Performance tips

This section contains some performance tips which can improve the experience of working with InMemoryDatasets. These tips are specially important when the package is handling huge data.

Make use of provided APIs

Avoid pushing single values

Avoid using String type for large data sets

Choose groupby or gatherby based on the problem in hand

Beware that every column must support missings

Master byrow

Don't avoid for loops!