Skip to content

PipelineSimple partitioning fixes

Redefined the heuristic for computing the dask partition sizes to prefer splitting the data between all the available workers.

Allowed the user to define a number of partitions instead of only a partition size.

Merge request reports

Loading