Skip to content

PipelineSimple partitioning fixes

Yannick DAYER requested to merge fix-partitions into master

Redefined the heuristic for computing the dask partition sizes to prefer splitting the data between all the available workers.

Allowed the user to define a number of partitions instead of only a partition size.

Merge request reports