Skip to content
Snippets Groups Projects

[dask] Convert dask bags to arrays more efficiently

Merged [dask] Convert dask bags to arrays more efficiently
dask-bag-to-array into master
Merged Amir MOHAMMADI requested to merge dask-bag-to-array into master

Most inefficiencies were coming from that fact that we were creating a dask array with each sample as a separate chunk.

Edited by Amir MOHAMMADI

Merge request reports

Pipeline #59095 passed

Stage: build

Pipeline passed for 98426aeb on dask-bag-to-array

Merged by Amir MOHAMMADIAmir MOHAMMADI 3 years ago (Mar 18, 2022 11:48am UTC)

Loading

Pipeline #59723 failed

Stage: build
Stage: deploy

Pipeline failed for 6f011de1 on master

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Loading
  • Loading
  • Loading
  • Loading
Please register or sign in to reply