Skip to content
GitLab
  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • bob.pipelines bob.pipelines
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 4
    • Issues 4
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • bob
  • bob.pipelinesbob.pipelines
  • Merge requests
  • !51

[dask][sge] Multiqueue updates

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Tiago de Freitas Pereira requested to merge multiqueue into master Nov 24, 2020
  • Overview 15
  • Commits 4
  • Pipelines 3
  • Changes 7

In this merge request I:

  • Simplified the way multi-queue is set in our scripts
  • Updated our Dask documentation

Example

Setting the fit method to run on q_short_gpu

pipeline = mario.wrap(
    ["sample", "checkpoint", "dask"],
    pipeline,
    model_path=model_path,
    fit_tag="q_short_gpu",
)

You have to explicitly set the list of resource tags available.

pipeline.fit_transform(...).compute(
    scheduler=dask_client, resources=cluster.get_sge_resources()
Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: multiqueue