Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • bob.devtools bob.devtools
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 4
    • Issues 4
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • bobbob
  • bob.devtoolsbob.devtools
  • Merge requests
  • !317

Preserve caches during git-clean

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged André Anjos requested to merge preserve-caches into master Sep 12, 2022
  • Overview 0
  • Commits 1
  • Pipelines 1
  • Changes 1

This MR introduces a fix to the bdt clean command, preserving pre-commit and torch caches so the gitlab-runner can actually store them. Otherwise, .cache directories are removed and not cached between builds. You can see that already happening in some examples, despite running pre-commit (at least):

  • https://gitlab.idiap.ch/bob/bob.extension/-/jobs/274957
  • https://gitlab.idiap.ch/bob/bob.bio.face/-/jobs/279560

That said, IDK if using the after_script section of bootstrap wouldn't be cleverer to carry on the bdt clean operation. It is run no matter what. The second point is that we should probably list what to keep on the CI file itself. Currently, things to cache are defined on the CI file, whereas what to clean defined in a Python file. At least by moving what to clean into the CI file everything would be defined in a single easy to maintain place.

Edited Sep 12, 2022 by André Anjos
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: preserve-caches