bob.pipelines merge requestshttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests2024-01-08T13:57:33Zhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/109Add a way to retrieve protocol definition files2024-01-08T13:57:33ZYannick DAYERAdd a way to retrieve protocol definition filesRemoves `bob.extension`'s `get_file()`.Removes `bob.extension`'s `get_file()`.Roadmap to the major version of Bob 12Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/108Change UserDefaults calls to match last implementation2023-01-26T13:04:12ZAndré MAYORAZChange UserDefaults calls to match last implementationChanged UserDefaults calls to match the last implementation done in the package exposed.Changed UserDefaults calls to match the last implementation done in the package exposed.André MAYORAZAndré MAYORAZhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/106Update deprecated dask-jobqueue names2023-01-26T09:00:00ZYannick DAYERUpdate deprecated dask-jobqueue namesParameters from dask-jobqueue's classes (`Job` and `JobQueueCluster`) will change name soon. This follows those changes (`job_extra` to `job_extra_directives` and `env_extra` to `job_script_prologue`.
A config option (`jobqueue.sge.job-...Parameters from dask-jobqueue's classes (`Job` and `JobQueueCluster`) will change name soon. This follows those changes (`job_extra` to `job_extra_directives` and `env_extra` to `job_script_prologue`.
A config option (`jobqueue.sge.job-extra`) became invalid due to the name changes and returned `None` which was not handled correctly, making the submit commands fail silently and the scheduler waiting for the jobs. The option is now renamed.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/105[utils.py] changed return type in check_parameters_for_validity to ensure tha...2022-12-06T11:13:38ZAndré MAYORAZ[utils.py] changed return type in check_parameters_for_validity to ensure that a list is returnedCloses #44Closes #44André MAYORAZAndré MAYORAZhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/104Bob extension replacement2022-11-11T13:13:55ZYannick DAYERBob extension replacementPart of the replacement of bob.extension to exposed and auto-intersphinx. Related to #43.Part of the replacement of bob.extension to exposed and auto-intersphinx. Related to #43.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/103Add protocols as classmethod for FileListDatabase2022-11-11T23:33:08ZYannick DAYERAdd protocols as classmethod for FileListDatabaseAllows inheriting classes to retrieve a default protocols definition file and list protocols.Allows inheriting classes to retrieve a default protocols definition file and list protocols.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/102Ci refactoring2022-10-28T09:29:21ZAndré MAYORAZCi refactoringRefactoring of the CI process.
Linked to Issue #42Refactoring of the CI process.
Linked to Issue #42André MAYORAZAndré MAYORAZhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/101Pin numpy on the minor version2022-09-23T17:49:44ZYannick DAYERPin numpy on the minor versionPrevents increment of numpy minor version over the bob.devtools defined pin.Prevents increment of numpy minor version over the bob.devtools defined pin.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/100Fix the doctest of xarray failing on python 3.82022-07-22T10:15:12ZYannick DAYERFix the doctest of xarray failing on python 3.8Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/99remove sampleloaders and prepare for bob.bio.base!3002022-10-14T09:02:57ZAmir MOHAMMADIremove sampleloaders and prepare for bob.bio.base!300Needed for bob.bio.base!300Needed for bob.bio.base!300Roadmap to the major version of Bob 12Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/98DelayedSample tweak2022-07-26T11:24:43ZChristophe ECABERTDelayedSample tweak## Changes
1. Make `kwargs` take precedence over parents' `delayed_attributes`. This change is made to follow more closely the implementation of the `Sample` class.
2. Make sure an attribute is not present in both `delayed_attributes` an...## Changes
1. Make `kwargs` take precedence over parents' `delayed_attributes`. This change is made to follow more closely the implementation of the `Sample` class.
2. Make sure an attribute is not present in both `delayed_attributes` and `kwargs` of `__init__` function. Which is semantically not sound.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/97pipeline wrappers tweaks2022-07-08T08:24:12ZChristophe ECABERTpipeline wrappers tweaks## Changes
1. `SampleWrapper` to be able choose the type of output: `Sample` vs `DelayedSample`
2. `SampleWrapper` to make sure there is no invalid samples when calling `fit`
3. `DaskWrapper` to avoid calling `fit` multiple times## Changes
1. `SampleWrapper` to be able choose the type of output: `Sample` vs `DelayedSample`
2. `SampleWrapper` to make sure there is no invalid samples when calling `fit`
3. `DaskWrapper` to avoid calling `fit` multiple timesChristophe ECABERTChristophe ECABERThttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/96Fix Dask documentation2022-06-28T14:00:34ZFlavio TARSETTIFix Dask documentationThis MR fixes the issues with the Dask documentationThis MR fixes the issues with the Dask documentationFlavio TARSETTIFlavio TARSETTIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/95[datasets] remove fieldnames from CSVToSamples2022-06-13T10:11:25ZAmir MOHAMMADI[datasets] remove fieldnames from CSVToSamplesSince it can be provided as part of dict_reader_kwargs
Also reorganize the DelayedSample code and tests
to make things more readableSince it can be provided as part of dict_reader_kwargs
Also reorganize the DelayedSample code and tests
to make things more readableThe Great DeprecationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/94[hotfix] [Dask] Add configuration to access multithreaded queue2022-06-14T15:15:30ZLaurent COLBOIS[hotfix] [Dask] Add configuration to access multithreaded queueThis adds an additional queue configuration that asks for multithreaded jobs, thus doubling the virtual memory limit to 16GB.
With this fix I can run heavy Tensorflow baselines without OOM crash.
Long term it would be better to:
* Expos...This adds an additional queue configuration that asks for multithreaded jobs, thus doubling the virtual memory limit to 16GB.
With this fix I can run heavy Tensorflow baselines without OOM crash.
Long term it would be better to:
* Expose the exact thread multiplier (now 2 by default)
* Use the resource tagging of transformers to have the queue dynamically selected based on the transformerhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/93Add documentation for CSV databases2022-06-02T14:16:56ZAmir MOHAMMADIAdd documentation for CSV databasesThe Great DeprecationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/92better logging overall2022-05-20T12:15:42ZAmir MOHAMMADIbetter logging overallThe Great DeprecationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/91Many API changes2022-05-24T11:40:31ZAmir MOHAMMADIMany API changesExpose utils API in the root API.
Fix the docs API.
Remove unused transformers.
Fix SGE GPU submissions.Expose utils API in the root API.
Fix the docs API.
Remove unused transformers.
Fix SGE GPU submissions.The Great DeprecationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/90replace is_estimator_stateless with estimator_requires_fit2022-05-09T18:30:39ZAmir MOHAMMADIreplace is_estimator_stateless with estimator_requires_fitThe actual code before meant to check if an estimator
requires fit or not while the function was named is_estimator_stateless.The actual code before meant to check if an estimator
requires fit or not while the function was named is_estimator_stateless.The Great DeprecationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/89Load checkpointed estimators inside the scheduler2022-05-09T17:40:41ZAmir MOHAMMADILoad checkpointed estimators inside the schedulerAlso adds resilience to loading checkpointed samplesAlso adds resilience to loading checkpointed samplesThe Great DeprecationAmir MOHAMMADIAmir MOHAMMADI