bob.pipelines merge requestshttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests2021-03-22T16:13:46Zhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/62Implement a new simple generic csv-based database interface2021-03-22T16:13:46ZAmir MOHAMMADIImplement a new simple generic csv-based database interfaceDepends on https://gitlab.idiap.ch/bob/bob.extension/-/merge_requests/126Depends on https://gitlab.idiap.ch/bob/bob.extension/-/merge_requests/126Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/59Dask client names2020-12-11T18:50:32ZAmir MOHAMMADIDask client namesBob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/52[CheckpointWrapper] Allow custom save and load functions through estimator tags2020-11-27T11:17:16ZAmir MOHAMMADI[CheckpointWrapper] Allow custom save and load functions through estimator tagsBob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/50[DelayedSample(Set)] make load and delayed_attributes private2020-11-23T16:24:44ZAmir MOHAMMADI[DelayedSample(Set)] make load and delayed_attributes privateThis removes the need for a lot of guessing in downstream packages as they can start removing all keys that start with `_` when access of the sample's attribute is needed.This removes the need for a lot of guessing in downstream packages as they can start removing all keys that start with `_` when access of the sample's attribute is needed.Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/49[DelayedSample] Fix issues when an attribute was set2020-11-23T14:19:57ZAmir MOHAMMADI[DelayedSample] Fix issues when an attribute was setBob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/48Improvements on CheckpointWrapper2020-11-22T18:40:31ZTiago de Freitas PereiraImprovements on CheckpointWrapperAdded the optional argument `hash_fn` in the `CheckpointWrapper` class.
Once this is set, `sample.key` generates a hash code and this hash code is used to compose the final path where `sample` will be checkpointed.
This is optional and ...Added the optional argument `hash_fn` in the `CheckpointWrapper` class.
Once this is set, `sample.key` generates a hash code and this hash code is used to compose the final path where `sample` will be checkpointed.
This is optional and generic enough for our purposes.
This hash function can be shipped in the database interface.
Closes https://gitlab.idiap.ch/bob/bob.pipelines/-/issues/25Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/47Multiple changes2020-11-23T10:27:21ZAmir MOHAMMADIMultiple changes* [DelayedSample] Allow for arbitrary delayed attributes
* [SampleBatch] Allow other attributes than data
Fixes #26 #24* [DelayedSample] Allow for arbitrary delayed attributes
* [SampleBatch] Allow other attributes than data
Fixes #26 #24Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/46move vstack_features to bob.io.base2020-11-13T11:02:21ZAmir MOHAMMADImove vstack_features to bob.io.baseBob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/45Multiple Changes2020-11-11T08:17:48ZAmir MOHAMMADIMultiple Changes* When checkpointing, checkpoing all steps in a pipeline
* Better names in dask graph for FunctionTransformer
* [xarray] Allow for multi argument transformers
* SampleBatch in public API* When checkpointing, checkpoing all steps in a pipeline
* Better names in dask graph for FunctionTransformer
* [xarray] Allow for multi argument transformers
* SampleBatch in public APIBob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/43Allow setting specific attributes of sample2020-11-06T15:13:29ZYannick DAYERAllow setting specific attributes of sampleSpecify the sample attribute to assign the output of an estimator to, instead of 'data' in SampleWrapper.
Specify the attribute of sample to save and load in CheckpointWrapper.Specify the sample attribute to assign the output of an estimator to, instead of 'data' in SampleWrapper.
Specify the attribute of sample to save and load in CheckpointWrapper.Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/42Adding annotations-related wrappers2020-11-06T14:38:16ZYannick DAYERAdding annotations-related wrappersAdds an annotated Sample wrapper that wraps an annotator, feeding it `sample.data` and storing the resulting annotations in `sample.annotations`.
Also adds an annotations Checkpoint wrapper that saves and loads a `sample.annotations` to...Adds an annotated Sample wrapper that wraps an annotator, feeding it `sample.data` and storing the resulting annotations in `sample.annotations`.
Also adds an annotations Checkpoint wrapper that saves and loads a `sample.annotations` to the disk.Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/41Added a GPU queue that defaults to short_gpu2020-11-05T15:22:13ZYannick DAYERAdded a GPU queue that defaults to short_gpuBob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/40Add dask-client configurations as resources2020-10-12T14:19:51ZYannick DAYERAdd dask-client configurations as resourcesFixes #19
Removes the sge-demanding configuration as all nodes at Idiap have a fast connection now.
Depends on bob.bio.base!201Fixes #19
Removes the sge-demanding configuration as all nodes at Idiap have a fast connection now.
Depends on bob.bio.base!201Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/39[dask][sge] Added the variables `idle_timeout` and `allowed_failures` as2020-10-12T15:04:50ZTiago de Freitas Pereira[dask][sge] Added the variables `idle_timeout` and `allowed_failures` aspart of our `.bobrc` and added better defaultspart of our `.bobrc` and added better defaultsBob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/38[sge] In dask some sublacessd classes need a config name. Fixes #202020-10-12T11:25:49ZAmir MOHAMMADI[sge] In dask some sublacessd classes need a config name. Fixes #20Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/116Add support for a Slurm cluster2024-03-26T10:13:51ZYannick DAYERAdd support for a Slurm clusterAdds a config file and an entry point for a default Dask Client using Slurm.Adds a config file and an entry point for a default Dask Client using Slurm.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/115meta(deps): add bob as dependency in new structure2023-06-14T12:35:09ZYannick DAYERmeta(deps): add bob as dependency in new structureAdapt to the new structure of bob with `bob/bob` on top.Adapt to the new structure of bob with `bob/bob` on top.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/114meta [readme]: Switch the README.rst to markdown2023-05-11T10:17:37ZYannick DAYERmeta [readme]: Switch the README.rst to markdownRenames README.rst to README.md to be supported by the release script.Renames README.rst to README.md to be supported by the release script.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/113meta [entry-points]: Revert dask.client group name2023-03-28T12:52:29ZYannick DAYERmeta [entry-points]: Revert dask.client group nameSwitch back to `dask.client` instead of `bob.pipelines.dask.client` for
the dask Client entry-points group name in `pyproject.toml`.
Fixes #46.Switch back to `dask.client` instead of `bob.pipelines.dask.client` for
the dask Client entry-points group name in `pyproject.toml`.
Fixes #46.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/112Replace clapp by clapper.2023-03-01T15:08:41ZYannick DAYERReplace clapp by clapper.Yannick DAYERYannick DAYER