bob.pipelines merge requests
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests
2022-07-26T11:24:43Z
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/98
DelayedSample tweak
2022-07-26T11:24:43Z
Christophe ECABERT
DelayedSample tweak
## Changes
1. Make `kwargs` take precedence over parents' `delayed_attributes`. This change is made to follow more closely the implementation of the `Sample` class.
2. Make sure an attribute is not present in both `delayed_attributes` an...
## Changes
1. Make `kwargs` take precedence over parents' `delayed_attributes`. This change is made to follow more closely the implementation of the `Sample` class.
2. Make sure an attribute is not present in both `delayed_attributes` and `kwargs` of `__init__` function. Which is semantically not sound.
Yannick DAYER
Yannick DAYER
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/76
[docs] update docs to match new API of xarray
2021-10-29T15:34:58Z
Amir MOHAMMADI
[docs] update docs to match new API of xarray
Fixes #35
Disabled testing Sphinx docs on mac builds.
Fixes #35
Disabled testing Sphinx docs on mac builds.
Tiago de Freitas Pereira
Tiago de Freitas Pereira
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/28
Filelist datasets
2020-05-14T08:27:07Z
André Anjos
Filelist datasets
@tiago.pereira, @ydayer: here is the CSV and JSON implementations of **filelist**-based datasets I had in my package, for your review.
The way the API goes makes sense for an application scenario in which loading an individual sample is...
@tiago.pereira, @ydayer: here is the CSV and JSON implementations of **filelist**-based datasets I had in my package, for your review.
The way the API goes makes sense for an application scenario in which loading an individual sample is costly (e.g. sample data is stored on disk).
If the sample data is not stored on disk (e.g., a dataset that can be completely stored in a single CSV table), then using other techniques would be better (e.g. pandas data frames).
I hope it is useful.
Tiago de Freitas Pereira
Tiago de Freitas Pereira
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/96
Fix Dask documentation
2022-06-28T14:00:34Z
Flavio TARSETTI
Fix Dask documentation
This MR fixes the issues with the Dask documentation
This MR fixes the issues with the Dask documentation
Flavio TARSETTI
Flavio TARSETTI
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/15
Fix dask_it, mix_me_up, and CheckpointMixin.load
2020-03-27T06:54:08Z
Amir MOHAMMADI
Fix dask_it, mix_me_up, and CheckpointMixin.load
Tiago de Freitas Pereira
Tiago de Freitas Pereira
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/14
Fix dask_it, mix_me_up, and CheckpointMixin.load
2020-03-26T18:40:16Z
Amir MOHAMMADI
Fix dask_it, mix_me_up, and CheckpointMixin.load
Tiago de Freitas Pereira
Tiago de Freitas Pereira
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/64
Fix delayed attributes
2021-10-29T15:34:58Z
Yannick DAYER
Fix delayed attributes
Delayed attributes are no longer loaded when `_copy_attributes` is called to create a DelayedSample.
Delayed attributes are no longer loaded when `_copy_attributes` is called to create a DelayedSample.
Amir MOHAMMADI
Amir MOHAMMADI
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/29
Fixed mario.wrap([dask]). It was not possible to set the npartitions kwarg
2020-05-02T12:53:30Z
Tiago de Freitas Pereira
Fixed mario.wrap([dask]). It was not possible to set the npartitions kwarg
```python
mario.wrap(["dask"],pipeline, npartitions=n)
```
wasn't working.
```python
mario.wrap(["dask"],pipeline, npartitions=n)
```
wasn't working.
Amir MOHAMMADI
Amir MOHAMMADI
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/61
Fixed modules
2021-02-02T10:44:41Z
Tiago de Freitas Pereira
Fixed modules
config files from here are not available once `conda install bob.pipelines`
config files from here are not available once `conda install bob.pipelines`
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/54
Fixed multiqueue
2020-11-27T15:34:52Z
Tiago de Freitas Pereira
Fixed multiqueue
Hi @amohammadi @ydayer
I'm fixing here the issue raised with the multiqueue.
I was wrongly setting all tasks to run in a particular resource restriction.
Now the problem is fixed.
To get it running you have to wrap your pipeline in t...
Hi @amohammadi @ydayer
I'm fixing here the issue raised with the multiqueue.
I was wrongly setting all tasks to run in a particular resource restriction.
Now the problem is fixed.
To get it running you have to wrap your pipeline in the same
way as before and fetch the resources like this
```python
pipeline = bob.pipelines.wrap(
["sample", "checkpoint", "dask"],
pipeline,
model_path="./",
transform_extra_arguments=(("metadata", "metadata"),),
fit_tag="q_short_gpu",
)
from bob.pipelines.distributed.sge import get_resource_requirements
resources = get_resource_requirements(pipeline)
pipeline.fit_transform(X_as_sample).compute(
scheduler=client, resources=resources
)
```
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/86
Fix fit extra parameters
2022-04-25T17:44:22Z
Yannick DAYER
Fix fit extra parameters
Allowed extra fit parameters to be non-array (e.g. str).
Added a tag to prevent stacking of the input array of the fit method if it expects partitioned data.
Allowed extra fit parameters to be non-array (e.g. str).
Added a tag to prevent stacking of the input array of the fit method if it expects partitioned data.
Yannick DAYER
Yannick DAYER
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/81
Fix get_bob_tags to return default tags
2022-02-21T13:11:13Z
Yannick DAYER
Fix get_bob_tags to return default tags
When passing `None` as estimator to get_bob_tags, returns the default tags.
When passing `None` as estimator to get_bob_tags, returns the default tags.
Yannick DAYER
Yannick DAYER
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/79
Fixing compatibility issues with dask_jobqueue=0.7.2
2021-11-30T18:25:54Z
Tiago de Freitas Pereira
Fixing compatibility issues with dask_jobqueue=0.7.2
closes #37
Unfortunately we can't test this on the CI (there's no SGE there)
closes #37
Unfortunately we can't test this on the CI (there's no SGE there)
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/68
Fix parent's delayed_attributes modified by child
2021-10-29T15:34:58Z
Yannick DAYER
Fix parent's delayed_attributes modified by child
A `DelayedSample` child's `delayed_attributes` is no longer referencing the parent's `delayed_attributes`.
A `DelayedSample` child's `delayed_attributes` is no longer referencing the parent's `delayed_attributes`.
Amir MOHAMMADI
Amir MOHAMMADI
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/44
Fix sphinx warnings
2020-11-09T14:48:34Z
Amir MOHAMMADI
Fix sphinx warnings
Conda-based CI
Amir MOHAMMADI
Amir MOHAMMADI
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/100
Fix the doctest of xarray failing on python 3.8
2022-07-22T10:15:12Z
Yannick DAYER
Fix the doctest of xarray failing on python 3.8
Yannick DAYER
Yannick DAYER
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/36
For some reason, the class information is not passed in the sample wrapper
2020-08-31T10:13:47Z
Tiago de Freitas Pereira
For some reason, the class information is not passed in the sample wrapper
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/20
Get SampleSet to accept DelayedSample
2020-04-06T06:25:28Z
Yannick DAYER
Get SampleSet to accept DelayedSample
Quick fix to accept both Sample and DelayedSample objects in
SampleSet.insert.
Fixes #9
Quick fix to accept both Sample and DelayedSample objects in
SampleSet.insert.
Fixes #9
Tiago de Freitas Pereira
Tiago de Freitas Pereira
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/66
Handled failed processing (Failure to Acquire) in the wrappers
2021-10-29T15:34:58Z
Yannick DAYER
Handled failed processing (Failure to Acquire) in the wrappers
Fixes #32
Fixes #32
Amir MOHAMMADI
Amir MOHAMMADI
https://gitlab.idiap.ch/bob/bob.pipelines/-/merge_requests/70
Handle estimator tags in wrapper classes
2022-03-18T09:09:58Z
Yannick DAYER
Handle estimator tags in wrapper classes
Allows setting some parameters of the `SampleWrapper` and `CheckpointWrapper` via estimator tags.
bob.bio.base#143
Allows setting some parameters of the `SampleWrapper` and `CheckpointWrapper` via estimator tags.
bob.bio.base#143
Yannick DAYER
Yannick DAYER