bob issueshttps://gitlab.idiap.ch/groups/bob/-/issues2020-11-25T16:17:38Zhttps://gitlab.idiap.ch/bob/bob.db.base/-/issues/27check_parameters_for_validity does not handle empty lists as advertised2020-11-25T16:17:38ZYannick DAYERcheck_parameters_for_validity does not handle empty lists as advertisedPassing an empty list as parameter should be handled as `None` is: return `default_parameters`.
[bob.db.base.utils l.341](https://gitlab.idiap.ch/bob/bob.db.base/-/blob/2f2b60b6eb08564dcf6abcc6194b1210b15be579/bob/db/base/utils.py#L341)Passing an empty list as parameter should be handled as `None` is: return `default_parameters`.
[bob.db.base.utils l.341](https://gitlab.idiap.ch/bob/bob.db.base/-/blob/2f2b60b6eb08564dcf6abcc6194b1210b15be579/bob/db/base/utils.py#L341)Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/issues/149Follow-up from "Add a method to retrieve all the samples of a dataset"2020-11-26T13:36:47ZAmir MOHAMMADIFollow-up from "Add a method to retrieve all the samples of a dataset"The following discussion from !217 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/217#note_58672): (+2 comments)
> @ydayer what if groups is `["dev"]` or `["...The following discussion from !217 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/217#note_58672): (+2 comments)
> @ydayer what if groups is `["dev"]` or `["train", "dev"]` both options will return the same samples, no?Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/27The `DelayedSampleCall` makes pipelines memory greedy.2020-11-26T18:06:00ZTiago de Freitas PereiraThe `DelayedSampleCall` makes pipelines memory greedy.The way we delay transformer calls (look https://gitlab.idiap.ch/bob/bob.pipelines/-/blob/master/bob/pipelines/wrappers.py#L132) makes our pipeline super memory greedy.
I'm running a simple experiment **LOCALLY**, no dask involved, on `...The way we delay transformer calls (look https://gitlab.idiap.ch/bob/bob.pipelines/-/blob/master/bob/pipelines/wrappers.py#L132) makes our pipeline super memory greedy.
I'm running a simple experiment **LOCALLY**, no dask involved, on `bob.bio.base` wrapping everything with the `CheckpointWrapper`; and my experiment blows 32GB of my RAM + my swap without writing one single file from mine experiment.
Do you have any thoughts on this @amohammadi ?
Do you think is a good call the `DelayedSampleCall`?
Thanks
ping @ydayerBob 9.0.0https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/148Follow-up from "[VanillaBiometrics] Make some dask arguments visible in the C...2020-11-23T14:51:12ZTiago de Freitas PereiraFollow-up from "[VanillaBiometrics] Make some dask arguments visible in the CLI commands"The following discussion from !213 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/213#note_58461):
> @tiago.pereira please put `cls=ResourceOption` in these ...The following discussion from !213 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/213#note_58461):
> @tiago.pereira please put `cls=ResourceOption` in these options and `type` should be `click.Int`Bob 9.0.0https://gitlab.idiap.ch/bob/bob.pipelines/-/issues/26DelayedSamples with arbitrary delayed attributes2020-11-23T10:27:22ZAmir MOHAMMADIDelayedSamples with arbitrary delayed attributesI think it is often required that we load some attributes of sample in a lazy manner.
We do this using our DelayedSample class but the problem with that is that it can only delay loading of `data`.
We need a generic implementation that d...I think it is often required that we load some attributes of sample in a lazy manner.
We do this using our DelayedSample class but the problem with that is that it can only delay loading of `data`.
We need a generic implementation that delays the loading of everything like `sample.annotations`.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/25Better handling of file structures with CheckpointWrapper2021-08-13T11:13:09ZTiago de Freitas PereiraBetter handling of file structures with CheckpointWrapperSome databases have file structures very flat (with more than 30k files in a directory).
This is not good for the Idiap file structure and can let our I/O super slow.
We should implement a hash function in `CheckpointWrapper.make_path` ...Some databases have file structures very flat (with more than 30k files in a directory).
This is not good for the Idiap file structure and can let our I/O super slow.
We should implement a hash function in `CheckpointWrapper.make_path` that generates directory names given `sample.key` to limit the number of files in a directory to 1000 files.
ping @lcolbois (this touches experiments with IJB-C)https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/147[VanillaBiometrics] Delayed Samples larger than memory2020-11-23T08:37:44ZTiago de Freitas Pereira[VanillaBiometrics] Delayed Samples larger than memoryI guess @amohammadi is going to like this one.
IJB-C has an immense amount of probe samples (~128k) and summing up the size of all `DelayedSamples`, we have something around ~11GB of metadata. Remember that each probe sample holds the b...I guess @amohammadi is going to like this one.
IJB-C has an immense amount of probe samples (~128k) and summing up the size of all `DelayedSamples`, we have something around ~11GB of metadata. Remember that each probe sample holds the biometric reference keys that we should be comparing at scoring time.
If we run an experiment with IJB-C using our `sge` default setup that starts with one `worker`, (adaptive scale up/down workers due to load) vanilla-biometrics crashes in memory error before start doing work.
Dask can't scale up the number of workers at this stage.
A solution for this is obviously to distribute this data among several workers.
A possible way to approach this would be either, i-) to estimate the size of all DelayedSamples and create a heuristic to set `n` in `dask_client.cluster.scale_up(n)` before running `.compute` or ii-) add an optional argument in the vanilla biometrics CLI command allowing to set the number of workers to start vanilla-biometrics
ping @lcolbois
PS: XArrays, possibly in the futureBob 9.0.0https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/146[API] Database interface - retrieve all samples2020-11-25T10:53:09ZYannick DAYER[API] Database interface - retrieve all samplesThe new Database interface is missing a way of retrieving every samples of a dataset (e.g. for annotations).
A method like `all_samples()` should exist, that returns a list of `bob.pipelines.Sample` from every set (background_model_samp...The new Database interface is missing a way of retrieving every samples of a dataset (e.g. for annotations).
A method like `all_samples()` should exist, that returns a list of `bob.pipelines.Sample` from every set (background_model_samples, probes and references) and every group (dev and eval).Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/24Do not cache data in DelayedSample2020-11-23T10:27:21ZAmir MOHAMMADIDo not cache data in DelayedSampleThis is important as loading DelayedSamples and stacking them in SampleBatch
will lead to the data being kept in the memory twice.
For example, see:
```python
import bob.pipelines as mario
import numpy as np
from functools import partial...This is important as loading DelayedSamples and stacking them in SampleBatch
will lead to the data being kept in the memory twice.
For example, see:
```python
import bob.pipelines as mario
import numpy as np
from functools import partial
a = np.zeros((1000, 1000))
def load(i):
# normally we load an array from disk
return a[i]
samples = [mario.DelayedSample(partial(load, i=i)) for i in range(len(a))]
samples[:2]
# [DelayedSample(load=functools.partial(<function load at 0x7fb1c90250d0>, i=0)),
# DelayedSample(load=functools.partial(<function load at 0x7fb1c90250d0>, i=1))]
a2 = np.array(mario.SampleBatch(samples))
np.shares_memory(a, a2)
# False
```
so you can see that SampleBatch always leads to a copy of data and caching data
in delayed samples always leads to doulbe memory usage.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/23What is the purpose of sge_gpu.py2020-12-03T19:06:47ZAmir MOHAMMADIWhat is the purpose of sge_gpu.pyI thought the whole idea of our pipelines was to use resource tags to properly allocate jobs to the correct worker.
But, now I see that we have 2 config files: `sge_default` and `sge_gpu`, why is that?
Is this because resource tags are ...I thought the whole idea of our pipelines was to use resource tags to properly allocate jobs to the correct worker.
But, now I see that we have 2 config files: `sge_default` and `sge_gpu`, why is that?
Is this because resource tags are not known? I think this issue is also relevant to https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/145Bob 9.0.0https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/145It's not possible to provide a dask wrapped pipeline and a dask client2020-11-17T09:53:56ZAmir MOHAMMADIIt's not possible to provide a dask wrapped pipeline and a dask clientI want to use custom dask tags and hence want to wrap the estimators myself in the config file.
but this is not possible as when I provide a dask client, the pipeline is again wrapped in dask.I want to use custom dask tags and hence want to wrap the estimators myself in the config file.
but this is not possible as when I provide a dask client, the pipeline is again wrapped in dask.Bob 9.0.0https://gitlab.idiap.ch/bob/bob.ip.tensorflow_extractor/-/issues/12Archive this package2021-03-16T17:22:47ZTiago de Freitas PereiraArchive this packageSince all the feature extractors are in `bob.bio.face` and we'll move MTCNN to `bob.ip.facedetect`, we can archive this package.
ping @ydayer @amohammadiSince all the feature extractors are in `bob.bio.face` and we'll move MTCNN to `bob.ip.facedetect`, we can archive this package.
ping @ydayer @amohammadiBob 9.0.0https://gitlab.idiap.ch/bob/bob.ip.facedetect/-/issues/9flandmark tests are failing2020-11-12T08:09:01ZAmir MOHAMMADIflandmark tests are failingJob [#217314](https://gitlab.idiap.ch/bob/bob.ip.facedetect/-/jobs/217314) failed for 2be4298bf22eed2fc3cea6fe44421cf932013861:
```
nosetests --with-coverage -sv bob.ip.flandmark
bob.ip.flandmark.test.test_is_inside ... ok
bob.ip.flandma...Job [#217314](https://gitlab.idiap.ch/bob/bob.ip.facedetect/-/jobs/217314) failed for 2be4298bf22eed2fc3cea6fe44421cf932013861:
```
nosetests --with-coverage -sv bob.ip.flandmark
bob.ip.flandmark.test.test_is_inside ... ok
bob.ip.flandmark.test.test_is_outside ... ok
bob.ip.flandmark.test.test_lena ... ERROR
bob.ip.flandmark.test.test_full_image ... ERROR
bob.ip.flandmark.test.test_multi ... ERROR
======================================================================
ERROR: bob.ip.flandmark.test.test_lena
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/test.py", line 93, in test_lena
img = bob.io.base.load(LENA)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/base/__init__.py", line 143, in load
return File(inputs, 'r').read()
RuntimeError: File - constructor: C++ exception caught: 'file '/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/data/lena.jpg' is not readable'
======================================================================
ERROR: bob.ip.flandmark.test.test_full_image
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/test.py", line 106, in test_full_image
img = bob.io.base.load(LENA)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/base/__init__.py", line 143, in load
return File(inputs, 'r').read()
RuntimeError: File - constructor: C++ exception caught: 'file '/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/data/lena.jpg' is not readable'
======================================================================
ERROR: bob.ip.flandmark.test.test_multi
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/test.py", line 118, in test_multi
img = bob.io.base.load(MULTI)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/base/__init__.py", line 143, in load
return File(inputs, 'r').read()
RuntimeError: File - constructor: C++ exception caught: 'file '/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/data/multi.jpg' is not readable'
```Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.io.video/-/issues/17Distortions of codecs have increased when updating to ffmpeg 4.22020-11-11T10:37:38ZAmir MOHAMMADIDistortions of codecs have increased when updating to ffmpeg 4.2Job [#216885](https://gitlab.idiap.ch/bob/bob.io.video/-/jobs/216885) failed for 6ba1f0c2c3a2c34ccba26e8855cf2042e7a9cc5b:
```
======================================================================
FAIL: bob.io.video.test_codec.test_nois...Job [#216885](https://gitlab.idiap.ch/bob/bob.io.video/-/jobs/216885) failed for 6ba1f0c2c3a2c34ccba26e8855cf2042e7a9cc5b:
```
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1855 > 0.5 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07322 > 9 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 75.0667 > 55 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1855 > 0.4 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07322 > 9 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 74.8509 > 50 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.5 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 75.3535 > 55 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.4 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 74.7213 > 50 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.4 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 74.7949 > 50 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.5 allowed for format `mp4' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mp4' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 75.3753 > 55 allowed for format `mp4' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 4.13493 > 2.7 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 4.13493 > 2.5 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.7 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.5 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.5 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.7 allowed for format `mp4' and codec `h264'
```Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/22Provide mechanism for reading database lists from inside a zip file and a mec...2020-12-04T18:26:20ZAmir MOHAMMADIProvide mechanism for reading database lists from inside a zip file and a mechanism to download themThe filelist databases interfaces are excellent but I think we're lacking two features:
* [x] Reading the filelists from inside a zip file (to save space).
* [x] Automatic downloading of these filelists and saving them in e.g. `~/.bob...The filelist databases interfaces are excellent but I think we're lacking two features:
* [x] Reading the filelists from inside a zip file (to save space).
* [x] Automatic downloading of these filelists and saving them in e.g. `~/.bob` for convenience.
I don't think these file lists should be checked into the source code and I think they should be managed
the same way as we handle deep learning models.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.vein/-/issues/24MaximumCurvature Config file2020-12-03T08:36:47ZHatef OTROSHIMaximumCurvature Config fileI was looking at the MaximumCurvature config file and I noticed that at
[#L41](https://gitlab.idiap.ch/bob/bob.bio.vein/-/blob/master/bob/bio/vein/config/maximum_curvature.py#L41) the subdirectory is defined `rlt`. I think it should be...I was looking at the MaximumCurvature config file and I noticed that at
[#L41](https://gitlab.idiap.ch/bob/bob.bio.vein/-/blob/master/bob/bio/vein/config/maximum_curvature.py#L41) the subdirectory is defined `rlt`. I think it should be `mc`, because it is for Maximum Curvature (MC) method.https://gitlab.idiap.ch/bob/bob.devtools/-/issues/61inconsistent builds between per project builds and nightlies2020-11-09T10:23:14ZAmir MOHAMMADIinconsistent builds between per project builds and nightliesRecently, some packages pipelines fail when tested independently like:
https://gitlab.idiap.ch/bob/bob.blitz/-/jobs/215922
and https://gitlab.idiap.ch/bob/bob.math/-/jobs/215931
but they build successfully when tested in nightlies: https...Recently, some packages pipelines fail when tested independently like:
https://gitlab.idiap.ch/bob/bob.blitz/-/jobs/215922
and https://gitlab.idiap.ch/bob/bob.math/-/jobs/215931
but they build successfully when tested in nightlies: https://gitlab.idiap.ch/bob/nightlies/-/jobs/215787
What could be the difference here? I just noticed that nightlies still uses our old docker image. So I will change that to see that will fix this issue.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.ip.optflow.liu/-/issues/2DEPRECATION2020-11-06T15:35:00ZTiago de Freitas PereiraDEPRECATIONThis package will go away too
ping @ydayer @amohammadiThis package will go away too
ping @ydayer @amohammadihttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/21Who is Mario?2024-01-08T13:58:44ZTiago de Freitas PereiraWho is Mario?There are several places in the code where we alias `bob.pipelines` as Mario.
Well, it was a good joke at the beginning but now we need to think if we want to keep this.There are several places in the code where we alias `bob.pipelines` as Mario.
Well, it was a good joke at the beginning but now we need to think if we want to keep this.Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.extension/-/issues/77Invalid C declaration warnings on macros with type hinted arguments2020-11-06T09:56:19ZAmir MOHAMMADIInvalid C declaration warnings on macros with type hinted argumentsBuilds fail with sphinx 3.2.1 see https://github.com/sphinx-doc/sphinx/issues/8379Builds fail with sphinx 3.2.1 see https://github.com/sphinx-doc/sphinx/issues/8379Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADI