bob issueshttps://gitlab.idiap.ch/groups/bob/-/issues2022-03-03T17:36:30Zhttps://gitlab.idiap.ch/bob/bob.pad.face/-/issues/38Follow-up from "Porting to dask pipelines"2022-03-03T17:36:30ZTiago de Freitas PereiraFollow-up from "Porting to dask pipelines"The following discussion from !110 should be addressed:
- [ ] @tiago.pereira started a [discussion](https://gitlab.idiap.ch/bob/bob.pad.face/-/merge_requests/110#note_58850): (+2 comments)
> Hey, does it make sense to keep those n...The following discussion from !110 should be addressed:
- [ ] @tiago.pereira started a [discussion](https://gitlab.idiap.ch/bob/bob.pad.face/-/merge_requests/110#note_58850): (+2 comments)
> Hey, does it make sense to keep those names `preprocessor`, `extractor`?
>
> ThanksBob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/29jman (gridtk) like interface for submitting dask jobs2024-03-21T10:21:20ZAmir MOHAMMADIjman (gridtk) like interface for submitting dask jobsWe need:
1. A command that automatically creates a dask client for us to be used for SGE submission.
2. A history of the commands that were executed.
3. An automatic tracking of dask logs.We need:
1. A command that automatically creates a dask client for us to be used for SGE submission.
2. A history of the commands that were executed.
3. An automatic tracking of dask logs.Bob 9.0.0https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/150There is no need to create yet another database abstract class2020-12-07T13:24:55ZAmir MOHAMMADIThere is no need to create yet another database abstract classI can see that the new pipelines could very well use our old database interfaces and adding another class is just going to create too many layers for us IMHO.I can see that the new pipelines could very well use our old database interfaces and adding another class is just going to create too many layers for us IMHO.Bob 9.0.0https://gitlab.idiap.ch/bob/nightlies/-/issues/58Job Failed #219230 bob.bio.video builds conflict in the nightlies only2020-12-01T11:08:26ZAmir MOHAMMADIJob Failed #219230 bob.bio.video builds conflict in the nightlies onlyJob [#219230](https://gitlab.idiap.ch/bob/nightlies/-/jobs/219230) failed for 363d726087f9b9c2b52992d71517c183ef660a45:
```
================================================================================
Building bob/bob.bio.video@maste...Job [#219230](https://gitlab.idiap.ch/bob/nightlies/-/jobs/219230) failed for 363d726087f9b9c2b52992d71517c183ef660a45:
```
================================================================================
Building bob/bob.bio.video@master (57/75)
================================================================================
INFO:bob.devtools.scripts.ci@2020-11-26 23:48:45,587: Cloning "bob/bob.bio.video", branch "master" (depth=1)...
INFO:bob.devtools.scripts.ci@2020-11-26 23:48:48,463: Conda build configuration file: /scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/data/conda_build_config.yaml
INFO:bob.devtools.scripts.ci@2020-11-26 23:48:48,464: Conda build recipe-append file: /scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/data/recipe_append.yaml
INFO:bob.devtools.scripts.build@2020-11-26 23:48:48,471: Using the following channels during (potential) build:
- http://www.idiap.ch/software/bob/conda/label/beta
- http://www.idiap.ch/software/bob/conda
- defaults
INFO:bob.devtools.scripts.build@2020-11-26 23:48:48,471: Uploading resulting package to: http://www.idiap.ch/software/bob/conda/label/beta
INFO:bob.devtools.bootstrap@2020-11-26 23:48:49,332: environ["MATPLOTLIBRC"] = /scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/data
INFO:bob.devtools.bootstrap@2020-11-26 23:48:49,332: environ["DOCSERVER"] = http://www.idiap.ch
INFO:bob.devtools.bootstrap@2020-11-26 23:48:49,332: environ["BOB_DOCUMENTATION_SERVER"] = http://www.idiap.ch/software/bob/docs/bob/%(name)s/master/
INFO:bob.devtools.bootstrap@2020-11-26 23:48:49,332: environ["NOSE_EVAL_ATTR"] = not slow
INFO:bob.devtools.bootstrap@2020-11-26 23:48:49,332: environ["PYTEST_ADDOPTS"] = -m 'not slow'
INFO:bob.devtools.bootstrap@2020-11-26 23:48:49,333: environ["BOB_PACKAGE_VERSION"] = 3.4.7b0
/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/environ.py:452: UserWarning: The environment variable 'DOCSERVER' is being passed through with value 'http://www.idiap.ch'. If you are splitting build and test phases with --no-test, please ensure that this value is also set similarly at test time.
UserWarning
/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/environ.py:452: UserWarning: The environment variable 'NOSE_EVAL_ATTR' is being passed through with value 'not slow'. If you are splitting build and test phases with --no-test, please ensure that this value is also set similarly at test time.
UserWarning
/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/environ.py:452: UserWarning: The environment variable 'PYTEST_ADDOPTS' is being passed through with value '-m 'not slow''. If you are splitting build and test phases with --no-test, please ensure that this value is also set similarly at test time.
UserWarning
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working...
Found conflicts! Looking for incompatible packages.
This can take several minutes. Press CTRL-C to abort.
failed
Traceback (most recent call last):
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/environ.py", line 802, in get_install_actions
actions = install_actions(prefix, index, specs, force=True)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
return f(*args, **kwds)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/plan.py", line 474, in install_actions
txn = solver.solve_for_transaction(prune=prune, ignore_pinned=not pinned)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/core/solve.py", line 117, in solve_for_transaction
should_retry_solve)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/core/solve.py", line 158, in solve_for_diff
force_remove, should_retry_solve)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/core/solve.py", line 281, in solve_final_state
ssc = self._run_sat(ssc)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
return f(*args, **kwds)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/core/solve.py", line 808, in _run_sat
should_retry_solve=ssc.should_retry_solve
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/common/io.py", line 88, in decorated
return f(*args, **kwds)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/resolve.py", line 1318, in solve
self.find_conflicts(specs, specs_to_add, history_specs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda/resolve.py", line 351, in find_conflicts
raise UnsatisfiableError(bad_deps, strict=strict_channel_priority)
conda.exceptions.UnsatisfiableError: The following specifications were found to be incompatible with each other:
Output in format: Requested package -> Available versions
Package python conflicts for:
setuptools=50.3.0 -> certifi[version='>=2016.9.26'] -> python
h5py=2.10.0 -> python[version='>=3.6,<3.7.0a0|>=3.8,<3.9.0a0|>=3.7,<3.8.0a0']
bob.io.video -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|3.4.*']
bob.extension -> click[version='>=7.1.2,<8.0a0'] -> python[version='>=3.8,<3.9.0a0|>=3.9,<3.10.0a0']
setuptools=50.3.0 -> python[version='>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.9,<3.10.0a0|>=3.8,<3.9.0a0']
bob.io.base -> boost[version='>=1.73.0,<1.73.1.0a0'] -> python[version='>=3.8,<3.9.0a0|>=3.9,<3.10.0a0']
bob.bio.face -> python[version='>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0']
python=3.7
bob.extension -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|3.4.*']
bob.bio.face -> scikit-image[version='>=0.17.2,<1.0a0'] -> python[version='>=3.8,<3.9.0a0|>=3.9,<3.10.0a0']
h5py=2.10.0 -> six -> python[version='>=3.9,<3.10.0a0']
scikit-learn=0.23.2 -> joblib[version='>=0.11'] -> python[version='>=3.5|>=3.6']
bob.bio.base -> python[version='>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0']
scikit-learn=0.23.2 -> python[version='>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.8,<3.9.0a0']
bob.bio.base -> scipy -> python[version='>=3.8,<3.9.0a0|>=3.9,<3.10.0a0']
bob.io.base -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|3.4.*']
bob.io.video -> boost[version='>=1.73.0,<1.73.1.0a0'] -> python[version='>=3.8,<3.9.0a0|>=3.9,<3.10.0a0']
Package bob.extension conflicts for:
bob.bio.face -> bob.blitz[version='>=2.0.20,<3.0a0'] -> bob.extension[version='>=3.1.2,<4.0a0|>=5.0.0,<6.0a0']
bob.io.base -> bob.extension[version='>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.1.2,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.0,<6.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']
bob.bio.face -> bob.extension[version='>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']
bob.extension
bob.io.video -> bob.blitz[version='>=2.0.20,<3.0a0'] -> bob.extension[version='>=3.1.2,<4.0a0|>=5.0.0,<6.0a0']
bob.io.video -> bob.extension[version='>2.0.4|>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']
bob.bio.base -> bob.blitz[version='>=2.0.20,<3.0a0'] -> bob.extension[version='>=3.1.2,<4.0a0|>=5.0.0,<6.0a0']
bob.bio.base -> bob.extension[version='>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']
Package h5py conflicts for:
bob.bio.base -> bob.pipelines -> h5py[version='>=2.10.0,<3.0a0|>=2.8.0,<3.0a0']
h5py=2.10.0
Package hdf5 conflicts for:
h5py=2.10.0 -> hdf5[version='>=1.10.4,<1.10.5.0a0|>=1.10.6,<1.10.7.0a0']
bob.bio.base -> bob.io.base[version='>=3.0.10b.0,<4.0a0'] -> hdf5[version='>=1.10.1,<1.10.2.0a0|>=1.10.2,<1.10.3.0a0|>=1.10.6,<1.10.7.0a0']
bob.io.base -> hdf5[version='1.8.17|1.8.17.*|>=1.10.1,<1.10.2.0a0|>=1.10.2,<1.10.3.0a0|>=1.10.6,<1.10.7.0a0']
bob.bio.face -> bob.io.base[version='>=3.0.10b.0,<4.0a0'] -> hdf5[version='>=1.10.1,<1.10.2.0a0|>=1.10.2,<1.10.3.0a0|>=1.10.6,<1.10.7.0a0']
bob.io.video -> bob.io.base[version='>=3.0.10b.0,<4.0a0'] -> hdf5[version='1.8.17|1.8.17.*|>=1.10.1,<1.10.2.0a0|>=1.10.2,<1.10.3.0a0|>=1.10.6,<1.10.7.0a0']
Package numpy conflicts for:
numpy=1.16
bob.bio.base -> numpy[version='<1.18']
bob.io.base -> numpy[version='1.12.*|1.13.*|>=1.14.5,<2.0a0|>=1.15.4,<2.0a0|>=1.16.6,<2.0a0|>=1.17.4,<2.0a0|>=1.9.3,<2.0a0']
h5py=2.10.0 -> numpy[version='>=1.11.3,<2.0a0|>=1.14.6,<2.0a0']
bob.io.video -> numpy[version='1.12.*|1.13.*|>=1.14.5,<2.0a0|>=1.15.4,<2.0a0|>=1.16.6,<2.0a0|>=1.9.3,<2.0a0']
scikit-learn=0.23.2 -> scipy -> numpy[version='>=1.11.3,<2.0a0|>=1.15.1,<2.0a0|>=1.9.3,<2.0a0']
bob.io.base -> bob.blitz -> numpy=1.11
bob.bio.face -> bob.blitz[version='>=2.0.23b.0,<3.0a0'] -> numpy[version='<1.18|>=1.14.6,<2.0a0|>=1.16.6,<2.0a0|>=1.17.4,<2.0a0|>=1.15.4,<2.0a0|>=1.14.5,<2.0a0|>=1.9.3,<2.0a0']
scikit-learn=0.23.2 -> numpy[version='>=1.14.6,<2.0a0']
bob.io.video -> bob.blitz[version='>=2.0.23b.0,<3.0a0'] -> numpy[version='1.11.*|>=1.17.4,<2.0a0']
bob.bio.base -> bob.blitz[version='>=2.0.23b.0,<3.0a0'] -> numpy[version='>=1.11.3,<2.0a0|>=1.14.6,<2.0a0|>=1.16.6,<2.0a0|>=1.17.4,<2.0a0|>=1.19.2,<2.0a0|>=1.15.1,<2.0a0|>=1.9.3,<2.0a0|>=1.15.4,<2.0a0|>=1.14.5,<2.0a0']
Package _libgcc_mutex conflicts for:
numpy=1.16 -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
h5py=2.10.0 -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
bob.io.video -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
scikit-learn=0.23.2 -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
python=3.7 -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
bob.io.base -> libgcc-ng[version='>=7.3.0'] -> _libgcc_mutex=[build=main]
Package bob.io.base conflicts for:
bob.bio.face -> bob.measure[version='>=4.2.0,<5.0a0'] -> bob.io.base[version='>=3.0.8,<4.0a0']
bob.bio.face -> bob.io.base[version='>=3.0.10b.0,<4.0a0|>=3.0.9,<4.0a0|>=3.0.7,<4.0a0|>=3.0.6,<4.0a0|>=3.0.5,<4.0a0|>=3.0.4,<4.0a0|>=3.0.3,<4.0a0']
bob.io.base
bob.bio.base -> bob.io.base[version='>=3.0.10b.0,<4.0a0|>=3.0.9,<4.0a0|>=3.0.7,<4.0a0|>=3.0.6,<4.0a0|>=3.0.5,<4.0a0|>=3.0.4,<4.0a0|>=3.0.3,<4.0a0']
bob.io.video -> bob.io.base[version='>=3.0.10b.0,<4.0a0|>=3.0.9,<4.0a0|>=3.0.7,<4.0a0|>=3.0.6,<4.0a0|>=3.0.5,<4.0a0|>=3.0.4,<4.0a0|>=3.0.3,<4.0a0']
bob.bio.base -> bob.measure[version='>=4.2.0,<5.0a0'] -> bob.io.base[version='>=3.0.8,<4.0a0']
Package setuptools conflicts for:
bob.extension -> setuptools
bob.io.base -> setuptools
bob.io.video -> setuptools
bob.bio.base -> setuptools
bob.bio.face -> setuptools
setuptools=50.3.0
scikit-learn=0.23.2 -> joblib[version='>=0.11'] -> setuptools
Package ca-certificates conflicts for:
bob.bio.face -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
bob.extension -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
bob.io.video -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
bob.io.base -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
bob.bio.base -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
python=3.7 -> openssl[version='>=1.1.1g,<1.1.2a'] -> ca-certificates
Package numpy-base conflicts for:
numpy=1.16 -> mkl_fft[version='>=1.0.6,<2.0a0'] -> numpy-base[version='>=1.0.2,<2.0a0|>=1.0.6,<2.0a0']
numpy=1.16 -> numpy-base[version='1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.2|1.16.2|1.16.2|1.16.2|1.16.3|1.16.3|1.16.3|1.16.3|1.16.4|1.16.4|1.16.4|1.16.4|1.16.5|1.16.5|1.16.5|1.16.5|1.16.6',build='py37h2f8d375_0|py36hde5b4d6_0|py37h2f8d375_1|py36hde5b4d6_1|py37h2f8d375_1|py36h2f8d375_1|py36hde5b4d6_0|py37h2f8d375_0|py37h2f8d375_0|py36hde5b4d6_0|py37h2f8d375_0|py38h2f8d375_0|py38hde5b4d6_0|py36hde5b4d6_0|py37hde5b4d6_0|py36h2f8d375_0|py37hde5b4d6_0|py36h2f8d375_0|py36hde5b4d6_0|py37hde5b4d6_0|py36h2f8d375_0|py37hde5b4d6_0|py36h2f8d375_0|py37h2f8d375_0|py36hde5b4d6_0|py37hde5b4d6_0|py36h2f8d375_0|py37h2f8d375_0|py36hde5b4d6_1|py37hde5b4d6_1|py37hde5b4d6_0|py36hde5b4d6_0|py36h2f8d375_0|py37h2f8d375_0|py37hde5b4d6_1|py36h2f8d375_1|py36h2f8d375_0|py37hde5b4d6_0']
Package six conflicts for:
bob.bio.base -> six
bob.bio.face -> six[version='>=1.15.0,<2.0a0']
numpy=1.16 -> mkl-service[version='>=2,<3.0a0'] -> six
h5py=2.10.0 -> six
Package scipy conflicts for:
bob.bio.face -> bob.bio.base[version='>=4.1.2b.0,<5.0a0'] -> scipy[version='>=0.19|>=1.5.2,<2.0a0']
scikit-learn=0.23.2 -> scipy
bob.bio.base -> scipy
Package certifi conflicts for:
setuptools=50.3.0 -> certifi[version='>=2016.9.26']
bob.io.base -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
bob.io.video -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
bob.extension -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
bob.bio.base -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
bob.bio.face -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
Package mkl_random conflicts for:
bob.io.video -> numpy[version='>=1.16.6,<2.0a0'] -> mkl_random[version='>=1.0.2,<2.0a0']
bob.io.base -> numpy[version='>=1.16.6,<2.0a0'] -> mkl_random[version='>=1.0.2,<2.0a0']
h5py=2.10.0 -> numpy[version='>=1.14.6,<2.0a0'] -> mkl_random[version='>=1.0.2,<2.0a0']
bob.bio.base -> numpy[version='<1.18'] -> mkl_random[version='>=1.0.2,<2.0a0']
numpy=1.16 -> mkl_random[version='>=1.0.2,<2.0a0']
scikit-learn=0.23.2 -> numpy[version='>=1.14.6,<2.0a0'] -> mkl_random[version='>=1.0.2,<2.0a0']
Package libtiff conflicts for:
bob.bio.face -> bob.io.image[version='>=2.5.0b.0,<3.0a0'] -> libtiff[version='>=4.0.9,<5.0a0|>=4.1.0,<5.0a0']
bob.io.video -> pillow -> libtiff[version='>=4.0.10,<5.0a0|>=4.1.0,<5.0a0|>=4.0.9,<5.0a0|>=4.0.8,<5.0a0']
Package scikit-learn conflicts for:
scikit-learn=0.23.2
bob.bio.base -> bob.pipelines -> scikit-learn[version='>=0.22.1,<1.0a0|>=0.23.2,<1.0a0']
Package py-boost conflicts for:
bob.io.video -> boost[version='>=1.73.0,<1.73.1.0a0'] -> py-boost[version='1.65.1|1.67.0|1.67.0|1.73.0',build='py36hff4598c_3|py36h04863e7_4|py37h04863e7_4|py38h962f231_10|py38h962f231_11|py37h962f231_11|py36h962f231_11|py36h962f231_10|py37h962f231_10']
bob.io.base -> boost[version='>=1.73.0,<1.73.1.0a0'] -> py-boost[version='1.65.1|1.67.0|1.67.0|1.73.0',build='py36hff4598c_3|py36h04863e7_4|py37h04863e7_4|py38h962f231_10|py38h962f231_11|py37h962f231_11|py36h962f231_11|py36h962f231_10|py37h962f231_10']
Package bob.bio.base conflicts for:
bob.bio.base
bob.bio.face -> bob.bio.base[version='>=3.3.0,<4.0a0|>=4.0.0,<5.0a0|>=4.0.1,<5.0a0|>=4.0.2,<5.0a0|>=4.1.0,<5.0a0|>=4.1.1,<5.0a0|>=4.1.2b.0,<5.0a0']
Note that strict channel priority may have removed packages required for satisfiability.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/scratch/builds/bob/nightlies/miniconda/bin/bdt", line 11, in <module>
sys.exit(main())
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/scripts/bdt.py", line 43, in _decorator
value = view_func(*args, **kwargs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func
return f(get_current_context(), *args, **kwargs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/scripts/ci.py", line 708, in nightlies
test_mark_expr=os.environ.get("TEST_MARK_EXPR", ""),
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/scripts/bdt.py", line 43, in _decorator
value = view_func(*args, **kwargs)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/scripts/build.py", line 252, in build
metadata = get_rendered_metadata(d, conda_config)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/bob/devtools/build.py", line 228, in get_rendered_metadata
return conda_build.api.render(recipe_dir, config=config)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/api.py", line 45, in render
permit_unsatisfiable_variants=permit_unsatisfiable_variants)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/render.py", line 834, in render_recipe
allow_no_other_outputs=True, bypass_env_check=bypass_env_check)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/render.py", line 736, in distribute_variants
bypass_env_check=bypass_env_check)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/metadata.py", line 1041, in parse_until_resolved
bypass_env_check=bypass_env_check)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/metadata.py", line 963, in parse_again
bypass_env_check=bypass_env_check),
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/metadata.py", line 1554, in _get_contents
rendered = template.render(environment=env)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/jinja2/environment.py", line 1090, in render
self.environment.handle_exception()
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/jinja2/environment.py", line 832, in handle_exception
reraise(*rewrite_traceback_stack(source=source))
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/jinja2/_compat.py", line 28, in reraise
raise value.with_traceback(tb)
File "/scratch/builds/bob/nightlies/src/bob/bob.bio.video/conda/meta.yaml", line 34, in top-level template code
- {{ pin_compatible('numpy') }}
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/jinja_context.py", line 230, in pin_compatible
pins, _, _ = get_env_dependencies(m, 'host', m.config.variant)
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/render.py", line 149, in get_env_dependencies
channel_urls=tuple(m.config.channel_urls))
File "/scratch/builds/bob/nightlies/miniconda/lib/python3.7/site-packages/conda_build/environ.py", line 804, in get_install_actions
raise DependencyNeedsBuildingError(exc, subdir=subdir)
conda_build.exceptions.DependencyNeedsBuildingError: Unsatisfiable dependencies for platform linux-64: {"numpy[version='1.11.*|>=1.17.4,<2.0a0']", "libtiff[version='>=4.0.9,<5.0a0|>=4.1.0,<5.0a0']", "numpy[version='1.12.*|1.13.*|>=1.14.5,<2.0a0|>=1.15.4,<2.0a0|>=1.16.6,<2.0a0|>=1.17.4,<2.0a0|>=1.9.3,<2.0a0']", "bob.extension[version='>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']", "certifi[version='>=2016.9.26']", "python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|3.4.*']", "python[version='>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.8,<3.9.0a0']", "numpy-base[version='1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.0|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.1|1.16.2|1.16.2|1.16.2|1.16.2|1.16.3|1.16.3|1.16.3|1.16.3|1.16.4|1.16.4|1.16.4|1.16.4|1.16.5|1.16.5|1.16.5|1.16.5|1.16.6',build='py37h2f8d375_0|py36hde5b4d6_0|py37h2f8d375_1|py36hde5b4d6_1|py37h2f8d375_1|py36h2f8d375_1|py36hde5b4d6_0|py37h2f8d375_0|py37h2f8d375_0|py36hde5b4d6_0|py37h2f8d375_0|py38h2f8d375_0|py38hde5b4d6_0|py36hde5b4d6_0|py37hde5b4d6_0|py36h2f8d375_0|py37hde5b4d6_0|py36h2f8d375_0|py36hde5b4d6_0|py37hde5b4d6_0|py36h2f8d375_0|py37hde5b4d6_0|py36h2f8d375_0|py37h2f8d375_0|py36hde5b4d6_0|py37hde5b4d6_0|py36h2f8d375_0|py37h2f8d375_0|py36hde5b4d6_1|py37hde5b4d6_1|py37hde5b4d6_0|py36hde5b4d6_0|py36h2f8d375_0|py37h2f8d375_0|py37hde5b4d6_1|py36h2f8d375_1|py36h2f8d375_0|py37hde5b4d6_0']", "numpy[version='1.12.*|1.13.*|>=1.14.5,<2.0a0|>=1.15.4,<2.0a0|>=1.16.6,<2.0a0|>=1.9.3,<2.0a0']", "numpy[version='<1.18']", "mkl_random[version='>=1.0.2,<2.0a0']", 'scipy', "numpy[version='>=1.11.3,<2.0a0|>=1.14.6,<2.0a0|>=1.16.6,<2.0a0|>=1.17.4,<2.0a0|>=1.19.2,<2.0a0|>=1.15.1,<2.0a0|>=1.9.3,<2.0a0|>=1.15.4,<2.0a0|>=1.14.5,<2.0a0']", "bob.io.base[version='>=3.0.8,<4.0a0']", "six[version='>=1.15.0,<2.0a0']", "py-boost[version='1.65.1|1.67.0|1.67.0|1.73.0',build='py36hff4598c_3|py36h04863e7_4|py37h04863e7_4|py38h962f231_10|py38h962f231_11|py37h962f231_11|py36h962f231_11|py36h962f231_10|py37h962f231_10']", "python[version='>=3.8,<3.9.0a0|>=3.9,<3.10.0a0']", "bob.extension[version='>=3.1.2,<4.0a0|>=5.0.0,<6.0a0']", 'numpy=1.11', "python[version='>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0']", 'python', "h5py[version='>=2.10.0,<3.0a0|>=2.8.0,<3.0a0']", "bob.extension[version='>2.0.4|>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']", 'six', "hdf5[version='>=1.10.4,<1.10.5.0a0|>=1.10.6,<1.10.7.0a0']", "bob.bio.base[version='>=3.3.0,<4.0a0|>=4.0.0,<5.0a0|>=4.0.1,<5.0a0|>=4.0.2,<5.0a0|>=4.1.0,<5.0a0|>=4.1.1,<5.0a0|>=4.1.2b.0,<5.0a0']", "libtiff[version='>=4.0.10,<5.0a0|>=4.1.0,<5.0a0|>=4.0.9,<5.0a0|>=4.0.8,<5.0a0']", "numpy[version='>=1.14.6,<2.0a0']", "numpy[version='<1.18|>=1.14.6,<2.0a0|>=1.16.6,<2.0a0|>=1.17.4,<2.0a0|>=1.15.4,<2.0a0|>=1.14.5,<2.0a0|>=1.9.3,<2.0a0']", 'ca-certificates', "python[version='>=3.9,<3.10.0a0']", "scikit-learn[version='>=0.22.1,<1.0a0|>=0.23.2,<1.0a0']", "python[version='>=3.5|>=3.6']", 'setuptools', "bob.io.base[version='>=3.0.10b.0,<4.0a0|>=3.0.9,<4.0a0|>=3.0.7,<4.0a0|>=3.0.6,<4.0a0|>=3.0.5,<4.0a0|>=3.0.4,<4.0a0|>=3.0.3,<4.0a0']", "bob.extension[version='>=2.5.0,<3.0a0|>=3.1.0,<4.0a0|>=3.1.1,<4.0a0|>=3.1.2,<4.0a0|>=3.2.0,<4.0a0|>=4.0.0,<5.0a0|>=5.0.0,<6.0a0|>=5.0.1,<6.0a0|>=5.0.2b.0,<6.0a0']", "hdf5[version='>=1.10.1,<1.10.2.0a0|>=1.10.2,<1.10.3.0a0|>=1.10.6,<1.10.7.0a0']", "python[version='>=3.6,<3.7.0a0|>=3.8,<3.9.0a0|>=3.7,<3.8.0a0']", "numpy[version='>=1.11.3,<2.0a0|>=1.15.1,<2.0a0|>=1.9.3,<2.0a0']", '_libgcc_mutex=[build=main]', "numpy-base[version='>=1.0.2,<2.0a0|>=1.0.6,<2.0a0']", "python[version='>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.9,<3.10.0a0|>=3.8,<3.9.0a0']", "numpy[version='>=1.11.3,<2.0a0|>=1.14.6,<2.0a0']", "scipy[version='>=0.19|>=1.5.2,<2.0a0']", "hdf5[version='1.8.17|1.8.17.*|>=1.10.1,<1.10.2.0a0|>=1.10.2,<1.10.3.0a0|>=1.10.6,<1.10.7.0a0']", "certifi[version='>=2016.09|>=2016.9.26']"}
```Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/63Add pre-commit checks to the CI2021-10-01T13:45:46ZAmir MOHAMMADIAdd pre-commit checks to the CISome packages are starting to ship a `.pre-commit-config.yaml` file. It would be a good idea to check for this file and run the hooks automatically in the CI.Some packages are starting to ship a `.pre-commit-config.yaml` file. It would be a good idea to check for this file and run the hooks automatically in the CI.https://gitlab.idiap.ch/bob/bob.devtools/-/issues/62Replace use of gitlab-ci skip with git push option2021-10-06T08:20:35ZSamuel GAISTReplace use of gitlab-ci skip with git push optionWhile on the hunt for GitLab token related information I stumbled across https://gitlab.com/gitlab-org/gitlab-foss/-/merge_requests/15643 which provides a way to avoid "polluting" commit messages with skip-ci tags using `git push -o ci.s...While on the hunt for GitLab token related information I stumbled across https://gitlab.com/gitlab-org/gitlab-foss/-/merge_requests/15643 which provides a way to avoid "polluting" commit messages with skip-ci tags using `git push -o ci.skip` in place.
Might be of interest for the automatic new version update workflow in the BOB/BEAT packages.https://gitlab.idiap.ch/bob/bob.db.base/-/issues/27check_parameters_for_validity does not handle empty lists as advertised2020-11-25T16:17:38ZYannick DAYERcheck_parameters_for_validity does not handle empty lists as advertisedPassing an empty list as parameter should be handled as `None` is: return `default_parameters`.
[bob.db.base.utils l.341](https://gitlab.idiap.ch/bob/bob.db.base/-/blob/2f2b60b6eb08564dcf6abcc6194b1210b15be579/bob/db/base/utils.py#L341)Passing an empty list as parameter should be handled as `None` is: return `default_parameters`.
[bob.db.base.utils l.341](https://gitlab.idiap.ch/bob/bob.db.base/-/blob/2f2b60b6eb08564dcf6abcc6194b1210b15be579/bob/db/base/utils.py#L341)Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/issues/149Follow-up from "Add a method to retrieve all the samples of a dataset"2020-11-26T13:36:47ZAmir MOHAMMADIFollow-up from "Add a method to retrieve all the samples of a dataset"The following discussion from !217 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/217#note_58672): (+2 comments)
> @ydayer what if groups is `["dev"]` or `["...The following discussion from !217 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/217#note_58672): (+2 comments)
> @ydayer what if groups is `["dev"]` or `["train", "dev"]` both options will return the same samples, no?Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/27The `DelayedSampleCall` makes pipelines memory greedy.2020-11-26T18:06:00ZTiago de Freitas PereiraThe `DelayedSampleCall` makes pipelines memory greedy.The way we delay transformer calls (look https://gitlab.idiap.ch/bob/bob.pipelines/-/blob/master/bob/pipelines/wrappers.py#L132) makes our pipeline super memory greedy.
I'm running a simple experiment **LOCALLY**, no dask involved, on `...The way we delay transformer calls (look https://gitlab.idiap.ch/bob/bob.pipelines/-/blob/master/bob/pipelines/wrappers.py#L132) makes our pipeline super memory greedy.
I'm running a simple experiment **LOCALLY**, no dask involved, on `bob.bio.base` wrapping everything with the `CheckpointWrapper`; and my experiment blows 32GB of my RAM + my swap without writing one single file from mine experiment.
Do you have any thoughts on this @amohammadi ?
Do you think is a good call the `DelayedSampleCall`?
Thanks
ping @ydayerBob 9.0.0https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/148Follow-up from "[VanillaBiometrics] Make some dask arguments visible in the C...2020-11-23T14:51:12ZTiago de Freitas PereiraFollow-up from "[VanillaBiometrics] Make some dask arguments visible in the CLI commands"The following discussion from !213 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/213#note_58461):
> @tiago.pereira please put `cls=ResourceOption` in these ...The following discussion from !213 should be addressed:
- [ ] @amohammadi started a [discussion](https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/213#note_58461):
> @tiago.pereira please put `cls=ResourceOption` in these options and `type` should be `click.Int`Bob 9.0.0https://gitlab.idiap.ch/bob/bob.pipelines/-/issues/26DelayedSamples with arbitrary delayed attributes2020-11-23T10:27:22ZAmir MOHAMMADIDelayedSamples with arbitrary delayed attributesI think it is often required that we load some attributes of sample in a lazy manner.
We do this using our DelayedSample class but the problem with that is that it can only delay loading of `data`.
We need a generic implementation that d...I think it is often required that we load some attributes of sample in a lazy manner.
We do this using our DelayedSample class but the problem with that is that it can only delay loading of `data`.
We need a generic implementation that delays the loading of everything like `sample.annotations`.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/25Better handling of file structures with CheckpointWrapper2021-08-13T11:13:09ZTiago de Freitas PereiraBetter handling of file structures with CheckpointWrapperSome databases have file structures very flat (with more than 30k files in a directory).
This is not good for the Idiap file structure and can let our I/O super slow.
We should implement a hash function in `CheckpointWrapper.make_path` ...Some databases have file structures very flat (with more than 30k files in a directory).
This is not good for the Idiap file structure and can let our I/O super slow.
We should implement a hash function in `CheckpointWrapper.make_path` that generates directory names given `sample.key` to limit the number of files in a directory to 1000 files.
ping @lcolbois (this touches experiments with IJB-C)https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/147[VanillaBiometrics] Delayed Samples larger than memory2020-11-23T08:37:44ZTiago de Freitas Pereira[VanillaBiometrics] Delayed Samples larger than memoryI guess @amohammadi is going to like this one.
IJB-C has an immense amount of probe samples (~128k) and summing up the size of all `DelayedSamples`, we have something around ~11GB of metadata. Remember that each probe sample holds the b...I guess @amohammadi is going to like this one.
IJB-C has an immense amount of probe samples (~128k) and summing up the size of all `DelayedSamples`, we have something around ~11GB of metadata. Remember that each probe sample holds the biometric reference keys that we should be comparing at scoring time.
If we run an experiment with IJB-C using our `sge` default setup that starts with one `worker`, (adaptive scale up/down workers due to load) vanilla-biometrics crashes in memory error before start doing work.
Dask can't scale up the number of workers at this stage.
A solution for this is obviously to distribute this data among several workers.
A possible way to approach this would be either, i-) to estimate the size of all DelayedSamples and create a heuristic to set `n` in `dask_client.cluster.scale_up(n)` before running `.compute` or ii-) add an optional argument in the vanilla biometrics CLI command allowing to set the number of workers to start vanilla-biometrics
ping @lcolbois
PS: XArrays, possibly in the futureBob 9.0.0https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/146[API] Database interface - retrieve all samples2020-11-25T10:53:09ZYannick DAYER[API] Database interface - retrieve all samplesThe new Database interface is missing a way of retrieving every samples of a dataset (e.g. for annotations).
A method like `all_samples()` should exist, that returns a list of `bob.pipelines.Sample` from every set (background_model_samp...The new Database interface is missing a way of retrieving every samples of a dataset (e.g. for annotations).
A method like `all_samples()` should exist, that returns a list of `bob.pipelines.Sample` from every set (background_model_samples, probes and references) and every group (dev and eval).Bob 9.0.0Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/24Do not cache data in DelayedSample2020-11-23T10:27:21ZAmir MOHAMMADIDo not cache data in DelayedSampleThis is important as loading DelayedSamples and stacking them in SampleBatch
will lead to the data being kept in the memory twice.
For example, see:
```python
import bob.pipelines as mario
import numpy as np
from functools import partial...This is important as loading DelayedSamples and stacking them in SampleBatch
will lead to the data being kept in the memory twice.
For example, see:
```python
import bob.pipelines as mario
import numpy as np
from functools import partial
a = np.zeros((1000, 1000))
def load(i):
# normally we load an array from disk
return a[i]
samples = [mario.DelayedSample(partial(load, i=i)) for i in range(len(a))]
samples[:2]
# [DelayedSample(load=functools.partial(<function load at 0x7fb1c90250d0>, i=0)),
# DelayedSample(load=functools.partial(<function load at 0x7fb1c90250d0>, i=1))]
a2 = np.array(mario.SampleBatch(samples))
np.shares_memory(a, a2)
# False
```
so you can see that SampleBatch always leads to a copy of data and caching data
in delayed samples always leads to doulbe memory usage.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/23What is the purpose of sge_gpu.py2020-12-03T19:06:47ZAmir MOHAMMADIWhat is the purpose of sge_gpu.pyI thought the whole idea of our pipelines was to use resource tags to properly allocate jobs to the correct worker.
But, now I see that we have 2 config files: `sge_default` and `sge_gpu`, why is that?
Is this because resource tags are ...I thought the whole idea of our pipelines was to use resource tags to properly allocate jobs to the correct worker.
But, now I see that we have 2 config files: `sge_default` and `sge_gpu`, why is that?
Is this because resource tags are not known? I think this issue is also relevant to https://gitlab.idiap.ch/bob/bob.bio.base/-/issues/145Bob 9.0.0https://gitlab.idiap.ch/bob/bob.ip.tensorflow_extractor/-/issues/12Archive this package2021-03-16T17:22:47ZTiago de Freitas PereiraArchive this packageSince all the feature extractors are in `bob.bio.face` and we'll move MTCNN to `bob.ip.facedetect`, we can archive this package.
ping @ydayer @amohammadiSince all the feature extractors are in `bob.bio.face` and we'll move MTCNN to `bob.ip.facedetect`, we can archive this package.
ping @ydayer @amohammadiBob 9.0.0https://gitlab.idiap.ch/bob/bob.ip.facedetect/-/issues/9flandmark tests are failing2020-11-12T08:09:01ZAmir MOHAMMADIflandmark tests are failingJob [#217314](https://gitlab.idiap.ch/bob/bob.ip.facedetect/-/jobs/217314) failed for 2be4298bf22eed2fc3cea6fe44421cf932013861:
```
nosetests --with-coverage -sv bob.ip.flandmark
bob.ip.flandmark.test.test_is_inside ... ok
bob.ip.flandma...Job [#217314](https://gitlab.idiap.ch/bob/bob.ip.facedetect/-/jobs/217314) failed for 2be4298bf22eed2fc3cea6fe44421cf932013861:
```
nosetests --with-coverage -sv bob.ip.flandmark
bob.ip.flandmark.test.test_is_inside ... ok
bob.ip.flandmark.test.test_is_outside ... ok
bob.ip.flandmark.test.test_lena ... ERROR
bob.ip.flandmark.test.test_full_image ... ERROR
bob.ip.flandmark.test.test_multi ... ERROR
======================================================================
ERROR: bob.ip.flandmark.test.test_lena
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/test.py", line 93, in test_lena
img = bob.io.base.load(LENA)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/base/__init__.py", line 143, in load
return File(inputs, 'r').read()
RuntimeError: File - constructor: C++ exception caught: 'file '/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/data/lena.jpg' is not readable'
======================================================================
ERROR: bob.ip.flandmark.test.test_full_image
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/test.py", line 106, in test_full_image
img = bob.io.base.load(LENA)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/base/__init__.py", line 143, in load
return File(inputs, 'r').read()
RuntimeError: File - constructor: C++ exception caught: 'file '/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/data/lena.jpg' is not readable'
======================================================================
ERROR: bob.ip.flandmark.test.test_multi
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/test.py", line 118, in test_multi
img = bob.io.base.load(MULTI)
File "/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/base/__init__.py", line 143, in load
return File(inputs, 'r').read()
RuntimeError: File - constructor: C++ exception caught: 'file '/scratch/builds/bob/bob.ip.facedetect/miniconda/conda-bld/bob.ip.facedetect_1605122616551/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/ip/flandmark/data/multi.jpg' is not readable'
```Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.io.video/-/issues/17Distortions of codecs have increased when updating to ffmpeg 4.22020-11-11T10:37:38ZAmir MOHAMMADIDistortions of codecs have increased when updating to ffmpeg 4.2Job [#216885](https://gitlab.idiap.ch/bob/bob.io.video/-/jobs/216885) failed for 6ba1f0c2c3a2c34ccba26e8855cf2042e7a9cc5b:
```
======================================================================
FAIL: bob.io.video.test_codec.test_nois...Job [#216885](https://gitlab.idiap.ch/bob/bob.io.video/-/jobs/216885) failed for 6ba1f0c2c3a2c34ccba26e8855cf2042e7a9cc5b:
```
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1855 > 0.5 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07322 > 9 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 75.0667 > 55 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1855 > 0.4 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07322 > 9 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 74.8509 > 50 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.5 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 75.3535 > 55 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.4 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 74.7213 > 50 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.4 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 74.7949 > 50 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 19.1838 > 0.5 allowed for format `mp4' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 9.07302 > 9 allowed for format `mp4' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 42, in check_format_codec
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 75.3753 > 55 allowed for format `mp4' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 4.13493 > 2.7 allowed for format `avi' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 4.13493 > 2.5 allowed for format `avi' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.7 allowed for format `mov' and codec `h264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.5 allowed for format `mov' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.5 allowed for format `mp4' and codec `libx264'
======================================================================
FAIL: bob.io.video.test_codec.test_user_video_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/bob.io.video/miniconda/conda-bld/bob.io.video_1605019658032/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/bob/io/video/test_codec.py", line 143, in check_user_video
assert max(dist) <= maxdist, "max(distortion) %g > %g allowed for format `%s' and codec `%s'" % (max(dist), maxdist, format, codec)
AssertionError: max(distortion) 3.98201 > 2.7 allowed for format `mp4' and codec `h264'
```Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/22Provide mechanism for reading database lists from inside a zip file and a mec...2020-12-04T18:26:20ZAmir MOHAMMADIProvide mechanism for reading database lists from inside a zip file and a mechanism to download themThe filelist databases interfaces are excellent but I think we're lacking two features:
* [x] Reading the filelists from inside a zip file (to save space).
* [x] Automatic downloading of these filelists and saving them in e.g. `~/.bob...The filelist databases interfaces are excellent but I think we're lacking two features:
* [x] Reading the filelists from inside a zip file (to save space).
* [x] Automatic downloading of these filelists and saving them in e.g. `~/.bob` for convenience.
I don't think these file lists should be checked into the source code and I think they should be managed
the same way as we handle deep learning models.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADI