bob issueshttps://gitlab.idiap.ch/groups/bob/-/issues2021-12-13T10:52:37Zhttps://gitlab.idiap.ch/bob/bob.io.audio/-/issues/9package installed with conda is broken2021-12-13T10:52:37ZAmir MOHAMMADIpackage installed with conda is broken```
bob10/lib/python3.8/site-packages/bob/io/audio/__init__.py", line 4, in <module>
from ._library import *
ImportError: libsox.so.3: cannot open shared object file: No such file or directory
```
Also I see that pytest never ran bo...```
bob10/lib/python3.8/site-packages/bob/io/audio/__init__.py", line 4, in <module>
from ._library import *
ImportError: libsox.so.3: cannot open shared object file: No such file or directory
```
Also I see that pytest never ran bob.io.audio tests in https://gitlab.idiap.ch/bob/bob/-/jobs/249166/rawAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.paper.8years/-/issues/2Things to be done in this paper package2022-08-11T12:58:08ZTiago de Freitas PereiraThings to be done in this paper package- [ ] Add some decent documentation on how to bootstrap the experiments and the special plots
- [ ] Make a dashboard on with ALL our baselines in a sphinx format
- [ ] Improve the experiment trigger use use resources instead of looking ...- [ ] Add some decent documentation on how to bootstrap the experiments and the special plots
- [ ] Make a dashboard on with ALL our baselines in a sphinx format
- [ ] Improve the experiment trigger use use resources instead of looking at configuration fileshttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/37dask_jobqueue > 0.7.2 changed the API...2021-11-30T18:25:54ZTiago de Freitas Pereiradask_jobqueue > 0.7.2 changed the API..... and this is breaking `SGEIdiapJob`
`**kwargs` was removed from here
https://github.com/dask/dask-jobqueue/blob/0.7.2/dask_jobqueue/core.py#L132.. and this is breaking `SGEIdiapJob`
`**kwargs` was removed from here
https://github.com/dask/dask-jobqueue/blob/0.7.2/dask_jobqueue/core.py#L132Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/90Stable deployment failed2021-11-03T17:05:04ZAmir MOHAMMADIStable deployment failedJob [#248688](https://gitlab.idiap.ch/bob/bob.ip.base/-/jobs/248688) failed for df03050b446a54b269d95e4f9c306fda35f95375:Job [#248688](https://gitlab.idiap.ch/bob/bob.ip.base/-/jobs/248688) failed for df03050b446a54b269d95e4f9c306fda35f95375:https://gitlab.idiap.ch/bob/bob.io.stream/-/issues/5docs not formatted correctly in bob/docs2021-11-25T10:38:15ZAmir MOHAMMADIdocs not formatted correctly in bob/docsplease see the sidebar in https://www.idiap.ch/software/bob/docs/bob/docs/master/index.html
![image](/uploads/dfb0d6e77b3151f7eae1d79a3cedf25e/image.png)please see the sidebar in https://www.idiap.ch/software/bob/docs/bob/docs/master/index.html
![image](/uploads/dfb0d6e77b3151f7eae1d79a3cedf25e/image.png)Vincent POLLETVincent POLLEThttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/89Deploy job failing -- Job Failed #2482832021-10-29T14:56:59ZAmir MOHAMMADIDeploy job failing -- Job Failed #248283Job [#248283](https://gitlab.idiap.ch/bob/bob.devtools/-/jobs/248283) failed for 5e9108c1d099aa2f78a27fc7ffd1195558f6a93b:
```
bdt ci base-deploy -vv
Warning: entry point could not be loaded. Contact its author for help.
�
Traceback (mos...Job [#248283](https://gitlab.idiap.ch/bob/bob.devtools/-/jobs/248283) failed for 5e9108c1d099aa2f78a27fc7ffd1195558f6a93b:
```
bdt ci base-deploy -vv
Warning: entry point could not be loaded. Contact its author for help.
�
Traceback (most recent call last):
File "/scratch/builds/bob/bob.devtools/miniconda/lib/python3.9/site-packages/click_plugins/core.py", line 37, in decorator
group.add_command(entry_point.load())
File "/scratch/builds/bob/bob.devtools/miniconda/lib/python3.9/site-packages/pkg_resources/__init__.py", line 2449, in load
self.require(*args, **kwargs)
File "/scratch/builds/bob/bob.devtools/miniconda/lib/python3.9/site-packages/pkg_resources/__init__.py", line 2472, in require
items = working_set.resolve(reqs, env, installer, extras=self.extras)
File "/scratch/builds/bob/bob.devtools/miniconda/lib/python3.9/site-packages/pkg_resources/__init__.py", line 777, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (MarkupSafe 2.0.1 (/scratch/builds/bob/bob.devtools/miniconda/lib/python3.9/site-packages), Requirement.parse('MarkupSafe<2.0'), {'sphinx'})
```https://gitlab.idiap.ch/bob/bob.devtools/-/issues/87run_cmdline is not verbose enough2021-10-29T15:23:52ZSamuel GAISTrun_cmdline is not verbose enoughThe `run_cmdline` is not verbose enough.
On failure it currently just prints that the command failed with the error number.
That's not enough information because there might be lots of reasons for failure that are not conveyed by the n...The `run_cmdline` is not verbose enough.
On failure it currently just prints that the command failed with the error number.
That's not enough information because there might be lots of reasons for failure that are not conveyed by the number itself.
It should at least dump stderr to see what the command screamed about.
As example use case, the current beat/beat.nightlies> pipelines all fail on Linux since the introduction of !259.
I suspect that's because of the `docker-build` tag that makes it use a shell gitlab-runner rather than the Docker executor and since the shell executor is run on a Debian machine, there's no reason for yum to be present.André AnjosAndré Anjoshttps://gitlab.idiap.ch/bob/bob.pad.face/-/issues/42Job Failed #2477962022-02-22T17:55:06ZAmir MOHAMMADIJob Failed #247796Job [#247796](https://gitlab.idiap.ch/bob/nightlies/-/jobs/247796) failed for 36b8adb9f36c2610132f0f90600063379d15a620:
```
Warning, treated as error:
/scratch/builds/bob/nightlies/miniconda/conda-bld/bob.pad.face_1634852412497/_test_env...Job [#247796](https://gitlab.idiap.ch/bob/nightlies/-/jobs/247796) failed for 36b8adb9f36c2610132f0f90600063379d15a620:
```
Warning, treated as error:
/scratch/builds/bob/nightlies/miniconda/conda-bld/bob.pad.face_1634852412497/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/python3.8/site-packages/bob/pad/face/config/replay_mobile.py:docstring of bob.pad.face.config.replay_mobile:13:circular inclusion in "include" directive: ../../../../src/bob/bob.pad.face/doc/links.rst < ../../../../src/bob/bob.pad.face/doc/links.rst < ../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/python3.8/site-packages/bob/pad/face/config/replay_attack.py:docstring of bob.pad.face.config.replay_attack
```Conda-forge migrationhttps://gitlab.idiap.ch/bob/bob.bio.face/-/issues/65Citation [WLW04] is not referenced.2021-10-29T19:43:58ZAmir MOHAMMADICitation [WLW04] is not referenced.```
Warning, treated as error:
/scratch/builds/bob/nightlies/src/bob/bob.bio.face/doc/references.rst:15:Citation [WLW04] is not referenced.
```
from https://gitlab.idiap.ch/bob/nightlies/-/jobs/247694```
Warning, treated as error:
/scratch/builds/bob/nightlies/src/bob/bob.bio.face/doc/references.rst:15:Citation [WLW04] is not referenced.
```
from https://gitlab.idiap.ch/bob/nightlies/-/jobs/247694Conda-forge migrationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/86Developing without buildout2022-03-04T16:07:21ZAmir MOHAMMADIDeveloping without buildoutHere are some ideas/tips of developing without buildout:
* [ ] `pip install --no-build-isolation` makes pip installations of our Bob packages inside a conda environment cleaner, and is probably required if we have a C++ package.
* [ ] ...Here are some ideas/tips of developing without buildout:
* [ ] `pip install --no-build-isolation` makes pip installations of our Bob packages inside a conda environment cleaner, and is probably required if we have a C++ package.
* [ ] `pip install --no-dependencies` is also an option that we want to use when installing a Bob package inside a conda environment because dependencies are supposed to come from conda.
pip supports a config file per environment (in the root folder of the conda environment, see its location with `pip config debug`), I wonder if we should add:
```ini
[global]
verbose = 1
[install]
no-build-isolation = false # false means: pip install --no-build-isolation
no-dependencies = true # true means: pip install --no-dependencies
```
when creating an env with `bdt create`. However, this would affect all pip installations which is not what we want ...Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.pipelines/-/issues/36Job Failed #2473682021-10-18T15:42:20ZAmir MOHAMMADIJob Failed #247368Job [#247368](https://gitlab.idiap.ch/bob/bob.pipelines/-/jobs/247368) failed for 3dab034b96d96a9f95435639b9c892171fb50ac4:
```
+ sphinx-build -aEW /scratch/builds/bob/bob.pipelines/conda/../doc /scratch/builds/bob/bob.pipelines/conda/....Job [#247368](https://gitlab.idiap.ch/bob/bob.pipelines/-/jobs/247368) failed for 3dab034b96d96a9f95435639b9c892171fb50ac4:
```
+ sphinx-build -aEW /scratch/builds/bob/bob.pipelines/conda/../doc /scratch/builds/bob/bob.pipelines/conda/../sphinx
Running Sphinx v4.2.0
Adding intersphinx source for `python': https://docs.python.org/3.8/
Adding intersphinx source for `numpy': https://numpy.org/doc/1.21/
Adding intersphinx source for `setuptools': https://setuptools.readthedocs.io/en/latest/
Adding intersphinx source for `scikit-learn': https://scikit-learn.org/stable/
Adding intersphinx source for `dask': https://docs.dask.org/en/latest/
Adding intersphinx source for `dask-jobqueue': https://jobqueue.dask.org/en/latest/
Adding intersphinx source for `distributed': https://distributed.dask.org/en/latest/
Adding intersphinx source for `xarray': https://xarray.pydata.org/en/stable/
Found documentation for bob.extension on http://www.idiap.ch/software/bob/docs/bob/bob.extension/master/; adding intersphinx source
Found documentation for bob.io.base on http://www.idiap.ch/software/bob/docs/bob/bob.io.base/master/; adding intersphinx source
Found documentation for bob.db.base on http://www.idiap.ch/software/bob/docs/bob/bob.db.base/master/; adding intersphinx source
[autosummary] generating autosummary for: checkpoint.rst, dask.rst, index.rst, py_api.rst, sample.rst, xarray.rst
loading intersphinx inventory from https://docs.python.org/3.8/objects.inv...
loading intersphinx inventory from https://numpy.org/doc/1.21/objects.inv...
loading intersphinx inventory from https://setuptools.readthedocs.io/en/latest/objects.inv...
loading intersphinx inventory from https://scikit-learn.org/stable/objects.inv...
loading intersphinx inventory from https://docs.dask.org/en/latest/objects.inv...
loading intersphinx inventory from https://jobqueue.dask.org/en/latest/objects.inv...
loading intersphinx inventory from https://distributed.dask.org/en/latest/objects.inv...
loading intersphinx inventory from https://xarray.pydata.org/en/stable/objects.inv...
loading intersphinx inventory from http://www.idiap.ch/software/bob/docs/bob/bob.extension/master/objects.inv...
loading intersphinx inventory from http://www.idiap.ch/software/bob/docs/bob/bob.io.base/master/objects.inv...
loading intersphinx inventory from http://www.idiap.ch/software/bob/docs/bob/bob.db.base/master/objects.inv...
intersphinx inventory has moved: https://setuptools.readthedocs.io/en/latest/objects.inv -> https://setuptools.pypa.io/en/latest/objects.inv
building [mo]: all of 0 po files
building [html]: all source files
updating environment: [new config] 6 added, 0 changed, 0 removed
reading sources... [ 16%] checkpoint
reading sources... [ 33%] dask
reading sources... [ 50%] index
reading sources... [ 66%] py_api
reading sources... [ 83%] sample
reading sources... [100%] xarray
looking for now-outdated files... none found
pickling environment... done
checking consistency... done
preparing documents... done
writing output... [ 16%] checkpoint
writing output... [ 33%] dask
writing output... [ 50%] index
writing output... [ 66%] py_api
writing output... [ 83%] sample
writing output... [100%] xarray
Warning, treated as error:
/scratch/builds/bob/bob.pipelines/doc/dask.rst:101:unknown document: dask:setup/adaptive
```Conda-forge migrationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.video/-/issues/21ERROR: bob.bio.video.test.test_databases.test_new_youtube2021-10-29T15:34:57ZAmir MOHAMMADIERROR: bob.bio.video.test.test_databases.test_new_youtubeSee: https://gitlab.idiap.ch/bob/nightlies/-/jobs/247320
```
======================================================================
ERROR: bob.bio.video.test.test_databases.test_new_youtube
-----------------------------------------------...See: https://gitlab.idiap.ch/bob/nightlies/-/jobs/247320
```
======================================================================
ERROR: bob.bio.video.test.test_databases.test_new_youtube
----------------------------------------------------------------------
Traceback (most recent call last):
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/site-packages/bob/bio/video/test/test_databases.py", line 14, in test_new_youtube
references = database.references()
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/site-packages/bob/bio/video/database/youtube.py", line 269, in references
sampleset = self._make_sample_set(reference_id, suject_id, sample_path)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/site-packages/bob/bio/video/database/youtube.py", line 185, in _make_sample_set
path = os.path.join(self.original_directory, sample_path)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/posixpath.py", line 76, in join
a = os.fspath(a)
TypeError: expected str, bytes or os.PathLike object, not NoneType
-------------------- >> begin captured logging << --------------------
bob.bio.video.database.youtube: WARNING: Invalid or non existant `original_directory`: f{original_directory}.Please, do `bob config set bob.bio.face.lfw.directory PATH` to set the LFW data directory.
bob.extension.download: INFO: Downloading ./bob_data/datasets/youtube_protocols/youtube_protocols-6962cd2e.tar.gz
bob.extension.download: WARNING: Could not download from the https://www.idiap.ch/software/bob/databases/latest/youtube_protocols-6962cd2e.tar.gz url
Traceback (most recent call last):
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 1354, in do_open
h.request(req.get_method(), req.selector, req.data, headers,
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/http/client.py", line 1256, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/http/client.py", line 1302, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/http/client.py", line 1251, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/http/client.py", line 1011, in _send_output
self.send(msg)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/http/client.py", line 951, in send
self.connect()
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/http/client.py", line 1425, in connect
self.sock = self._context.wrap_socket(self.sock,
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/ssl.py", line 500, in wrap_socket
return self.sslsocket_class._create(
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/ssl.py", line 1040, in _create
self.do_handshake()
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/ssl.py", line 1309, in do_handshake
self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'www.idiap.ch'. (_ssl.c:1131)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/site-packages/bob/extension/download.py", line 116, in download_file_from_possible_urls
download_file(url, out_file)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/site-packages/bob/extension/download.py", line 93, in download_file
with urlopen(url) as response:
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 525, in open
response = self._open(req, data)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 542, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 1397, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "/Users/gitlab/builds/f6f95b82/0/bob/nightlies/miniconda/conda-bld/bob.bio.video_1634557881182/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold/lib/python3.8/urllib/request.py", line 1357, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'www.idiap.ch'. (_ssl.c:1131)>
bob.extension.download: INFO: Untar/gzip in ./bob_data/datasets/youtube_protocols/youtube_protocols-6962cd2e.tar.gz
```Conda-forge migrationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/85pytorch=1.8.0 crashes python on Linux CI with "libgcc_s.so.1 must be installe...2022-03-03T17:37:00ZAndré Anjospytorch=1.8.0 crashes python on Linux CI with "libgcc_s.so.1 must be installed for pthread_cancel to work"An effect of this can be seen at: https://gitlab.idiap.ch/bob/bob.ip.binseg/-/jobs/247142/raw, where the job literally crashes during a simple 'sphinx-build'.
This is not reproducible on my own Idiap VM, but I managed to reproduce it co...An effect of this can be seen at: https://gitlab.idiap.ch/bob/bob.ip.binseg/-/jobs/247142/raw, where the job literally crashes during a simple 'sphinx-build'.
This is not reproducible on my own Idiap VM, but I managed to reproduce it consistently on the Docker image we use for the CI builds. I tested the same setup with pytorch=1.9.1 and, with that version, the crashes are gone.
I'm thus requesting we consider the (urgent) upgrade of pytorch to version 1.9.1. Without this, I'm afraid we won't be able to fix bob.ip.binseg builds on Linux.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.face/-/issues/64Tests are failing after bob.ip.base modifications2021-10-29T19:43:58ZAmir MOHAMMADITests are failing after bob.ip.base modificationshttps://gitlab.idiap.ch/bob/bob.bio.face/-/jobs/247103
```
=================================== FAILURES ===================================
___________________________________ test_SQI ___________________________________
def test_SQ...https://gitlab.idiap.ch/bob/bob.bio.face/-/jobs/247103
```
=================================== FAILURES ===================================
___________________________________ test_SQI ___________________________________
def test_SQI():
face_cropper = bob.bio.face.preprocessor.FaceCrop(
cropped_image_size=(CROPPED_IMAGE_HEIGHT, CROPPED_IMAGE_WIDTH),
cropped_positions={'leye': LEFT_EYE_POS, 'reye': RIGHT_EYE_POS}
)
> preprocessor = bob.bio.face.preprocessor.SelfQuotientImage(
face_cropper = face_cropper
)
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python3.8/site-packages/bob/bio/face/test/test_picklability.py:100:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python3.8/site-packages/bob/bio/face/preprocessor/SelfQuotientImage.py:62: in __init__
self._init_non_pickables()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = SelfQuotientImage(face_cropper=FaceCrop(cropped_image_size=(80, 64),
cropped_positions={'leye': (16, 48),
'reye': (16, 15)}))
def _init_non_pickables(self):
> self.self_quotient = bob.ip.base.SelfQuotientImage(
size_min=self.size, sigma=self.sigma
)
E AttributeError: module 'bob.ip.base' has no attribute 'SelfQuotientImage'
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python3.8/site-packages/bob/bio/face/preprocessor/SelfQuotientImage.py:65: AttributeError
___________________________________ test_sqi ___________________________________
def test_sqi():
# read input
image, annotation = _image(), _annotation()
face_cropper = bob.bio.face.preprocessor.FaceCrop(
cropped_image_size=(CROPPED_IMAGE_HEIGHT, CROPPED_IMAGE_WIDTH),
cropped_positions={'leye': LEFT_EYE_POS, 'reye': RIGHT_EYE_POS}
)
> preprocessor = bob.bio.face.preprocessor.SelfQuotientImage(
face_cropper = face_cropper
)
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python3.8/site-packages/bob/bio/face/test/test_preprocessors.py:310:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python3.8/site-packages/bob/bio/face/preprocessor/SelfQuotientImage.py:62: in __init__
self._init_non_pickables()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = SelfQuotientImage(face_cropper=FaceCrop(cropped_image_size=(80, 64),
cropped_positions={'leye': (16, 48),
'reye': (16, 15)}))
def _init_non_pickables(self):
> self.self_quotient = bob.ip.base.SelfQuotientImage(
size_min=self.size, sigma=self.sigma
)
E AttributeError: module 'bob.ip.base' has no attribute 'SelfQuotientImage'
../_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/python3.8/site-packages/bob/bio/face/preprocessor/SelfQuotientImage.py:65: AttributeError
```Conda-forge migrationTiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.io.video/-/issues/18AssertionError: distortion(frame[29]) 85.0335 > 80 allowed for format `avi' a...2021-10-29T15:34:56ZAmir MOHAMMADIAssertionError: distortion(frame[29]) 85.0335 > 80 allowed for format `avi' and codec `libx264'```
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/nightlies/miniconda/conda-bld/bob....```
FAIL: bob.io.video.test_codec.test_noise_format_mp4_codec_mpeg4
----------------------------------------------------------------------
Traceback (most recent call last):
File "/scratch/builds/bob/nightlies/miniconda/conda-bld/bob.io.video_1634154089695/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/python3.8/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/scratch/builds/bob/nightlies/miniconda/conda-bld/bob.io.video_1634154089695/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/python3.8/site-packages/bob/io/video/test_codec.py", line 47, in check_format_codec
assert rdist <= maxdist, "distortion(frame[%d]) %g > %g allowed for format `%s' and codec `%s'" % (k, rdist, maxdist, format, codec)
AssertionError: distortion(frame[29]) 85.0335 > 80 allowed for format `avi' and codec `libx264'
```
see https://gitlab.idiap.ch/bob/nightlies/-/jobs/246975Conda-forge migrationAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/84Python-only CI pipeline is required2021-10-29T15:34:56ZAmir MOHAMMADIPython-only CI pipeline is requiredSome packages like bob/bob.buildout> don't need conda and it's easier to maintain using pip only.
Looking at https://github.com/pypa/ would help.
related: https://gitlab.idiap.ch/bob/bob.buildout/-/issues/28Some packages like bob/bob.buildout> don't need conda and it's easier to maintain using pip only.
Looking at https://github.com/pypa/ would help.
related: https://gitlab.idiap.ch/bob/bob.buildout/-/issues/28Conda-forge migrationAndré AnjosAndré Anjoshttps://gitlab.idiap.ch/bob/bob.extension/-/issues/81bob.extension 6.1.0 pip package is broken2022-03-01T12:48:18ZAmir MOHAMMADIbob.extension 6.1.0 pip package is brokenAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/83[suggestion] Change CI template include style2022-11-17T17:35:27ZSamuel GAIST[suggestion] Change CI template include styleCurrently the `.gitlab-ci.yml` template for all bob packages contains either one or two lines like the following:
```
include: 'https://gitlab.idiap.ch/bob/bob.devtools/raw/master/bob/devtools/data/gitlab-ci/single-package.yaml'
```
Th...Currently the `.gitlab-ci.yml` template for all bob packages contains either one or two lines like the following:
```
include: 'https://gitlab.idiap.ch/bob/bob.devtools/raw/master/bob/devtools/data/gitlab-ci/single-package.yaml'
```
This has several drawbacks:
1) The server address is hardcoded
2) If there are incompatible changes to be done, there's no really easy way to test them without breaking a lot of packages
3) If one needs to keep using an old version of that file to be able to continue building it's not really clear how to proceed
For these reasons, I suggest to change the template as well as the bob packages `.gitlab-ci.yml` to the following.
```
include:
- project: 'bob/bob.devtools'
ref: master
file: '/bob/devtools/data/gitlab-ci/single-package.yaml'
```
This removes the server address so if there's a need to move stuff around, then there will be way less problems.
It also allows to retrieve the file from different branches if required in an easy fashion. For example if there's a massive change to the infrastructure, it allows to do that without breaking everything that is currently working.
The ref value can also be `$CI_DEFAULT_BRANCH` provided that the projects follow the same naming convention. It will thus allow to properly move from using master to main as default branch name.André AnjosAndré Anjoshttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/82The Docker image used for Linux builds breaks beat/beat.editor> build2021-10-29T15:34:56ZSamuel GAISTThe Docker image used for Linux builds breaks beat/beat.editor> buildThe bob scripts used to use the `docker.idiap.ch/bob/docker-images/c3i-linux-64` Docker image. This image provided the required OpenGL related packages needed by beat/beat.editor>.
This is not the case anymore with the latest changes th...The bob scripts used to use the `docker.idiap.ch/bob/docker-images/c3i-linux-64` Docker image. This image provided the required OpenGL related packages needed by beat/beat.editor>.
This is not the case anymore with the latest changes that happened with the change to `quay.io/condaforge/linux-anvil-cos7-x86_64`.
See for example: https://gitlab.idiap.ch/beat/beat.editor/-/jobs/246701Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.devtools/-/issues/81pytorch=1.8.0 and torchvision=0.10.1 cannot be installed under a Linux build ...2021-10-06T13:07:29ZAndré Anjospytorch=1.8.0 and torchvision=0.10.1 cannot be installed under a Linux build on the CIFor some reason, the versions of pytorch and torchvision current in `conda_build_config.yaml` cannot be installed alongside the remainder of the packages, at least for bob.ip.binseg:
- https://gitlab.idiap.ch/bob/bob.ip.binseg/-/jobs/24...For some reason, the versions of pytorch and torchvision current in `conda_build_config.yaml` cannot be installed alongside the remainder of the packages, at least for bob.ip.binseg:
- https://gitlab.idiap.ch/bob/bob.ip.binseg/-/jobs/246120
It states:
```
The reported errors are:
Encountered problems while solving:
- nothing provides __glibc >=2.17,<3.0.a0 needed by torchvision-0.10.1-py36cuda102hd220d44_0_cuda
- nothing provides __glibc >=2.17,<3.0.a0 needed by pytorch-1.8.0-cpu_py36h2d15a6b_1
```
Which is weird, because it is a python=3.8 build!André AnjosAndré Anjos