beat issueshttps://gitlab.idiap.ch/groups/beat/-/issues2018-12-15T07:15:00Zhttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/54Linux builds are failing with new docker-py 3.6.02018-12-15T07:15:00ZAndré AnjosLinux builds are failing with new docker-py 3.6.0@samuel.gaist: could you have a look at this today?
Job [#153447](https://gitlab.idiap.ch/beat/beat.cmdline/-/jobs/153447) failed for 2580eac2427657fd6b7cf395b03b4a06bdcd3745:
N.B.: there is an issue with the current "Schedules" featur...@samuel.gaist: could you have a look at this today?
Job [#153447](https://gitlab.idiap.ch/beat/beat.cmdline/-/jobs/153447) failed for 2580eac2427657fd6b7cf395b03b4a06bdcd3745:
N.B.: there is an issue with the current "Schedules" feature of gitlab (https://secure.idiap.ch/bugzilla5/show_bug.cgi?id=15791)
TBC: I just re-ran the nightlies manually to see if the builds would get stuck in the same position: https://gitlab.idiap.ch/beat/beat.nightlies/pipelines/25464Samuel GAISTSamuel GAISThttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/34`beat caches view` doesn't work2018-12-12T09:14:17ZJaden DIEFENBAUGH`beat caches view` doesn't workI get the following:
```
path: e4/fb/dc/b2f4751a65179e51b472c4b8c1efbec86441e61194bc02442971ae3405
dataformat: tutorial/linear_machine/1
Traceback (most recent call last):
File "/home/jae/miniconda3/envs/beatedit/bin/beat", line 11, ...I get the following:
```
path: e4/fb/dc/b2f4751a65179e51b472c4b8c1efbec86441e61194bc02442971ae3405
dataformat: tutorial/linear_machine/1
Traceback (most recent call last):
File "/home/jae/miniconda3/envs/beatedit/bin/beat", line 11, in <module>
sys.exit(main())
File "/home/jae/miniconda3/envs/beatedit/lib/python3.6/site-packages/beat/cmdline/scripts/beat.py", line 186, in main
return module.process(args)
File "/home/jae/miniconda3/envs/beatedit/lib/python3.6/site-packages/beat/cmdline/cache.py", line 191, in process
return view(args['config'], args['<path>'], start, end)
File "/home/jae/miniconda3/envs/beatedit/lib/python3.6/site-packages/beat/cmdline/cache.py", line 164, in view
cls=NumpyJSONEncoder).\
File "/home/jae/.local/lib/python3.6/site-packages/simplejson/__init__.py", line 397, in dumps
**kw).encode(obj)
File "/home/jae/.local/lib/python3.6/site-packages/simplejson/encoder.py", line 293, in encode
chunks = list(chunks)
File "/home/jae/.local/lib/python3.6/site-packages/simplejson/encoder.py", line 677, in _iterencode
for chunk in _iterencode_dict(o, _current_indent_level):
File "/home/jae/.local/lib/python3.6/site-packages/simplejson/encoder.py", line 634, in _iterencode_dict
for chunk in chunks:
File "/home/jae/.local/lib/python3.6/site-packages/simplejson/encoder.py", line 697, in _iterencode
o = _default(o)
File "/home/jae/miniconda3/envs/beatedit/lib/python3.6/site-packages/beat/backend/python/utils.py", line 354, in default
return simplejson.JSONEncoder.default(self, obj)
File "/home/jae/.local/lib/python3.6/site-packages/simplejson/encoder.py", line 268, in default
raise TypeError(repr(o) + " is not JSON serializable")
TypeError: <map object at 0x7f1b3d54a4e0> is not JSON serializable
```
This happens with any cache I've tried. Does it work for anyone?Samuel GAISTSamuel GAISThttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/24Store prefix on configuration file2018-12-12T09:14:17ZAndré AnjosStore prefix on configuration fileIt would be nice to be able to store the prefix on the configuration file.It would be nice to be able to store the prefix on the configuration file.André AnjosAndré Anjoshttps://gitlab.idiap.ch/beat/beat.cmdline/-/issues/40`list` commands have a default verbosity level above 12018-12-12T09:14:12ZJaden DIEFENBAUGH`list` commands have a default verbosity level above 1I recently updated `beat.cmdline` for writing the documentation examples and it seems that the verbosity level isn't `0` by default. Running `beat exp list` for the `beat.tutorial.prefix` prefix gives me:
```
Loaded configuration file `/...I recently updated `beat.cmdline` for writing the documentation examples and it seems that the verbosity level isn't `0` by default. Running `beat exp list` for the `beat.tutorial.prefix` prefix gives me:
```
Loaded configuration file `/home/jae/.beatrc'
anjos/tutorial/eigenface/1/atnt-eigenfaces-172
[05/Jul/2018 15:25:21 - beat.cmdline.common] INFO: anjos/tutorial/eigenface/1/atnt-eigenfaces-172
test/tutorial/eigenface/1/atnt
[05/Jul/2018 15:25:21 - beat.cmdline.common] INFO: test/tutorial/eigenface/1/atnt
test/test/iris_advanced/1/iris
[05/Jul/2018 15:25:21 - beat.cmdline.common] INFO: test/test/iris_advanced/1/iris
test/test/iris/1/iris
[05/Jul/2018 15:25:21 - beat.cmdline.common] INFO: test/test/iris/1/iris
test/test/iris/1/error
[05/Jul/2018 15:25:21 - beat.cmdline.common] INFO: test/test/iris/1/error
test/test/iris/1/means
[05/Jul/2018 15:25:21 - beat.cmdline.common] INFO: test/test/iris/1/means
```
This isn't the correct functionality, right?Samuel GAISTSamuel GAISThttps://gitlab.idiap.ch/beat/beat.core/-/issues/52Cannot run on a Mac with Docker installed2018-12-12T08:05:24ZAndré AnjosCannot run on a Mac with Docker installedThe current test suite works well on a Linux box with the docker daemon installed, but equivalent tests cannot be executed on a MacOS system also with a docker daemon installed.
To reproduce this issue, install Docker for Mac (https://d...The current test suite works well on a Linux box with the docker daemon installed, but equivalent tests cannot be executed on a MacOS system also with a docker daemon installed.
To reproduce this issue, install Docker for Mac (https://docs.docker.com/docker-for-mac/install/#download-docker-for-mac) and try to run the docker test units.Samuel GAISTSamuel GAISThttps://gitlab.idiap.ch/beat/beat.editor/-/issues/172CI broken - "npm not found"2018-12-06T10:24:07ZJaden DIEFENBAUGHCI broken - "npm not found"See https://gitlab.idiap.ch/beat/beat.editor/-/jobs/152718, specifically the line:
```
/local/builds/beat/beat.editor/miniconda/conda-bld/beat.editor_1543860509476/work/conda_build.sh: line 5: npm: command not found
```
This is in the ...See https://gitlab.idiap.ch/beat/beat.editor/-/jobs/152718, specifically the line:
```
/local/builds/beat/beat.editor/miniconda/conda-bld/beat.editor_1543860509476/work/conda_build.sh: line 5: npm: command not found
```
This is in the build step, so it doesn't concern the testing docker image.https://gitlab.idiap.ch/beat/beat.cmdline/-/issues/52About Walkthrough section in the documentation.2018-12-06T09:50:13ZZohreh MOSTAANIAbout Walkthrough section in the documentation.I do not understand what is the purpose of the section Walkthrough in the documentation of beat.cmdline. Is it for developing the beat platform locally? Is it only for running the platform locally? Or is it for developing the beat.cmdlin...I do not understand what is the purpose of the section Walkthrough in the documentation of beat.cmdline. Is it for developing the beat platform locally? Is it only for running the platform locally? Or is it for developing the beat.cmdline itself? In the first line of this documentation it is written:
This page gives an overview on setting up an environment to develop BEAT **experiments** locally.https://gitlab.idiap.ch/beat/beat.editor/-/issues/149beateditor is completely down for me2018-12-06T09:49:29ZZohreh MOSTAANIbeateditor is completely down for meHi,
Today when I ran beateditor command to edit some experiment, it did not show me anything on the Firefox. It only shows the page for split second and then it is a blank page. I updated beat.editor with conda in case there were some c...Hi,
Today when I ran beateditor command to edit some experiment, it did not show me anything on the Firefox. It only shows the page for split second and then it is a blank page. I updated beat.editor with conda in case there were some changes but the problem is still there.https://gitlab.idiap.ch/beat/beat.web/-/issues/504strange behaviour regarding an analyzer in beat platform2018-11-30T16:03:45ZZohreh MOSTAANIstrange behaviour regarding an analyzer in beat platformI ran two different experiment on beat platform and both of them used the same database (replay/3) and the same analyser (Kanma/iqm_spoof_eer_analyzer/1). The number of positive and negative scores regardless of what the experiment is sh...I ran two different experiment on beat platform and both of them used the same database (replay/3) and the same analyser (Kanma/iqm_spoof_eer_analyzer/1). The number of positive and negative scores regardless of what the experiment is should be the same, since it only depends on the database. However for one of the experiments these numbers were wrong.
| | exp1(correct) | exp2(wrong) |
| ------------------- |:--------------:| -----------:|
| dev_numNegatives | 300 | 297 |
| dev_numPositives | 60 | 60 |
| test_numNegatives | 400 | 260 |
| test_numPositives | 80 | 80 |
|Scientific Python 2.7| 0.0.4 | 1.0.0 |
Then I ran the experiment with the wrong numbers in my local beat using beat.cmdline and beat.editor ( python 3.6 with the latest version of bob and beat). This time the numbers were correct!
I was wondering if you have any idea what might be the problem and how can I debug it further.https://gitlab.idiap.ch/beat/beat.editor/-/issues/171beat editor does not accept api version 2 as valid2018-11-27T11:19:24ZZohreh MOSTAANIbeat editor does not accept api version 2 as validI am trying to test algorithms written with api version 2 that is introduced in the new platform release. beat editor shows them as invalid all the time. The experiments are running and the algorithms are correct.I am trying to test algorithms written with api version 2 that is introduced in the new platform release. beat editor shows them as invalid all the time. The experiments are running and the algorithms are correct.https://gitlab.idiap.ch/beat/beat.editor/-/issues/148packer_scripts does not exist, while it is mentioned in the documentation of ...2018-11-26T02:45:09ZZohreh MOSTAANIpacker_scripts does not exist, while it is mentioned in the documentation of Method 1 for installationThere is no packer_scripts in `https://gitlab.idiap.ch/beat/beat.tutorial.git`.There is no packer_scripts in `https://gitlab.idiap.ch/beat/beat.tutorial.git`.https://gitlab.idiap.ch/beat/beat.editor/-/issues/126Fix exp editor assigning datasets wrongly when choosing protocol2018-11-20T19:14:16ZJaden DIEFENBAUGHFix exp editor assigning datasets wrongly when choosing protocolWhen creating an iris experiment, training & testing were assigned wrongly (why???)When creating an iris experiment, training & testing were assigned wrongly (why???)Experiment Editor: Fixeshttps://gitlab.idiap.ch/beat/beat.editor/-/issues/169cannot build the virtual image for beat editor.2018-11-20T18:08:52ZZohreh MOSTAANIcannot build the virtual image for beat editor.I cannot make the VM even after using the ``june-allies`` branch.
I installed the packer. The only command I could run is ``packer`` not ``packer-io`` and when I run ``packer build ubuntu-18.04-beat.json`` I get this error:
```
virtualb...I cannot make the VM even after using the ``june-allies`` branch.
I installed the packer. The only command I could run is ``packer`` not ``packer-io`` and when I run ``packer build ubuntu-18.04-beat.json`` I get this error:
```
virtualbox-iso output will be in this color.
==> virtualbox-iso: Downloading or copying Guest additions
virtualbox-iso: Downloading or copying: file:///usr/share/virtualbox/VBoxGuestAdditions.iso
==> virtualbox-iso: Downloading or copying ISO
virtualbox-iso: Downloading or copying: file://./iso/ubuntu-18.04-server-amd64.iso
virtualbox-iso: Error downloading: open /idiap/user/zmostaani/experiments/beat.tutorial/packer_scripts/iso/ubuntu-18.04-server-amd64.iso: no such file or directory
virtualbox-iso: Downloading or copying: http://cdimage.ubuntu.com/ubuntu/releases/bionic/release/ubuntu-18.04-server-amd64.iso
virtualbox-iso: Error downloading: Error making HTTP GET request: 404 Not Found
==> virtualbox-iso: ISO download failed.
Build 'virtualbox-iso' errored: ISO download failed.
```
I followed the steps in the documentation. I am using idiap's workstation which has VirtualBox installed.
It is related to issues #148 and #150.https://gitlab.idiap.ch/beat/docs/-/issues/7Question about documentation.2018-11-09T16:03:22ZZohreh MOSTAANIQuestion about documentation.Could you please tell me which one of these statements are correct. They are both about the same concept in defining arrays in dataformats.
In beat.core/dataformats/arrays: `An array can have as many dimensions as you want.`
In beat.w...Could you please tell me which one of these statements are correct. They are both about the same concept in defining arrays in dataformats.
In beat.core/dataformats/arrays: `An array can have as many dimensions as you want.`
In beat.web/user/dataformat/arrays: `An array can have up to 32 dimensions.`
Thanks.André AnjosAndré Anjoshttps://gitlab.idiap.ch/beat/beat.core/-/issues/17Refer to "ISO/IEC 19795-1:2006 "Biometric performance testing and reporting -...2018-11-03T15:23:12ZLaurent EL SHAFEYRefer to "ISO/IEC 19795-1:2006 "Biometric performance testing and reporting -- Part 1: Principles and framework" in performance evaluationFollowing a remark raised after the RP Conference, it would be nice to implement the biometric metrics according to the ISO standard. In particular, it seems that the ROC displayed during the conference was not respecting the definition ...Following a remark raised after the RP Conference, it would be nice to implement the biometric metrics according to the ISO standard. In particular, it seems that the ROC displayed during the conference was not respecting the definition given in the standard.
One simple option would be to add a reference to the standard in the documentation of the analyzer algorithms.https://gitlab.idiap.ch/beat/beat.core/-/issues/16beat experiment run does not use external environment2018-11-03T15:23:12ZAndré Anjosbeat experiment run does not use external environmentCurrently, the command to run experiments on the user machine does not rely on the same infrastructure used by the platform to run experiments.
It would be good these two things converged at a certain point.Currently, the command to run experiments on the user machine does not rely on the same infrastructure used by the platform to run experiments.
It would be good these two things converged at a certain point.Tutorial for the FG2015 ConferenceAndré AnjosAndré Anjoshttps://gitlab.idiap.ch/beat/beat.core/-/issues/15Pull experiment does not work properly for user 'tutorial'2018-11-03T15:23:12ZLaurent EL SHAFEYPull experiment does not work properly for user 'tutorial'When trying to pull experiments:
```sh
../bin/beat exp pull --user tutorial
```
we end up with:
```text
Pulling the experiment tutorial/eigenface/Test17
The toolchain isn't valid, due to the following errors:
Errors w...When trying to pull experiments:
```sh
../bin/beat exp pull --user tutorial
```
we end up with:
```text
Pulling the experiment tutorial/eigenface/Test17
The toolchain isn't valid, due to the following errors:
Errors with the algorithm 'tutorial/postperf': Failed to find the algorithm file
```Biometrics Center Kickoff Meeting and BEAT ReviewLaurent EL SHAFEYLaurent EL SHAFEYhttps://gitlab.idiap.ch/beat/beat.core/-/issues/14createDataFromJSON() is failing on arrays of arrays structures2018-11-03T15:23:12ZLaurent EL SHAFEYcreateDataFromJSON() is failing on arrays of arrays structuresThe function createDataFromJSON() is failing on arrays of array structures, such as:
```
{
"input_subtract": "beat/array_1d_floats",
"input_divide": "beat/array_1d_floats",
"weights": [
0,
"beat/a...The function createDataFromJSON() is failing on arrays of array structures, such as:
```
{
"input_subtract": "beat/array_1d_floats",
"input_divide": "beat/array_1d_floats",
"weights": [
0,
"beat/array_2d_floats"
],
"biases": [
0,
"beat/array_1d_floats"
]
}
```
This currently generates the error:
*** ValueError: field named value not found.
where 'value' is the key of the 'beat/array_*' dictionary.https://gitlab.idiap.ch/beat/beat.core/-/issues/13Input management2018-11-03T15:23:12ZAndré AnjosInput managementIt would be interesting to revisit input management on algorithms and analysis blocks and try to factor out code that is repeated everywhere into a simpler interface.
This bug shall be used to track advances on this field.It would be interesting to revisit input management on algorithms and analysis blocks and try to factor out code that is repeated everywhere into a simpler interface.
This bug shall be used to track advances on this field.Tutorial for the FG2015 ConferenceAndré AnjosAndré Anjoshttps://gitlab.idiap.ch/beat/beat.core/-/issues/12Object renaming2018-11-03T15:23:12ZAndré AnjosObject renamingIt should be possible to rename:
- [ ] algorithms
- [ ] dataformats
- [ ] toolchains
- [ ] experiments
The platform should handle renaming gracefully.It should be possible to rename:
- [ ] algorithms
- [ ] dataformats
- [ ] toolchains
- [ ] experiments
The platform should handle renaming gracefully.Tutorial for the FG2015 ConferenceAndré AnjosAndré Anjos