Create a test to prevent some errors for scoring tools

Created by: siebenkopf

The current test, which does not seem to have covered the referenced issue, is here: https://github.com/bioidiap/bob.bio.base/blob/master/bob/bio/base/test/test_scripts.py#L105 There, the tool requires projection and, hence, https://github.com/bioidiap/bob.bio.base/blob/master/bob/bio/base/tools/scoring.py#L163 never reached the second case.

Providing another test case that actually runs an extractor and an algorithm that do not require training should be straightforward. Just replace the command line with something like

...
'--extractor', 'linearize',
'--algorithm', 'distance-euclidean'
...

Of course, the expected result files need to be adapted.

Unfortunately I have a paper deadline on Monday, so I cannot work on that right now.

Reassigned to @amohammadi

Started branch 10-create-a-test-to-prevent-some-errors-for-scoring-tools

The error I got before was this:

bob.bio.base@2016-03-09 14:36:22,159 -- ERROR: During the execution, an exception was raised: The given directory type 'features' is not supported.
Traceback (most recent call last):
  File "/home/miniconda2/envs/bob.example.facevoice/bin/verify.py", line 6, in <module>
    sys.exit(bob.bio.base.script.verify.main())
  File "/home/miniconda2/envs/bob.example.facevoice/lib/python2.7/site-packages/bob.bio.base-2.0.5-py2.7.egg/bob/bio/base/script/verify.py", line 435, in main
    verify(args, command_line_parameters)
  File "/home/miniconda2/envs/bob.example.facevoice/lib/python2.7/site-packages/bob.bio.base-2.0.5-py2.7.egg/bob/bio/base/script/verify.py", line 382, in verify
    if not execute(args):
  File "/home/miniconda2/envs/bob.example.facevoice/lib/python2.7/site-packages/bob.bio.base-2.0.5-py2.7.egg/bob/bio/base/script/verify.py", line 338, in execute
    write_compressed = args.write_compressed_score_files)
  File "/home/miniconda2/envs/bob.example.facevoice/lib/python2.7/site-packages/bob.bio.base-2.0.5-py2.7.egg/bob/bio/base/tools/scoring.py", line 273, in compute_scores
    _scores_c(algorithm, t_model_ids, group, force)
  File "/home/miniconda2/envs/bob.example.facevoice/lib/python2.7/site-packages/bob.bio.base-2.0.5-py2.7.egg/bob/bio/base/tools/scoring.py", line 163, in _scores_c
    probe_files = fs.get_paths(probe_objects, 'projected' if algorithm.performs_projection else 'features')
  File "/home/miniconda2/envs/bob.example.facevoice/lib/python2.7/site-packages/bob.bio.base-2.0.5-py2.7.egg/bob/bio/base/tools/FileSelector.py", line 103, in get_paths
    raise ValueError("The given directory type '%s' is not supported." % directory_type)
ValueError: The given directory type 'features' is not supported.

My invoke command was this:

'bob.example.facevoice/bin/verify.py' -vv --grid 'grid' --preprocessor 'inorm-lbp-cro p' --extractor 'grid-graph' --algorithm 'gabor-jet' -d 'mobio-male' --zt-norm --groups 'eval' --sub-directory 'baselines/gabor-graph' --sub-task 'compute-scores' --group 'eval' --score-type 'C'

mentioned in merge request !32 (merged)

Status changed to closed by merge request !32 (merged)

Status changed to closed by commit 347bf423

Create a test to prevent some errors for scoring tools

Designs

Child items ...

Activity