Skip to content

FAIL: bob.ip.binseg.test.test_cli.test_discrete_experiment_stare

======================================================================
FAIL: bob.ip.binseg.test.test_cli.test_discrete_experiment_stare
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/scratch/builds/bob/bob.nightlies/miniconda/conda-bld/bob.ip.binseg_1595896558621/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_p/lib/python3.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/scratch/builds/bob/bob.nightlies/miniconda/conda-bld/bob.ip.binseg_1595896558621/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_p/lib/python3.7/site-packages/bob/ip/binseg/test/__init__.py", line 34, in wrapper
    return test(*args, **kwargs)
  File "/scratch/builds/bob/bob.nightlies/miniconda/conda-bld/bob.ip.binseg_1595896558621/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_p/lib/python3.7/site-packages/bob/ip/binseg/test/test_cli.py", line 600, in test_discrete_experiment_stare
    _check_significance(runner)
  File "/scratch/builds/bob/bob.nightlies/miniconda/conda-bld/bob.ip.binseg_1595896558621/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_p/lib/python3.7/site-packages/bob/ip/binseg/test/test_cli.py", line 585, in _check_significance
    f"Count for string '{k}' appeared "
AssertionError: Count for string '^Evaluating patch 'accuracy' on' appeared (0) instead of the expected 2:
Output:
Evaluating sliding window 'accuracy' on 'test' set for 'v1' using windows of size (64, 64) and stride (32, 32)
Evaluating sliding window 'accuracy' on 'test' set for 'v2' using windows of size (64, 64) and stride (32, 32)
Evaluating sliding window 'accuracy' differences on 'test' set on 'v1-v2' using windows of size (64, 64) and stride (32, 32)
Writing analysis figures to significance/analysis.pdf (multipage PDF)...
Writing analysis summary to significance/analysis.txt...
Differences are exactly zero between both sliding window distributions, for **all** samples. Statistical significance tests are not meaningful in this context and will be skipped.  This typically indicates an issue with the setup of prediction folders (duplicated?)
Differences are exactly zero between both sliding window distributions, for **all** samples. Statistical significance tests are not meaningful in this context and will be skipped.  This typically indicates an issue with the setup of prediction folders (duplicated?)

see https://gitlab.idiap.ch/bob/bob.nightlies/-/jobs/204616