strange behaviour regarding an analyzer in beat platform
I ran two different experiment on beat platform and both of them used the same database (replay/3) and the same analyser (Kanma/iqm_spoof_eer_analyzer/1). The number of positive and negative scores regardless of what the experiment is should be the same, since it only depends on the database. However for one of the experiments these numbers were wrong.
exp1(correct) | exp2(wrong) | |
---|---|---|
dev_numNegatives | 300 | 297 |
dev_numPositives | 60 | 60 |
test_numNegatives | 400 | 260 |
test_numPositives | 80 | 80 |
Scientific Python 2.7 | 0.0.4 | 1.0.0 |
Then I ran the experiment with the wrong numbers in my local beat using beat.cmdline and beat.editor ( python 3.6 with the latest version of bob and beat). This time the numbers were correct!
I was wondering if you have any idea what might be the problem and how can I debug it further.