Once the scores are obtained, error rates can be computed using the following command (you must have installed Bob v5.0 or higher)::
Also, it is possible to reproduce the experiments presented in the paper using the following bash scripts that run for all
$ bob pad metrics -e scores_path/scores-dev scores_path/scores-eval
The histograms and DET curves can also be plotted, for details run ``$ bob pad --help``.
If you want to avoid training all PAD systems and computing scores, we are providing the score files obtained for all the PAD systems presented in the paper.
You can download all the scores as follows::
$ #You should be inside the package directory bob.paper.interspeech_2016
$ wget http://www.idiap.ch/resource/biometric/data/interspeech_2016.tar.gz #Download the scores
$ tar -xzvf interspeech_2016.tar.gz
With downloaded scores, you need to compute error rates and DET curves, you need to run the following script::
It is possible to reproduce the experiments presented in the paper using the following bash scripts that run for all
PAD systems used in the paper (note that these scripts assume SGE grid to be available and will take a few days on 50
parallel machines)::
...
...
@@ -83,14 +107,13 @@ parallel machines)::
$ ./project_on_gmms.sh asvspoof 20 # evaluate for ASVspoof database
Generate results from pre-computed scores
-----------------------------------------
Generate paper's results from pre-computed scores
-------------------------------------------------
If you want to avoid training all PAD systems and computing scores, we are providing the score files obtained for all the PAD systems presented in the paper. Hence, the error rates can be computed, as per Tables 1, 2, and 3 of the paper, and additional DET curves can be plotted by simply performing the following::
If you want to avoid training all PAD systems and computing scores, we are providing the score files obtained for all the PAD systems presented in the paper.
The error rates can be computed, as per Tables 1, 2, and 3 of the paper, and additional DET curves can be plotted by simply performing the following::
$ #You should be inside the package directory bob.paper.interspeech_2016
$ wget http://www.idiap.ch/resource/biometric/data/interspeech_2016.tar.gz #Download the scores
$ tar -xzvf interspeech_2016.tar.gz
$ ./evaluate_scores.sh # compute error rates and plot the DET curves for each PAD system
The script will create folders for each different PAD system (it contains computed error rates and DET curves)