diff --git a/doc/baselines.rst b/doc/baselines.rst index e03611d5923e16ad269eb43b4cb58cbd377c0d77..2d9ce83108cfa42e3c360374abf84c0491e31ace 100644 --- a/doc/baselines.rst +++ b/doc/baselines.rst @@ -347,4 +347,54 @@ The ROC curves for the particular experiment can be downloaded from here: ------------ +Frame differences based features (motion analysis) + SVM classifier +======================================================================== + +Detailed description of this PAD pipe-line is given at :ref:`bob.pad.face.resources.face_pad.frame_diff_svm_replayattack`. +Note, that the same PAD pipe-line was used to run experiments on the Replay-Attack database. + +To run this baseline on the `Replay-Mobile`_ database, using the ``grandtest`` protocol, execute the following: + +.. code-block:: sh + + $ ./bin/spoof.py frame-diff-svm \ + --database replay-mobile --protocol grandtest --groups train dev eval \ + --sub-directory <PATH_TO_STORE_THE_RESULTS> + +.. tip:: + + Similarly to the tip above you can run this baseline in parallel. + +To understand the settings of this baseline PAD experiment you can check the +corresponding configuration file: ``bob/pad/face/config/frame_diff_svm.py`` + +To evaluate the results computing EER, HTER and plotting ROC you can use the +following command: + +.. code-block:: sh + + ./bin/evaluate.py \ + --dev-files <PATH_TO_STORE_THE_RESULTS>/grandtest/scores/scores-dev \ + --eval-files <PATH_TO_STORE_THE_RESULTS>/grandtest/scores/scores-eval \ + --legends "10 features for each window in Frame Differences + SVM classifier + Replay-Mobile database" \ + -F 7 \ + --criterion EER \ + --roc <PATH_TO_STORE_THE_RESULTS>/ROC.pdf + +The EER/HTER errors for the `Replay-Mobile`_ database are summarized in the Table below: + ++-------------------+----------+----------+ +| Protocol | EER,\% | HTER,\% | ++===================+==========+==========+ +| ``grandtest`` | 10.801 | 10.414 | ++-------------------+----------+----------+ + +The ROC curves for the particular experiment can be downloaded from here: + +:download:`ROC curve <img/ROC_frame_diff_svm_replay_mobile.pdf>` + +------------ + + .. include:: links.rst + diff --git a/doc/img/ROC_frame_diff_svm_replay_mobile.pdf b/doc/img/ROC_frame_diff_svm_replay_mobile.pdf new file mode 100644 index 0000000000000000000000000000000000000000..fa6048a5a55f3abeb9d6b3fd4d1ab075914b839f Binary files /dev/null and b/doc/img/ROC_frame_diff_svm_replay_mobile.pdf differ