Frame-level scoring is the default for (some) baselines?
Recently I noticed that the SVM PAD algorithm dumps scores as a frame-level basis and it is used by default in some baselines (e.g. qm-svm
). However the evaluation using this frame-level analysis is much worse compared to video-level scoring. For example, I saw the EER decrease from 28% to 15% when switching to video-level scoring. Shouldn't we change the defaults in our baselines?