Skip to content

Define the 4 or 5 column score format as the standard format for bob.measure and document it.

Related to bob.measure#25 (closed) and bob.measure#37 (closed), I think it might be a good idea to define the 4 or 5 column score format as the standard format for bob.measure and document it as opposed to moving it to bob.bio.base. This would allow us to have generic evaluation scripts implemented in bob.measure for any machine learning experiment. The score format could be as simple as:

claimed_id real_id test_label score
claimed_id model_label real_id test_label score
  • If claimed_id and real_id columns are equal, then it's a positive score. Otherwise, it's a negative score.
  • The text in columns should not contain spaces!
  • No need to explain what claimed_id, real_id, and model_label are! We can just mention they are related to biometrics.
  • As long as anyone comes up with the scores format above (preferably 4 column format), they can use the scripts in bob.measure.