Migrating the database interfaces to the new new CSV format

A new interface is being implemented in !300 (merged), and I am trying to migrate all dbs to that. This is a meta issue to track the migration.

  • Convert all csv based ones to the new format
  • Convert all custom interfaces to the new format
  • Rewrite bob.bio.face.database file for database that were using custom interface
  • Test and verify the new interfaces!
  • Upload csv files according to https://gitlab.idiap.ch/bob/private/-/wikis/How-to-upload-resources
    • follow the data/bob/bob.bio.modality/bio-modality-database_name.tar.gz
    • Use this format in the code:
from bob.extension.download import get_file

name = "bio-modality-database_name-586b7e81.tar.gz"
dataset_protocols_path = get_file(
    name,
    # don't use https here, use http so the link works in the CI as well.
    [f"https://www.idiap.ch/software/bob/data/bob/bob.bio.modality/{name}",
     f"http://www.idiap.ch/software/bob/data/bob/bob.bio.modality/{name}"],
    cache_subdir="protocols",
    file_hash="586b7e81",
)
# remove .urls method.

Separate problems

  • asvspoof2017-spoof the interface does not load
  • utfvp has some columns without header in its CSV files!
  • caspeal has some columns without header in its CSV files!
  • gbu, rfw, lfw, ijbc, youtube interfaces are custom
  • bob.bio.spear licit and spoof protocols need to change to new format like replaymobile
Edited by Laurent COLBOIS