IJB-C protocols outdated and incomplete
When downloading the original data from IJB, the structure of the protocol files have changed. When I run an ls -R IJB-C/protocols/ in the main directory of the downloaded and extracted IJB folder, I obtain:
IJB-C/protocols/:
archive ijbc_metadata_with_age.csv readme.txt test1 test10 test11 test2 test4 test6 test7 test9
IJB-C/protocols/archive:
clustering ijbc_11_covariate_probe_reference.csv ijbc_1N_gallery_G1.csv ijbc_1N_probe_mixed.csv ijbc_face_detection_ground_truth.csv ijbc_wild_test10.csv ijbc_wild_test9.csv
ijbc_11_covariate_matches.csv ijbc_11_G1_G2_matches.csv ijbc_1N_gallery_G2.csv ijbc_face_detection.csv ijbc_metadata.csv ijbc_wild_test11.csv
IJB-C/protocols/archive/clustering:
ijbc_clustering_1021_hint_10000.csv ijbc_clustering_1839_hint_10000.csv ijbc_clustering_32_hint_100.csv ijbc_clustering_3531_hint_10000.csv ijbc_clustering_ground_truth.csv
IJB-C/protocols/test1:
enroll_templates.csv match.csv README.txt verif_templates.csv
IJB-C/protocols/test10:
gallery_G1.csv gallery_G2.csv probes.csv README.txt
IJB-C/protocols/test11:
gallery_G1.csv gallery_G2.csv probes.csv README.txt
IJB-C/protocols/test2:
enroll_templates.csv match.csv README.txt verif_templates.csv
IJB-C/protocols/test4:
gallery_G1.csv gallery_G2.csv probes.csv README.txt
IJB-C/protocols/test6:
face_detection.csv face_detection_ground_truth.csv README.txt
IJB-C/protocols/test7:
clustering_1021_hint_10000.csv clustering_1839_hint_10000.csv clustering_32_hint_100.csv clustering_3531_hint_10000.csv clustering_ground_truth.csv README.txt
IJB-C/protocols/test9:
gallery_G1.csv gallery_G2.csv probes.csv README.txt The currently implemented protocol files are located in IJB-C/protocols/archive. The new files have a much easier structure.
Currently, only the 1:1 protocol is implemented, which would correspond to the IJB-C/protocols/test1 folder. However, the database also provides many more protocols, for example, open-set identification protocols defined in IJB-C/protocols/test4. An implementation of these protocols would be great, and should be straightforward with the new protocol files.