Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • bob.bio.face bob.bio.face
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 23
    • Issues 23
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 5
    • Merge requests 5
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • bobbob
  • bob.bio.facebob.bio.face
  • Issues
  • #61
Closed
Open
Issue created Aug 11, 2021 by Manuel Günther@mguentherMaintainer

IJB-C protocols outdated and incomplete

When downloading the original data from IJB, the structure of the protocol files have changed. When I run an ls -R IJB-C/protocols/ in the main directory of the downloaded and extracted IJB folder, I obtain:

IJB-C/protocols/:                                                                                                                                                                                      
archive  ijbc_metadata_with_age.csv  readme.txt  test1  test10  test11  test2  test4  test6  test7  test9                                                                                              
                                                                                                                                                                                                       
IJB-C/protocols/archive:                                                                                                                                                                               
clustering                     ijbc_11_covariate_probe_reference.csv  ijbc_1N_gallery_G1.csv  ijbc_1N_probe_mixed.csv  ijbc_face_detection_ground_truth.csv  ijbc_wild_test10.csv  ijbc_wild_test9.csv 
ijbc_11_covariate_matches.csv  ijbc_11_G1_G2_matches.csv              ijbc_1N_gallery_G2.csv  ijbc_face_detection.csv  ijbc_metadata.csv                     ijbc_wild_test11.csv                      
                                                                                                                                                                                                       
IJB-C/protocols/archive/clustering:                                                                                                                                                                    
ijbc_clustering_1021_hint_10000.csv  ijbc_clustering_1839_hint_10000.csv  ijbc_clustering_32_hint_100.csv  ijbc_clustering_3531_hint_10000.csv  ijbc_clustering_ground_truth.csv                       
                                                                                                                                                                                                       
IJB-C/protocols/test1:                                                                                                                                                                                 
enroll_templates.csv  match.csv  README.txt  verif_templates.csv                                                                                                                                       
                                                                                                                                                                                                       
IJB-C/protocols/test10:                                                                                                                                                                                
gallery_G1.csv  gallery_G2.csv  probes.csv  README.txt                                                                                                                                                 
                                                                                                                                                                                                       
IJB-C/protocols/test11:                                                                                                                                                                                
gallery_G1.csv  gallery_G2.csv  probes.csv  README.txt                                                                                                                                                 
                                                                                                                                                                                                       
IJB-C/protocols/test2:                                                                                                                                                                                 
enroll_templates.csv  match.csv  README.txt  verif_templates.csv                                                                                                                                       
                                                                                                                                                                                                       
IJB-C/protocols/test4:                                                                                                                                                                                 
gallery_G1.csv  gallery_G2.csv  probes.csv  README.txt                                                                                                                                                 
                                                                                                                                                                                                       
IJB-C/protocols/test6:                                                                                                                                                                                 
face_detection.csv  face_detection_ground_truth.csv  README.txt                                                                                                                                        
                                                                                                                                                                                                       
IJB-C/protocols/test7:                                                                                                                                                                                 
clustering_1021_hint_10000.csv  clustering_1839_hint_10000.csv  clustering_32_hint_100.csv  clustering_3531_hint_10000.csv  clustering_ground_truth.csv  README.txt                                    
                                                                                                                                                                                                       
IJB-C/protocols/test9:                                                                                                                                                                                 
gallery_G1.csv  gallery_G2.csv  probes.csv  README.txt                                                                                                                                                 

The currently implemented protocol files are located in IJB-C/protocols/archive. The new files have a much easier structure.

Currently, only the 1:1 protocol is implemented, which would correspond to the IJB-C/protocols/test1 folder. However, the database also provides many more protocols, for example, open-set identification protocols defined in IJB-C/protocols/test4. An implementation of these protocols would be great, and should be straightforward with the new protocol files.

Assignee
Assign to
Time tracking