bob.bio.base merge requestshttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests2021-10-29T15:34:58Zhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/265[score][load] Always sort scores when sort=True2021-10-29T15:34:58ZAmir MOHAMMADI[score][load] Always sort scores when sort=TrueFixes a bug introduced in !258 where scores were not being sorted
when the file was a csv file.Fixes a bug introduced in !258 where scores were not being sorted
when the file was a csv file.Yannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/264Making Distance algorithm (enroll and scoring) more robust while different...2021-10-29T15:34:58ZTiago de Freitas PereiraMaking Distance algorithm (enroll and scoring) more robust while different...Making Distance algorithm (enroll and scoring) more robust while different sources of data is provided.
Related to https://gitlab.idiap.ch/bob/bob.bio.video/-/merge_requests/46Making Distance algorithm (enroll and scoring) more robust while different sources of data is provided.
Related to https://gitlab.idiap.ch/bob/bob.bio.video/-/merge_requests/46https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/263Updated legacy checkpoint wrapper to used pickle+gzip format2021-10-29T15:34:58ZTiago de Freitas PereiraUpdated legacy checkpoint wrapper to used pickle+gzip formatLaurent COLBOISLaurent COLBOIShttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/262[CSVDataset] Expose option to group the probes in SampleSets by reference id2021-10-29T15:34:58ZLaurent COLBOIS[CSVDataset] Expose option to group the probes in SampleSets by reference idThis is necessary for the protocol "2.0.2" of bob.bio.face.database.frgc, in which probe reference templates are formed from a set of 4 probe images, which should be regrouped in a single SampleSet.
cf. https://gitlab.idiap.ch/bob/bob.b...This is necessary for the protocol "2.0.2" of bob.bio.face.database.frgc, in which probe reference templates are formed from a set of 4 probe images, which should be regrouped in a single SampleSet.
cf. https://gitlab.idiap.ch/bob/bob.bio.face/-/merge_requests/139
@tiago.pereira could you please have a look at it as we discussed it together yesterday ?Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/261Implemented the hash_fn mechanism into the biometric algorithm2021-10-29T15:34:58ZTiago de Freitas PereiraImplemented the hash_fn mechanism into the biometric algorithmThis will handle cases where we have thousands of biometric references to be enrolled.
Do you mind reviewing this one @lcolbois
Thanks
Closes #161This will handle cases where we have thousands of biometric references to be enrolled.
Do you mind reviewing this one @lcolbois
Thanks
Closes #161Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/259Resolve "score_reduction_algorithm in BioAlgorithm cannot be changed"2021-10-29T15:34:58ZManuel Günthersiebenkopf@googlemail.comResolve "score_reduction_algorithm in BioAlgorithm cannot be changed"Closes #159Closes #159Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/258Allow reading a mix of old and new format scores2021-10-29T15:34:58ZAmir MOHAMMADIAllow reading a mix of old and new format scoresYannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/256Solving possible race condition issues with certain datasets2021-10-29T15:34:58ZTiago de Freitas PereiraSolving possible race condition issues with certain datasetsIn some legacy datasets, the same sample can work as a biometric reference and probe.
Running distributed experiments might trigger some racing conditions.
Since our file system has no file locking mechanism, we might face some random an...In some legacy datasets, the same sample can work as a biometric reference and probe.
Running distributed experiments might trigger some racing conditions.
Since our file system has no file locking mechanism, we might face some random and bizarre bugs. This MR fixes the issue.https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/255Updates2021-10-29T15:34:58ZTiago de Freitas PereiraUpdatesTwo updates in the MR.
- First, I updated the extension of the ZTNorm score files to `.csv`
- Second, we should return delayed objects while reading the scores in `get_split_dataframe`. This avoids larger than memory problems. Imagine ...Two updates in the MR.
- First, I updated the extension of the ZTNorm score files to `.csv`
- Second, we should return delayed objects while reading the scores in `get_split_dataframe`. This avoids larger than memory problems. Imagine the scenario where 10 score files with 5.5GB each need to be processed; the code will possibly break at this point. Delaying these readings alleviates this issue.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/254Update the vulnerability dataset loading method2021-10-29T15:34:58ZYannick DAYERUpdate the vulnerability dataset loading method- Removed `SampleLoaderVulnerability` -- Use a normal CSVDataset with `SampleLoaderBiometric` and `is_parse` flag instead.
- Updated the doc to represent this change and how to build the CSV protocol files for using with `is_sparse`.- Removed `SampleLoaderVulnerability` -- Use a normal CSVDataset with `SampleLoaderBiometric` and `is_parse` flag instead.
- Updated the doc to represent this change and how to build the CSV protocol files for using with `is_sparse`.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/253Vulnerability: Add a SampleLoader that prevents negative attack scores comput...2021-10-29T15:34:58ZYannick DAYERVulnerability: Add a SampleLoader that prevents negative attack scores computationAdds a `references` list to the samples to prevent attack probes to be compared to every reference.Adds a `references` list to the samples to prevent attack probes to be compared to every reference.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/252[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped b...2021-10-29T15:34:58ZTiago de Freitas Pereira[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped by...[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped by using the bob_features_save_fn and bob_features_load_fn tags
This would allow us more flexibility with estimators that already handle `bob.pipeline.Samples`[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped by using the bob_features_save_fn and bob_features_load_fn tags
This would allow us more flexibility with estimators that already handle `bob.pipeline.Samples`Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/251Use the CSV ScoreWriter by default in bob pipelines vanilla-biometrics2021-10-29T15:34:58ZYannick DAYERUse the CSV ScoreWriter by default in bob pipelines vanilla-biometricsAdds a Click option to choose between CSV and four-column scores, defaulting to CSV.Adds a Click option to choose between CSV and four-column scores, defaulting to CSV.Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/250Supporting the CSVWriter in our evaluation scripts2021-10-29T15:34:58ZTiago de Freitas PereiraSupporting the CSVWriter in our evaluation scriptsSo far `bob bio evaluate` (and it's siblings) does not have support for scores written with `CSVScoreWriter` (`bob bio pipelines vanilla-biometrics --write-metadata-scores`).
This MR fixes thatSo far `bob bio evaluate` (and it's siblings) does not have support for scores written with `CSVScoreWriter` (`bob bio pipelines vanilla-biometrics --write-metadata-scores`).
This MR fixes thatYannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/249Allow a CSVDataset to define `fetch_probes`.2021-10-29T15:34:58ZYannick DAYERAllow a CSVDataset to define `fetch_probes`.Needed by replaymobile-img in bob.bio.faceNeeded by replaymobile-img in bob.bio.faceAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/248Support invalid samples and scores2021-10-29T15:34:58ZYannick DAYERSupport invalid samples and scoresYannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/247Multiple Improvements2021-10-29T15:34:58ZAmir MOHAMMADIMultiple Improvements* Improve the documentation
* Refactor database interfaces
* Some misc fixes
Fixes #154 #153 #102 #137 #144 * Improve the documentation
* Refactor database interfaces
* Some misc fixes
Fixes #154 #153 #102 #137 #144 Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/246Vulnerability analysis documentation2021-10-29T15:34:58ZYannick DAYERVulnerability analysis documentationAdding documentation on how to evaluate a system for vulnerability.Adding documentation on how to evaluate a system for vulnerability.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/245Score checkpoint are more robust2021-04-07T13:24:47ZTiago de Freitas PereiraScore checkpoint are more robustIn this MR I'm changing the way we checkpoint scores.
I moved from the joblib pickling to pickle and compress with gzip myself.
This seems more robust with our file system.In this MR I'm changing the way we checkpoint scores.
I moved from the joblib pickling to pickle and compress with gzip myself.
This seems more robust with our file system.https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/244Update of the vulnerability analysis commands2021-10-29T15:34:58ZYannick DAYERUpdate of the vulnerability analysis commandsAccepting CSV score files.Accepting CSV score files.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADI