bob.bio.base merge requestshttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests2021-02-17T11:57:40Zhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/240Doc cleanup2021-02-17T11:57:40ZYannick DAYERDoc cleanupDid a pass in Grammaly and corrected the errors.Did a pass in Grammaly and corrected the errors.Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/241Legacy database wrapper was not supporting this properly supporting the use c...2021-02-17T12:35:04ZTiago de Freitas PereiraLegacy database wrapper was not supporting this properly supporting the use case where `model_id<>client_id`Making the bob.bio.base database interface support samplesets where the **reference_id** is different from **subject_id**.
There are some databases protocols that needs such support.
Furthermore the legacy database interface was not sup...Making the bob.bio.base database interface support samplesets where the **reference_id** is different from **subject_id**.
There are some databases protocols that needs such support.
Furthermore the legacy database interface was not supporting this properly
ping @mguentherhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/242[bob.piplines] sample loaders have moved in bob.pipelines2021-03-22T16:46:33ZAmir MOHAMMADI[bob.piplines] sample loaders have moved in bob.pipelinesDepends on bob.pipelines!62Depends on bob.pipelines!62Bob 9.0.0Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/243Add the vulnerability analysis commands2021-10-29T15:34:58ZYannick DAYERAdd the vulnerability analysis commandsMoved from bob.pad.baseMoved from bob.pad.baseBob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/245Score checkpoint are more robust2021-04-07T13:24:47ZTiago de Freitas PereiraScore checkpoint are more robustIn this MR I'm changing the way we checkpoint scores.
I moved from the joblib pickling to pickle and compress with gzip myself.
This seems more robust with our file system.In this MR I'm changing the way we checkpoint scores.
I moved from the joblib pickling to pickle and compress with gzip myself.
This seems more robust with our file system.https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/244Update of the vulnerability analysis commands2021-10-29T15:34:58ZYannick DAYERUpdate of the vulnerability analysis commandsAccepting CSV score files.Accepting CSV score files.Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/249Allow a CSVDataset to define `fetch_probes`.2021-10-29T15:34:58ZYannick DAYERAllow a CSVDataset to define `fetch_probes`.Needed by replaymobile-img in bob.bio.faceNeeded by replaymobile-img in bob.bio.faceAmir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/248Support invalid samples and scores2021-10-29T15:34:58ZYannick DAYERSupport invalid samples and scoresYannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/247Multiple Improvements2021-10-29T15:34:58ZAmir MOHAMMADIMultiple Improvements* Improve the documentation
* Refactor database interfaces
* Some misc fixes
Fixes #154 #153 #102 #137 #144 * Improve the documentation
* Refactor database interfaces
* Some misc fixes
Fixes #154 #153 #102 #137 #144 Bob 9.0.0Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/246Vulnerability analysis documentation2021-10-29T15:34:58ZYannick DAYERVulnerability analysis documentationAdding documentation on how to evaluate a system for vulnerability.Adding documentation on how to evaluate a system for vulnerability.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/252[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped b...2021-10-29T15:34:58ZTiago de Freitas Pereira[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped by...[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped by using the bob_features_save_fn and bob_features_load_fn tags
This would allow us more flexibility with estimators that already handle `bob.pipeline.Samples`[legacy] Changed the way vanilla-biometric pipelines are checkpoint wrapped by using the bob_features_save_fn and bob_features_load_fn tags
This would allow us more flexibility with estimators that already handle `bob.pipeline.Samples`Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/253Vulnerability: Add a SampleLoader that prevents negative attack scores comput...2021-10-29T15:34:58ZYannick DAYERVulnerability: Add a SampleLoader that prevents negative attack scores computationAdds a `references` list to the samples to prevent attack probes to be compared to every reference.Adds a `references` list to the samples to prevent attack probes to be compared to every reference.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/250Supporting the CSVWriter in our evaluation scripts2021-10-29T15:34:58ZTiago de Freitas PereiraSupporting the CSVWriter in our evaluation scriptsSo far `bob bio evaluate` (and it's siblings) does not have support for scores written with `CSVScoreWriter` (`bob bio pipelines vanilla-biometrics --write-metadata-scores`).
This MR fixes thatSo far `bob bio evaluate` (and it's siblings) does not have support for scores written with `CSVScoreWriter` (`bob bio pipelines vanilla-biometrics --write-metadata-scores`).
This MR fixes thatYannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/254Update the vulnerability dataset loading method2021-10-29T15:34:58ZYannick DAYERUpdate the vulnerability dataset loading method- Removed `SampleLoaderVulnerability` -- Use a normal CSVDataset with `SampleLoaderBiometric` and `is_parse` flag instead.
- Updated the doc to represent this change and how to build the CSV protocol files for using with `is_sparse`.- Removed `SampleLoaderVulnerability` -- Use a normal CSVDataset with `SampleLoaderBiometric` and `is_parse` flag instead.
- Updated the doc to represent this change and how to build the CSV protocol files for using with `is_sparse`.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/255Updates2021-10-29T15:34:58ZTiago de Freitas PereiraUpdatesTwo updates in the MR.
- First, I updated the extension of the ZTNorm score files to `.csv`
- Second, we should return delayed objects while reading the scores in `get_split_dataframe`. This avoids larger than memory problems. Imagine ...Two updates in the MR.
- First, I updated the extension of the ZTNorm score files to `.csv`
- Second, we should return delayed objects while reading the scores in `get_split_dataframe`. This avoids larger than memory problems. Imagine the scenario where 10 score files with 5.5GB each need to be processed; the code will possibly break at this point. Delaying these readings alleviates this issue.Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/256Solving possible race condition issues with certain datasets2021-10-29T15:34:58ZTiago de Freitas PereiraSolving possible race condition issues with certain datasetsIn some legacy datasets, the same sample can work as a biometric reference and probe.
Running distributed experiments might trigger some racing conditions.
Since our file system has no file locking mechanism, we might face some random an...In some legacy datasets, the same sample can work as a biometric reference and probe.
Running distributed experiments might trigger some racing conditions.
Since our file system has no file locking mechanism, we might face some random and bizarre bugs. This MR fixes the issue.https://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/251Use the CSV ScoreWriter by default in bob pipelines vanilla-biometrics2021-10-29T15:34:58ZYannick DAYERUse the CSV ScoreWriter by default in bob pipelines vanilla-biometricsAdds a Click option to choose between CSV and four-column scores, defaulting to CSV.Adds a Click option to choose between CSV and four-column scores, defaulting to CSV.Tiago de Freitas PereiraTiago de Freitas Pereirahttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/258Allow reading a mix of old and new format scores2021-10-29T15:34:58ZAmir MOHAMMADIAllow reading a mix of old and new format scoresYannick DAYERYannick DAYERhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/259Resolve "score_reduction_algorithm in BioAlgorithm cannot be changed"2021-10-29T15:34:58ZManuel Günthersiebenkopf@googlemail.comResolve "score_reduction_algorithm in BioAlgorithm cannot be changed"Closes #159Closes #159Amir MOHAMMADIAmir MOHAMMADIhttps://gitlab.idiap.ch/bob/bob.bio.base/-/merge_requests/261Implemented the hash_fn mechanism into the biometric algorithm2021-10-29T15:34:58ZTiago de Freitas PereiraImplemented the hash_fn mechanism into the biometric algorithmThis will handle cases where we have thousands of biometric references to be enrolled.
Do you mind reviewing this one @lcolbois
Thanks
Closes #161This will handle cases where we have thousands of biometric references to be enrolled.
Do you mind reviewing this one @lcolbois
Thanks
Closes #161Tiago de Freitas PereiraTiago de Freitas Pereira