Wrappers and aggregators

Hi guys, follow an awesome update of this MR that is ready to be merged to dask-pipelines. Follow below the list of features:

• Ported the legacy transformers with the new aggregators API (Preprocessor, Extractor and Algorithm)
• Created some easy to use wrappers to wrap these legacy objects
• Removed all traces of non picklable stuff in our design. It was a terrible idea and this brings more problems than solve. It's a lesson learned that shouldn't be repeated.
• Making an effort to make stuff picklable in the most relevant packages (bob.bio.face, bob.learn.em, bob.learn.linear,....)
• Rewrote part of the BiometricAlgorithm class and created aggregators to handle dask and checkpoint support (https://gitlab.idiap.ch/bob/bob.bio.base/-/blob/wrapper-api/bob/bio/base/pipelines/vanilla_biometrics/wrappers.py#L122 and https://gitlab.idiap.ch/bob/bob.bio.base/-/blob/wrapper-api/bob/bio/base/pipelines/vanilla_biometrics/wrappers.py#L12 respectively)
• Detached the score writing mechanism from BiometricAlgorithm. This is useful if we want to write scores for different "analyzers". Now we have 2 score writers.
  • FourColumnsWriter: This one is our link to the past (e.g. our plotting scripts)
  • CSVWriter: In one line writes: i-Metadata from biometric reference, ii-Metada from probe, iii-the score. This is useful when you want to analyze certain cohorts based on metadata (e.g demographics, device model, etc,..). Even the vulnerability test can benefit from it. We could write one protocol containing all probes (genuines and PAs) and make an analyzer that filters this information from the CSV.
  • ... you could imagine writing a SQLWriter in case you have large scale datasets and want to leverage from some SQL features (indexes, optimized aggregation functions, etc...)
  • Created better tests

Things to be done:

• A user guide is still missing, but I have an idea for it to make things more understandable.
• I still need to move forward with this package for my work. For instance, I have stashed here a pipeline for score normalization.

I think that's it

added 1 commit

• 36b9ab2d - Removed the sketch of ZTNorm

Compare with previous version

added 3 commits

• d5fef270 - Updated _more_tags methods
• a3282ddd - Detached the mechanism of writing scores from the BioAlgCheckpointing. This...
• 735ad313 - Reorganing the structure of vanilla_biometrics

Compare with previous version

Don't review it. I'm still working on it

added 6 commits

• 40cb9aea - Dasking estimators
• 9e3a1f03 - Created CSV Score writter
• 93e8486b - Cleaning up
• 523e4e28 - Implemeted [dask] wrapper
• ba36a5cf - Fixed extension of score writer
• ebc2cb4c - Patched with new VanillaBiometricsPipeline

Compare with previous version

added 4 commits

• 0e3d6af0 - Removed examples
• 54162c97 - [sphinx] Small patches to build the docs. This docs needs to be done from scratch
• 89064087 - Used the ScoreWriter to do the score concatenation
• 18f0ff35 - Handle legacy bob.bio.base Algorithms as algorithms

Compare with previous version

added 1 commit

• 3e5506e4 - Some cosmetic changes in the legacy wrap function

Compare with previous version

added 1 commit

• afbe3b9e - Using single-threaded dask scheduler

Compare with previous version

unmarked as a Work In Progress

changed the description

mentioned in merge request !186 (closed)

added 2 commits

• f178ce66 - [black]
• 493da265 - Memory optimizing CSVWriter

Compare with previous version

added 1 commit

• 1ae9d33c - Fixed bug with the CSV header

Compare with previous version

added 1 commit

• ca62d02e - Fixed CSVScoreWriter tests

Compare with previous version

added 1 commit

• ce29f3bb - Implemented extra wrappers for bob legacy and ported some default options from cd ..

Compare with previous version

Ported the wrappers implemented in !186 (closed)

Shall we merge once it's green?

Ok, thanks, let me review this.