WIP: rPPG as features for PAD

Hey all,

So I'm working on this rPPG features for PAD. Right now, I implemented three different algorithms to retrieve the pulse signal, and they are all based on what I previously did in bob.rppg.base (and hence, bob.pad.face should then depend on it eventually).

At the moment, all pulse extraction algorithm are implemented as bob.pad.face.Extractor, but the more I think about it, I think that they should be implemented as bob.pad.face.Preprocessor for mainly two reasons:

1. Solves the problem with rotated videos directly (instead of having an "empty" preprocessor copying data)
2. Gives the ability to then extract features from the pulse (i.e. frequency spectrum, for instance)

@amohammadi @onikisins @dgeissbuhler @andre.anjos @ageorge @pkorshunov any comments, remarks, suggestions on the best way to integrate that in this package are welcomed

Thanks !

Hi @heusch

As long as bob.rppg.base does not have any dependencies that could go unmaintained, it should be ok to add it as a dependency here. I see that it depends on two db packages. db packages tend to go unmaintained. Could you drop those from bob.rppg.base or make it optional in there?

@amohammadi Good point. It may need some rework on the bob.rppg.base package then. @andre.anjos what do you think ? I'll open an issue on bob.rppg.base for that matter.

added 22 commits

• 5ee01dfd...8a66d83c - 17 commits from branch master
• 99126097 - Merge branch 'master' into rppg
• fa5b2087 - [extractor] removed all the pulse extractor
• ce463a0c - [preprocessor] added all the pulse algorithms as preprocessor, and removed the dummy one
• cad231fb - [extractor] added the extraction of the freq spectrum for pulse signal
• d1df496f - [extractor] added feature extractor from Li paper

Compare with previous version

added 3 commits

• bdd6bf10 - [extractor] fixed the extractor for Li feature, using FFT
• a59bf0c7 - [extractor] added sanity check on the input for FrequencySpectrum features
• 594e57d4 - [extractor] added extractor that normalize the length of the features, and one…

Compare with previous version

added 1 commit

• 8fc2c962 - [extractor] added FFT features, modified Freq Features (Li), added LTSS features

Compare with previous version

added 1 commit

• f176d11d - [extractor] removed the import for Autocorrelation (not existing anymore)

Compare with previous version

assigned to @heusch

added 1 commit

• 4e7a0641 - [config] changed my grid config

Compare with previous version

added 1 commit

• d028b3f6 - [database] first attempt to incorporate 3DMAD database

Compare with previous version

added 2 commits

• d0565381 - [preprocessor] started PPGSecure implementation
• a1fc10ee - [database] finished - i.e. working, but should be polished - 3DMAD high-level interface

Compare with previous version

added 3 commits

• 379b8d09 - [preprocessor] fixed bandpass filter parameters in Li
• 4dc5bc02 - [preprocessor, extractor] added PPGSecure
• 6751c7be - [preprocessor] fixed stuff (mainly docstrings) in pulse preprocessors

Compare with previous version

added 1 commit

• caac10bf - [conda] added bob.rppg.base

Compare with previous version

added 1 commit

• f58d5fde - [extractor] fixed extractors for pulse-based PAD

Compare with previous version

added 1 commit

• ffb0f091 - [database] remove batl and 3dmad in __init__ file

Compare with previous version

added 1 commit

• ba80ebba - [doc] fixed indentation in bob/pad/face/preprocessor/PPGSecure.py docstring

Compare with previous version

added 4 commits

• bbe0e08c - [preprocessor, extractor] fixed docstrings (again)
• 54ac14b1 - [conda] tagged numpy version to 1.11
• d7e7ff79 - [doc] added bob.ip.skincolorfilter in extra-intersphinx
• 6e9d93fe - [req] removed sphinx from the requirements

Compare with previous version

added 1 commit

• c2948d8f - [conda] added bob.rppg.base as run and test requirements

Compare with previous version

Hey all,

As mentioned earlier by @amohammadi, I removed the dependencies in bob.rppg.base. Now that everything is green, it would be nice to merge this branch. Any objection ?

Thanks