Evaluate script should produce plots and tables
ptbench evaluate
should produce plots and tables summarising results:
- Plots:
- Histogram distributions of true-positive/true-negative scores
- ROC curve (Sensitivity on the vertical axis, "1-Specificity" on the horizontal axis)
- Precision-Recall curve (Precision on the vertical axis, Recall on the horizontal axis)
- Table - 1 single table that summarises the most important measures
- Dataset name (within the split)
- Threshold applied
- If the threshold was chosen a priori or a posteriori
- Check further elements here: https://gitlab.idiap.ch/biosignal/software/deepdraw/-/blob/master/src/deepdraw/utils/table.py