Cannot search or combine plots from multiple analyzers, where one algorithm is used in two blocks
I have a tool chain, where I separate between the development and the test set: https://www.beat-eu.org/platform/toolchains/siebenkopf/FaceRec-WithOut-Training/2
I have ran two experiments, where I was using the same analyzer (ROC, which is plotting an ROC curve) in two different blocks, namely res_dev
and res_eval
.
Additionally, I have a third analyzer, which computes the EER and the HTER.
In the result page of these experiments:
https://www.beat-eu.org/platform/experiments/siebenkopf/siebenkopf/FaceRec-WithOut-Training/2/Banca_P-Canberra/
and
https://www.beat-eu.org/platform/experiments/siebenkopf/siebenkopf/FaceRec-WithOut-Training/2/Banca_P-PhaseDiff/
both ROC plots are displayed correctly, as well as the EER and the HTER.
Now, I want to generate comparison ROC plots for both the development and the test set, and a table listing the EERs and HTERs. When I search for the results, two analyzers are listed, the ROC and the EER_HTER. However, I expected to have two ROC analyzers. After a discussion with @andre.anjos it turned out that there is (yet) no direct way to separate the results of two blocks running the same analyzer. We have to come up with a more clever idea, how to handle that case.
Additionally, I cannot even combine the outputs of the EER_HTER analyzer. When I click on the according rack-wheel button, an empty box opens.