Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
bob.measure
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
2
Issues
2
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
bob
bob.measure
Commits
b4976267
Commit
b4976267
authored
Apr 13, 2018
by
Theophile GENTILHOMME
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Small changes in the user guide, add titles option to hist command
parent
14e852f2
Pipeline
#18919
passed with stage
in 33 minutes and 50 seconds
Changes
2
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
12 additions
and
11 deletions
+12
-11
bob/measure/script/commands.py
bob/measure/script/commands.py
+1
-0
doc/guide.rst
doc/guide.rst
+11
-11
No files found.
bob/measure/script/commands.py
View file @
b4976267
...
...
@@ -152,6 +152,7 @@ def epc(ctx, scores, **kwargs):
@
common_options
.
const_layout_option
()
@
common_options
.
show_dev_option
()
@
common_options
.
print_filenames_option
()
@
common_options
.
titles_option
()
@
verbosity_option
()
@
click
.
pass_context
def
hist
(
ctx
,
scores
,
evaluation
,
**
kwargs
):
...
...
doc/guide.rst
View file @
b4976267
...
...
@@ -491,6 +491,7 @@ on a set, after setting up |project|, just do:
==== ===================
.. Development dev-1
==== ===================
FtA 0.000%
FMR 6.263% (31/495)
FNMR 6.208% (28/451)
FAR 5.924%
...
...
@@ -498,7 +499,7 @@ on a set, after setting up |project|, just do:
HTER 8.599%
==== ===================
The output will present the threshold together with the FMR, FMNR, FAR, FRR and
The output will present the threshold together with the F
tA, F
MR, FMNR, FAR, FRR and
HTER on the given set, calculated using such a threshold. The relative counts of FAs
and FRs are also displayed between parenthesis.
...
...
@@ -519,6 +520,7 @@ To evaluate the performance of a new score file with a given threshold, use
==== ====================
.. Development eval-1
==== ====================
FtA 0.000%
FMR 5.010% (24/479)
FNMR 6.977% (33/473)
FAR 4.770%
...
...
@@ -536,6 +538,7 @@ on an evaluation set:
==== =================== ===============
.. Development dev-1 Eval. eval-1
==== =================== ===============
FtA 0.000% 0.000%
FMR 6.263% (31/495) 5.637% (27/479)
FNMR 6.208% (28/451) 6.131% (29/473)
FAR 5.924% 5.366%
...
...
@@ -544,11 +547,8 @@ on an evaluation set:
==== =================== ===============
.. note::
Table format can be changed using ``--tablefmt`` option. Note that
``latex``
format is used by default when the outputs are witten in a log file and
``rst`` when written in the terminal. See
``bob measure metrics --help`` for more details.
Table format can be changed using ``--tablefmt`` option, the default format
being ``rst``. Please refer to ``bob measure metrics --help`` for more details.
Plots
...
...
@@ -573,7 +573,7 @@ For example, to generate a DET curve from development and evaluation datasets:
.. code-block:: sh
$bob measure det --
split --
output 'my_det.pdf' dev-1.txt eval-1.txt
$bob measure det --output 'my_det.pdf' dev-1.txt eval-1.txt
dev-2.txt eval-2.txt
where `my_det.pdf` will contain DET plots for the two experiments.
...
...
@@ -586,14 +586,14 @@ where `my_det.pdf` will contain DET plots for the two experiments.
Evaluate
========
A convenient command `
evaluate
` is provided to generate multiple metrics and
plots for a list of experiments. It generates two `
metrics` outputs with EE
R
and HTER criteria along with `
roc`, `det`, `epc`, `hist
` plots for each
A convenient command `
`evaluate`
` is provided to generate multiple metrics and
plots for a list of experiments. It generates two `
`metrics`` outputs with ER
R
and HTER criteria along with `
`roc``, ``det``, ``epc``, ``hist`
` plots for each
experiment. For example:
.. code-block:: sh
$bob measure evaluate -
t -
l 'my_metrics.txt' -o 'my_plots.pdf' {sys1, sys2}/
$bob measure evaluate -l 'my_metrics.txt' -o 'my_plots.pdf' {sys1, sys2}/
{eval,dev}
will output metrics and plots for the two experiments (dev and eval pairs) in
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment