Skip to content
Snippets Groups Projects

Fixed issue with score normalization with dev/eval groups

Merged Tiago de Freitas Pereira requested to merge norm-stats into master

The current score normalization pipeline had an issue while executing experiments with dev/eval groups. Once the normalization statistics were computed on the dev set, its check-point contains a name that is indistinguishable from the one of the evaluation set. Consequently, the evaluation set pipeline tries to use the statistics from the dev set, which breaks the code.

This bug was introduced while the score normalization pipeline was refactored. It would be good in the future if we have a good dummy dataset to test all this stuff, even if this cost more hours on the CI.

Merge request reports

Pipeline #63148 passed

Pipeline passed for 74d3b9ef on norm-stats

Test coverage 81.00% from 5 jobs

Merged by Yannick DAYERYannick DAYER 2 years ago (Jul 19, 2022 5:03pm UTC)

Loading

Pipeline #63151 passed

Pipeline passed for 0988e735 on master

Test coverage 81.00% from 5 jobs

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
Please register or sign in to reply
Loading