From e294ba00fcec03640f2711b10a4c09c796df90da Mon Sep 17 00:00:00 2001 From: Ross Cutler <46252169+rosscutler@users.noreply.github.com> Date: Wed, 4 Jun 2025 12:40:53 -0700 Subject: [PATCH] Clarify submissions not used in results docs --- docs/results.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/results.md b/docs/results.md index 7b105bf..16dcc18 100644 --- a/docs/results.md +++ b/docs/results.md @@ -71,8 +71,8 @@ want to have experiment specific criteria for data cleansing process. * `gold_standard_bigger_equal:1` Submissions with wrong answers to the gold questions will not be used. * `viewing_duration_over:1.15` If the overall play-back duration exceed 115% of videos' duration, the submission will not be used * `correct_matrix_bigger_equal: 2` Both brightness tests (matrix with images) should be answered correctly - * `rater_min_acceptance_rate_current_test : 80` Minimum acceptance rate for a worker in this test. If they have - an acceptance rate below this percentage all of their submission will to be used. +* `rater_min_acceptance_rate_current_test : 80` Minimum acceptance rate for a worker in this test. If they have + an acceptance rate below this percentage, all of their submissions will not be used. * `rater_min_accepted_hits_current_test : 1` The minimum number of accepted submissions that a worker should have. 1. Run `result_parser.py`