Skip to content

Commit 4de343e

Browse files
committed
msg
Signed-off-by: Luca Soldaini <lucas@allenai.org>
1 parent b82e678 commit 4de343e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/cookbook/eval/results.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -103,7 +103,7 @@ def make_dashboard_table(
103103
if 'styled_math500' in metric.alias and 'tulu' in metric.alias:
104104
metric.metrics.primary_score = metric.metrics.extra_metrics['exact_match_flex']
105105

106-
# @soldni: hot fix for wildchat/ultrachat masked ppl. The task has no alias in oe-eval,
106+
# @soldni: Hotfix for wildchat/ultrachat masked ppl. The task has no alias in oe-eval,
107107
# so hash gets added at the end the name. We strip if the hash matches the known one.
108108
if metric.alias in {'wildchat_masked_ppl-67b0e9', 'ultrachat_masked_ppl-831470'}:
109109
metric_alias, _ = metric.alias.rsplit('-', 1)

0 commit comments

Comments
 (0)