Search results

[FT] add a long horizon "tension crash test" dimension based on a TXT S-class question pack

Status: Open.

#1164 In huggingface/lighteval;

· onestardao opened on Feb 6, 2026

[BUG] KeyError: 'default'

bug

Status: Open.

#1163 In huggingface/lighteval;

· 2niuhe opened on Jan 31, 2026

[BUG] IndexError: list index out of rang

bug

Status: Open.

#1162 In huggingface/lighteval;

· 2niuhe opened on Jan 31, 2026

Fix TypeError in aa_omniscience_prompt

Status: Open.

#1160 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix split loading error in bigbench

Status: Open.

#1158 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix RecursionError in imdb_contrastset_prompt

Status: Open.

#1154 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix non-existent evaluation splits in lextreme

Status: Open.

#1150 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix evaluation split config in lsat_qa

Status: Open.

#1148 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Improve NarrativeQA metrics and prompt structure

Status: Open.

#1146 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix schema validation in olympiad_bench Doc.specific

Status: Open.

#1144 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix key mismatch and context access in PubMedQA

Status: Open.

#1142 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026

Fix TypeError in real_toxicity_prompts due to None choices

Status: Open.

#1140 In huggingface/lighteval;

· pjavanrood opened on Jan 22, 2026