Official Task Variations (3/3): Add Official AlpacaEval, Arena-Hard, and MT-Bench Tasks - #115

Merged

kargibora merged 11 commits into

refactor/composable-pairwise-metricsfrom

feat/official-task-variants-v2

Sep 15, 2026

Commits on Sep 10, 2026

Commits on Sep 14, 2026

fix: align Arena-Hard fitting and retain incomplete Alpaca judgments
kargibora
committed
e3458ab
chore: remove standalone PyTorch notice
kargibora
committed
09a7c34
Merge commit '1cfbd0ebc4f3889262596e7f061dc705a00ee876' into HEAD
kargibora
committed
7f0e0ab
fix: preserve task overrides and handle unsupported judgments
kargibora
committed
94a3b39
test: reduce official benchmark cases to representative contracts
kargibora
committed
5c052b5
Merge compact PR 113 tests into PR 115
kargibora
committed
c92cfe6
test: restore inherited coverage through official task variants
kargibora
committed
e38ccae