On Oct 22, SkillEval builds per-skill ability profiles of LLMs from benchmark data.
Where it stands
On Oct 22, SkillEval builds per-skill ability profiles of LLMs from benchmark data.
Timeline · newest first
Official
SkillEval builds per-skill ability profiles of LLMs from benchmark data
Posted on arXiv on Oct 22, 2026 (source: arxiv.org).
The paper introduces SkillEval, which discovers skills from benchmark questions and uses psychometric models to estimate each model's ability per skill. Tested on 3,811 models across five benchmarks, the authors report it predicts behavior better and cut routing inference cost by over 60%. The paper has not yet been peer-reviewed.