SkillEval

Product · 1 update · Updated Oct 22

On Oct 22, SkillEval builds per-skill ability profiles of LLMs from benchmark data.

Where it stands

On Oct 22, SkillEval builds per-skill ability profiles of LLMs from benchmark data.

Timeline · newest first
  1. Official

    SkillEval builds per-skill ability profiles of LLMs from benchmark data

    Posted on arXiv on Oct 22, 2026 (source: arxiv.org).

    The paper introduces SkillEval, which discovers skills from benchmark questions and uses psychometric models to estimate each model's ability per skill. Tested on 3,811 models across five benchmarks, the authors report it predicts behavior better and cut routing inference cost by over 60%. The paper has not yet been peer-reviewed.

    Source: arXiv cs.CL
Related stories
How we label
Official
An institution announces something that has already happened, through its own channel or a founder or executive account.
Statement by …
A named person's views, predictions, plans or comments, including remarks reported by media when the original is unavailable.
Reported by …
Only media or another third party is saying it. We name the outlet.
Unconfirmed
Circulating online (posts, comments, leaks). No company, named person or outlet has confirmed it.

Items older than 72 hours never go in Top stories and show their original date.

DailyCitedRSSAboutPrivacy