On Oct 22, LADDER pruning keeps LLM quality more robust at 70% sparsity and above.
Where it stands
On Oct 22, LADDER pruning keeps LLM quality more robust at 70% sparsity and above.
Timeline · newest first
Official
LADDER pruning keeps LLM quality more robust at 70% sparsity and above
Posted on arXiv on Oct 22, 2026 (source: arxiv.org).
The paper introduces LADDER, which adds sparsity layer by layer where it does the least damage and produces nested masks across budgets. Tested on five OPT, Llama and Qwen models, the authors report it is comparable at low sparsity and substantially more robust from 70% onward. The paper has not yet been peer-reviewed.