As of Sep 26, a community post claimed the Tauon optimizer outperforms Muon on GPT-Mini.
Timeline · newest first
- Unconfirmed
Tauon optimizer claimed to outperform Muon on GPT-Mini
Not verified by an official source as of Sep 26, 2026 (source: reddit.com).
A Reddit post introduces Tauon, a new optimizer claimed to outperform Muon on GPT-Mini with lower loss and about 8.5% faster step time.
Source: r/MachineLearning
Related stories