Reported
Prime Intellect released Prime Mega MoE, a backward pass for DeepSeek's fused Mega MoE kernel that makes the kernel trainable, per MarkTechPost. The company reports it speeds Qwen3 MoE training steps by up to 34% in prime-rl.
Source: MarkTechPost