ended7월 25일· 1 sources
MoE Capacity Factor: Why Mixture-of-Experts Drops Your Tokens
Why it matters
Your Mixture-of-Experts fine-tune looks clean in eval and degrades in production, and the degradation tracks concurrency rather than input difficulty. Nothing throws. Logits look normal. The usual sus...
1
Sources
+0
24h
—
Growth
7d
Active