Kimi K3's 896-Expert MoE Is a Distributed Scheduling Problem-Not Just a Model

Kimi K3 is a Mixture-of-Experts model with 896 experts, of which 16 are activated per token. The headline benefit is efficiency: you get 2.8T parameters of capacity but only pay the compute cost of 16...