What happened?
On 16 July 2026, Moonshot AI introduced Kimi K3: a natively multimodal mixture-of-experts model with 2.8 trillion total parameters, a 1M-token context window, and an explicit product bet on long-horizon coding, knowledge work, and agentic tool use. Full weights followed on 27 July. Moonshot positions it as the first open model in the ~3T class.
The architecture is not "just scale." K3 stacks Kimi Delta Attention (KDA): a hybrid linear-attention design interleaved with global gated MLA, with Attention Residuals (AttnRes) so deeper layers can selectively pull earlier residual state instead of drowning in uniform skip paths. On the expert side it runs Stable LatentMoE: 16 of 896 experts active per token (~1.8% activation), with tokens compressed into a latent before cross-GPU routing and quantile balancing instead of the usual bias-nudge load-balancing tricks. Moonshot claims roughly 2.5× better scaling efficiency versus Kimi K2 from the structural stack plus training recipe.
The company is unusually candid on the leaderboard story. Overall, K3 still trails Claude Fable 5 and GPT-5.6 Sol. On its own tables it is competitive or ahead on several coding and agentic suites (Program Bench, Terminal Bench 2.1, SWE Marathon, BrowseComp, Automation Bench) and sits near the closed frontier on independent indices. Official list pricing for the API: $3 / MTok cache-miss input, $0.30 cache-hit, $15 output, with Moonshot claiming >90% cache hit rates on coding workloads via Mooncake disaggregated inference. Deployment guidance is blunt: 64+ accelerators in a high-bandwidth supernode if you want serious self-host throughput.
