Today, we are introducing Kimi K3 — our most capable model. Kimi K3 is a 2.8T-parameter model built on our Kimi Delta Attention and Attention Residuals, with native vision capabilities and a 1-million-token context window. It is the world's first open 3T-class model, designed for frontier intelligence across long-horizon coding, knowledge work, and reasoning.
FLOPs2.0001e+25
Notes: Based on peer models such as Kimi K2.6 and DeepSeek V4 Pro, plausibly was trained on roughly 30T tokens (likely between 15T and 60T). Using the heuristic that C = 6ND, 30T pretraining tokens would imply ~1.9e25 FLOP. This is a somewhat uncertain estimate (more uncertain than estimates based on disclosed active params and token counts, but comparable to estimates based on disclosed GPU-hours). K3 was likely pretrained on over 1e25 FLOP. Speculatively, K3's relatively large size compared to other Chinese models may have reduced the training token budget vs smaller models.
Training Code AccessibilityKimi K3 license requires that if K3 is used for a product with >100M MAU or >$20M monthly revenue, that the licensee enter a separate agreement with Moonshot. Therefore, the license does not grant free commercial use for all users, though commercial use is free for smaller companies. https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE
Parameters2800000000000
Notes: 104 billion active parameters