Home / Blog / Kimi K3 Review
ENGINEERING_BLOG · 2026.07.17

Kimi K3 Review:
The 2.8-Trillion-Parameter Open-Source Model That Challenges Claude and GPT

On the night of July 16, 2026, Moonshot AI quietly added a "Kimi K3 is live" banner to the top of its API docs — no keynote, no livestream, but a 2.8-trillion-parameter model that becomes the largest open-source LLM on record. If you are an AI developer or engineering lead evaluating open-weight options, this guide covers launch context, KDA/AttnRes/Stable LatentMoE architecture, full benchmark tables, pricing vs Claude Sonnet 5 and GPT-5.5, four access paths with a six-step setup, a use-case decision matrix, the July 27 open-weights promise, citable technical data, and FAQ so you can decide before the WAIC window closes.

  • TL;DR: Kimi K3 is a 896-expert MoE (16 active), 1M-token context, native-vision model priced at $3/$15 per 1M tokens with $0.30/M cache hits — same sticker rate as Claude Sonnet 5 but five times the context. Full weights land on Hugging Face July 27, 2026.
  • Standout scores: SWE Marathon 42.0 (first), OmniDocBench 91.1 (first), Intelligence Index 57.1 (fourth globally).
  • Architecture edge: KDA cuts KV cache by 75% and boosts 1M-token decode speed 6.3×; Stable LatentMoE scales 2.5× more efficiently than Kimi K2.

SECTION 01 Open-Source LLM Pain Points: Scale, Context, and Real Coding Ability Rarely Align

By mid-2026 the open-source lane already includes strong models like DeepSeek V4 Pro and GLM-5.2, yet engineering teams still hit structural friction at deploy time:

  • Context ceilings: Most open models cap at 128K–256K tokens. Analyzing an entire repo or a long legal/research corpus still requires chunking, which breaks Agent long-term memory.
  • Benchmark vs. production gap: High SWE-bench scores do not guarantee performance on SWE Marathon — multi-hour sustained coding. Single-benchmark shopping leads to expensive surprises.
  • Hidden inference cost: MoE models activate sparsely, but million-token contexts still inflate KV cache memory on self-hosted clusters — a problem Moonshot targets with custom inference silicon trends across the industry.
  • API-first, weights-later lag: API access arrives weeks before downloadable weights, forcing hardware procurement and framework adaptation cycles.
  • Commercial comeback timing: Moonshot spent 18 months under DeepSeek pressure. K3 drops on the eve of WAIC 2026 with clear strategic intent — ARR passed $300M, a sixth funding round closed at a $31.5B pre-money valuation, API revenue exceeds 70% of total revenue, and overseas paid users grew 400% year-over-year.

One-line positioning: Kimi K3 is the largest open-source AI model by parameter count — 2.8T total, roughly 75% above DeepSeek V4 Pro (1.6T) and 2.7× Xiaomi's open model (1.02T). It ships as an 896-expert MoE (16 active per forward pass), 1M-token context, native vision, Sonnet-tier pricing with five times the context window, and full weights promised for July 27.

Moonshot held the open-model scale crown for 9 of the past 12 months. K3 targets complex coding, long-document reasoning, and knowledge work, running at max effort by default with text, image, and video inputs.

Kimi K3 core specifications
Parameter Value
Total parameters 2.8 trillion (2.8T)
Architecture stack KDA + AttnRes + Stable LatentMoE
MoE config 896 experts, 16 active per token (1.8% sparsity)
Context window 1,048,576 tokens (1M)
Vision Native multimodal (text, image, video)
API model ID kimi-k3
API pricing $3 / $15 per 1M tokens (input / output)
Open weights July 27, 2026 (Hugging Face)

SECTION 02 KDA, AttnRes, and Stable LatentMoE: Three Architecture Innovations Explained

Kimi Delta Attention (KDA) — Rethinking attention for 1M context

Standard full attention scales quadratically with sequence length; at 1M tokens, KV cache memory becomes the bottleneck. KDA is a hybrid linear attention mechanism:

  • Alternates 3 linear attention layers with 1 full attention layer — linear layers handle local sequences cheaply, full layers preserve global information flow;
  • Reduces KV cache memory by up to 75%;
  • Delivers up to 6.3× faster decode at million-token context;
  • Beats pure full-attention baselines across short context, long context, and RL scaling regimes.

Attention Residuals (AttnRes) — Fixing depth-related information loss

Standard residual connections accumulate information uniformly across depth, diluting early-layer features in deep stacks. AttnRes adds selective retrieval — the model can pull high-value representations from earlier layers directly, yielding roughly 25% training efficiency gain with less than 2% extra compute.

Stable LatentMoE — Stable training at extreme sparsity

With 896 experts and only 16 active, routing and optimization dominate. Moonshot pairs the design with:

Stable LatentMoE supporting techniques
Technique Role
Quantile Balancing Derives expert allocation from router score quantiles, eliminating heuristic hyperparameters
Per-Head Muon Per-attention-head optimization for more adaptive large-scale training
Sigmoid Tanh Unit (SiTU) Improved activation control
Gated MLA Higher attention selectivity
Overall scaling ~2.5× scaling efficiency vs Kimi K2

SECTION 03 Kimi K3 Benchmarks: Coding, Reasoning, and Vision vs Claude and GPT

Figures below are Moonshot self-reported (each model uses its own inference harness: K3 via Kimi Code, GPT via Codex, Claude via Claude Code). Independent third-party reproduction is still in progress — treat as directional, not definitive.

Kimi K3 vs frontier closed models — full benchmark table
Benchmark Kimi K3 Claude Fable 5 GPT-5.6 Sol Claude Opus 4.8 GLM-5.2
DeepSWE 67.5 70.0 73.0 59.0 46.2
Program Bench 77.8 76.8 77.6 71.9 63.7
Terminal Bench 2.1 88.3 84.6 88.8 84.6 82.7
FrontierSWE 81.2 86.6 71.3 66.7 67.3
SWE Marathon 42.0 35.0 39.0 40.0 13.0
BrowseComp 91.2 88.0 90.4 84.3
Automation Bench 30.8 29.1 29.7 27.2 12.9
GPQA-Diamond 93.5 92.6 94.1 91.0 91.2
MMMU-Pro (vision) 81.6 81.2 83.0 78.9
OmniDocBench (document understanding) 91.1 89.8 85.8 87.9
Intelligence Index v4.1 57.1 (4th place) 59.9 58.9

Reading the table: SWE Marathon stress-tests sustained multi-hour coding — K3 leads at 42.0. OmniDocBench first place (91.1) reflects vision + long-context synergy. On Artificial Analysis Intelligence Index v4.1, K3 scores 57.1 (fourth globally), trailing Claude Fable 5 (59.9) and GPT-5.6 Sol (58.9) by only 2.8 points. For Agent cost context, see our Grok 4.5 review.

SECTION 04 Kimi K3 API Pricing: Sonnet-Parity Rates, Opus-Class Benchmarks, 5× Context

Mainstream model API pricing (per 1M tokens)
Model Input Output Cache hit input Context
Kimi K3 $3.00 $15.00 $0.30 1M
Claude Sonnet 5 $3.00 (promo $2) $15.00 (promo $10) 200K
Claude Opus 4.8 $5.00 $25.00 200K
GPT-5.5 $5.00 $30.00 400K
DeepSeek V4 Pro $1.74 $3.48 $0.145 128K
Kimi K2.6 $0.95 $4.00 $0.16 256K
  • Price positioning: K3 matches Claude Sonnet 5 standard rates ($3/$15) with five times the context;
  • Cache advantage: Cache-hit input drops to $0.30/M (one-tenth standard). Moonshot reports 90%+ cache hit rates in coding Agent scenarios, slashing effective input cost;
  • vs Opus 4.8: ~60% input cost, ~40% output cost, while remaining competitive on multiple benchmarks;
  • Flat 1M pricing: No length surcharge — feeding an entire repo index in one call is economically viable.
Use-case decision matrix — which model when
Scenario Recommended model Why
Sustained multi-hour coding Kimi K3 SWE Marathon leader, longest context
Complex repo-level bug fixing Claude Fable 5 FrontierSWE lead by a wide margin
Terminal / toolchain-heavy Agents GPT-5.6 Sol Terminal Bench and Coding Agent Index leader
Ultra-long documents / multimodal docs Kimi K3 OmniDocBench first, native vision + 1M context
Cost-sensitive workloads DeepSeek V4 Pro Output at $3.48/M — far below K3
Self-hosted open weights (post 7/27) Kimi K3 Strongest open weights at 2.8T — new record

SECTION 05 How to Access Kimi K3: Four Paths and a Six-Step Integration Guide

Whether you are smoke-testing or wiring K3 into CI/CD, pick one of four entry points:

  • Method 1 — kimi.com web/app: Sign up at kimi.com (Google login supported). K3 runs at max effort by default.
  • Method 2 — Official API: OpenAI-compatible endpoint, model ID kimi-k3, API key from platform.kimi.ai.
  • Method 3 — OpenRouter: Model ID moonshotai/kimi-k3 at Moonshot official pricing with no markup.
  • Method 4 — July 27 open weights: Full weights on Hugging Face; production inference needs a 64+ accelerator super-node.
kimi_k3_api.py
from openai import OpenAI

client = OpenAI(
    api_key="your_moonshot_api_key",
    base_url="https://api.moonshot.ai/v1"
)

response = client.chat.completions.create(
    model="kimi-k3",
    messages=[{"role": "user", "content": "Analyze this codebase for security issues..."}]
)
  1. Confirm account and quota: Register at kimi.com or platform.kimi.ai. Verify API billing mode (pay-as-you-go or prepaid packages).
  2. Create an API key: Generate a key in the Moonshot developer console. Never commit it to a public repo.
  3. Set the base URL: Use https://api.moonshot.ai/v1 with the OpenAI SDK, or configure the OpenRouter endpoint if routing through a gateway.
  4. Pick the model ID: Official API uses kimi-k3; OpenRouter uses moonshotai/kimi-k3. Only max-effort mode is available today — low/high modes ship in a future update.
  5. Enable caching and long context: For coding Agents, keep system prompts and repo structure summaries stable to push cache hit rates above 90%. The 1M window has no length surcharge — feed the full codebase index in one shot.
  6. Plan self-host hardware (post 7/27): If you intend private-cloud inference, size GPU clusters early (64+ accelerator super-node), validate vLLM/SGLang adapters, and review edge-node costs in our Mac Mini M4 rent vs buy TCO analysis.

SECTION 06 July 27 Open-Weights Promise, Citable Data, and Production Takeaways

Moonshot's official announcement commits to releasing full model weights on July 27, 2026. Once downloadable, Kimi K3 becomes:

  • The largest open-weight model ever released for download;
  • The first open weights above the 2-trillion-parameter threshold;
  • A new fine-tuning baseline for the open community — trained with MXFP4 weights and MXFP8 activations, quantization-aware from design stage;
  • Expected Day-0 support in vLLM, SGLang, and transformers, with MXFP4/NVFP4 quantized variants on Hugging Face.

Timeline to watch: July 17–20 WAIC Shanghai (more announcements expected) → July 27 K3 full weight release.

  • Parameter scale: 2.8T total, 896-expert MoE (16 active) — ~75% above DeepSeek V4 Pro (1.6T).
  • Context: 1,048,576 tokens, flat pricing with no length surcharge.
  • Architecture efficiency: KDA cuts KV cache 75%, 6.3× faster decode at 1M tokens; ~2.5× scaling efficiency vs Kimi K2.
  • Commercial metrics: ARR passed $300M (June 2026), sixth-round pre-money valuation $31.5B, API revenue 70%+ of total.
  • Composite ranking: Artificial Analysis Intelligence Index v4.1 score 57.1, fourth place.
  • Self-host floor: Production inference requires 64+ accelerator super-nodes — not a laptop workload.

Re-open these sources after upstream updates to verify specs and benchmark claims:

Moonshot AI official blog — Kimi K3 launch

Kimi API Platform official documentation

Artificial Analysis — Intelligence Index v4.1 model rankings

VentureBeat — Moonshot AI Kimi K3 open-source coverage

South China Morning Post — Kimi K3 Moonshot AI open-source report

Kimi K3 is a model-selection upgrade for API users, but teams integrating Kimi Code Agents, macOS CI/CD, and 7×24 automated test pipelines still face three practical gaps: (1) weights are unavailable until July 27, stretching private-cloud procurement cycles; (2) macOS CI on VMs hits Metal and Core ML compatibility overhead; (3) a local Mac goes dark when it sleeps, breaking always-on Agent pipelines. For production environments that need zero-overhead native Apple compute, stable iOS CI/CD, and always-on AI Agent automation, MACNOX cloud physical Mac nodes are usually the better fit: 100% genuine Apple hardware, full root access, no hypervisor tax, flexible daily/weekly/monthly billing. See our Grok 4.5 Agent cost analysis, GPT-5.6 Sol Ultra multi-agent workflow breakdown, and Mac Mini M4 rent vs buy TCO comparison, or visit the pricing page.

SECTION 07 FAQ

Can I use Kimi K3 for free?

Yes on kimi.com — free accounts can try K3 at max effort. API access requires a paid key billed at $3/$15 per 1M tokens.

Can I run Kimi K3 locally today?

Not yet. Full weights arrive July 27, 2026 on Hugging Face. Production inference will need 64+ accelerators (e.g., NVIDIA H100) — 2.8T parameters are not a laptop workload.

Kimi K3 vs DeepSeek V4 Pro — how do I choose?

K3 has nearly 2× parameters (2.8T vs 1.6T), far more context (1M vs 128K), and stronger coding/reasoning benchmarks overall. DeepSeek V4 Pro output at $3.48/M still wins on pure cost sensitivity.

Is the 1M-token context window actually useful?

Especially for full-repo analysis, long research or legal documents, and multi-turn Agent memory. Flat pricing with no length surcharge makes using the full window economically viable.

When will low/high effort modes ship?

Moonshot says low and high effort modes will arrive in a future update. Only max-effort mode is available at launch.

How trustworthy are the benchmark numbers?

They are Moonshot self-reported with different inference harnesses per vendor. Independent reproduction is ongoing. Treat as directional guidance and run your own A/B tests on critical workloads.