Kimi-K3 on HuggingFace(huggingface.co)
1346 points by nateb2022 1 day ago | 532 comments
tl;dr: Moonshot AI released Kimi K3, an open-weight 2.8T-parameter MoE model (104B activated) with native multimodality and a 1M-token context window, built on new Kimi Delta Attention (KDA) and Attention Residuals architecture with MXFP4 quantization-aware training. Benchmarks show it competitive with Claude Opus 4.8, GPT-5.6, and Claude Fable 5 across reasoning, coding, agentic, and vision tasks, positioning it as the first open 3T-class frontier model. Weights are available on HuggingFace under the Kimi K3 License, with vLLM/SGLang deployment support and an OpenAI/Anthropic-compatible API.
HN Discussion:
  • Hosting costs and pricing dynamics for a 3T model will be revealing but expensive
  • Consumer hardware is poorly shaped for running large models locally
  • The real value is customization, fine-tuning, and IP sovereignty from open weights
  • License restrictions and revenue thresholds limit true openness of the release
  • Model has identity confusion claiming to be Claude, casting doubt on originality