Skip to content
Self-Host Kimi K3 Open Weights With vLLM — ContentBuffer guide

Self-Host Kimi K3 Open Weights With vLLM

K
Kodetra Technologies··9 min read Advanced

Summary

Run Moonshot's 2.8T open-weight model on your own GPUs with vLLM and MXFP4.

Moonshot just open-sourced a 2.8-trillion-parameter model

As of July 27, 2026, the full weights for Kimi K3 are live on Hugging Face under an Apache 2.0 license. That makes it the first open-weight model to cross the three-trillion-parameter class, and the first you can legally run end to end on hardware you control. No rate limits, no data leaving your VPC, no vendor deciding tomorrow that your use case violates a policy.

Keep reading — it's free

Enter your email to keep reading — plus the best of AI & tech, daily. Free, forever.

Also get
or

Already a member? Sign in

Comments

Subscribe to join the conversation...

Be the first to comment