Tutorials Advanced
Self-Host Kimi K3 Open Weights With vLLM
Run Moonshot's 2.8T open-weight model on your own GPUs with vLLM and MXFP4.
9 min read·Kodetra Technologies
TodayHow-to content for builders, indie hackers, and AI engineers. Less theory, more shipped code.
Tutorials Run Moonshot's 2.8T open-weight model on your own GPUs with vLLM and MXFP4.
Machine Learning Run the first 27B-class model on a phone: MLX, llama.cpp, tool calls, and the memory math.
Tutorials Compile llama.cpp with Vulkan in Termux and run a quantized LLM on your Android GPU, no root.