Machine Learning Intermediate
Run Bonsai 27B on Your Phone: 1-Bit Local AI
Run the first 27B-class model on a phone: MLX, llama.cpp, tool calls, and the memory math.
10 min read·Kodetra Technologies
TodayHow-to content for builders, indie hackers, and AI engineers. Less theory, more shipped code.
Machine Learning Run the first 27B-class model on a phone: MLX, llama.cpp, tool calls, and the memory math.
Tutorials Compile llama.cpp with Vulkan in Termux and run a quantized LLM on your Android GPU, no root.