AI · 2h ago
Bonsai 27B: First 27-Billion-Parameter LLM Runs on a Phone
Prism ML released Bonsai 27B, a 1-bit quantized large language model with 27 billion parameters that fits on a smartphone. The model achieves performance comparable to larger models while requiring minimal memory and compute. This breakthrough could enable advanced AI capabilities on mobile devices without cloud dependency.
Meridian48 take
Running a 27B-parameter model on a phone is impressive, but 1-bit quantization often sacrifices accuracy, so real-world performance may not match full-precision models.
Read the full reporting
Bonsai 27B (1-bit LLM): The First 27B-Class Model to Run on a Phone →
Hacker News
llmmobile-ai