Bonsai 27BPrismML
|
||||||
Related Products
|
||||||
About
Bonsai 27B is the new multimodal flagship of the Bonsai family and the first 27B-class model to run on a phone. Based on Qwen3.6 27B, it brings a new capability tier to local devices: multi-step reasoning, structured tool calls, vision tasks, and computer-use agentic loops that stay coherent across many steps. Bonsai 27B comes in two variants. Ternary Bonsai 27B uses ternary weights with FP16 group-wise scaling, giving 1.71 effective bits per weight and a 5.9 GB footprint for the quality-oriented laptop-class version. 1-bit Bonsai 27B uses binary weights with the same group-wise scaling, giving 1.125 effective bits per weight and a 3.9 GB footprint that fits within the memory budget of an iPhone 17 Pro. Both variants run end-to-end across the language network, embeddings, attention, MLPs, and LM head with no higher-precision escape hatches. They are multimodal, with a compact 4-bit vision tower, so on-device workflows can understand screenshots, documents, and camera input.
|
About
Kluster.ai is a developer-centric AI cloud platform designed to deploy, scale, and fine-tune large language models (LLMs) with speed and efficiency. Built for developers by developers, it offers Adaptive Inference, a flexible and scalable service that adjusts seamlessly to workload demands, ensuring high-performance processing and consistent turnaround times. Adaptive Inference provides three distinct processing options: real-time inference for ultra-low latency needs, asynchronous inference for cost-effective handling of flexible timing tasks, and batch inference for efficient processing of high-volume, bulk tasks. It supports a range of open-weight, cutting-edge multimodal models for chat, vision, code, and more, including Meta's Llama 4 Maverick and Scout, Qwen3-235B-A22B, DeepSeek-R1, and Gemma 3 . Kluster.ai's OpenAI-compatible API allows developers to integrate these models into their applications seamlessly.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Mobile AI developers who need a local multimodal model for private on-device reasoning, tool use, vision, and agentic workflows
|
Audience
Developers and AI engineers requiring a scalable, cost-effective tool to deploy, scale, and fine-tune large language models
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$0.15per input
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationPrismML
Founded: 2026
United States
prismml.com/news/bonsai-27b
|
Company Informationkluster.ai
Founded: 2024
United States
www.kluster.ai/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
DeepSeek R1
DeepSeek-V3
Gemma 3
Gemma 4
LLM Gateway
Llama
Llama 4 Maverick
Llama 4 Scout
Mistral NeMo
OpenAI
|
Integrations
DeepSeek R1
DeepSeek-V3
Gemma 3
Gemma 4
LLM Gateway
Llama
Llama 4 Maverick
Llama 4 Scout
Mistral NeMo
OpenAI
|
|||||
|
|
|