MuMicrosoft
|
||||||
Related Products
|
||||||
About
Mu is a 330-million-parameter encoder–decoder language model designed to power the agent in Windows settings by mapping natural-language queries to Settings function calls, running fully on-device via NPUs at over 100 tokens per second while maintaining high accuracy. Drawing on Phi Silica optimizations, Mu’s encoder–decoder architecture reuses a fixed-length latent representation to cut computation and memory overhead, yielding 47 percent lower first-token latency and 4.7× higher decoding speed on Qualcomm Hexagon NPUs compared to similar decoder-only models. Hardware-aware tuning, including a 2/3–1/3 encoder–decoder parameter split, weight sharing between input and output embeddings, Dual LayerNorm, rotary positional embeddings, and grouped-query attention, enables fast inference at over 200 tokens per second on devices like Surface Laptop 7 and sub-500 ms response times for settings queries.
|
About
distil labs optimizes AI workloads by replacing expensive frontier-model calls with custom small language models tuned to a specific task while maintaining the required quality bar. It observes real production traffic, captures traces from existing LLM requests, and automatically builds an evaluation set to understand how the workload actually behaves. It then generates and validates synthetic training data, matches the data distribution to the target workload, performs supervised fine-tuning and reinforcement learning, quantizes the model, and deploys an optimized endpoint. Results are automatically evaluated against the current model on accuracy, latency, and efficiency before teams choose to scale traffic. The resulting OpenAI-compatible endpoint combines a specialized SLM, prompt optimization, caching, and tuned serving for the use case.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Developers seeking a solution to navigate and configure system settings through natural language
|
Audience
AI product, engineering, and machine learning teams in need of a tool to optimize production LLM workloads with task-specific small language models
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$0.04 per 1M tokens
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationMicrosoft
Founded: 1975
United States
blogs.windows.com/windowsexperience/2025/06/23/introducing-mu-language-model-and-how-it-enabled-the-agent-in-windows-settings/
|
Company Informationdistil labs
Founded: 2024
Germany
www.distillabs.ai/
|
|||||
Alternatives |
AlternativesNo Alternatives
|
|||||
|
|
||||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
GPT-5.4 nano
Gemini 2.0 Flash-Lite
|
||||||
|
|
|