Open Source Rust AI Models

Harmony is a response format developed by OpenAI for use with the gpt-oss model series. It defines a structured way for language models to produce outputs, including regular text, reasoning traces, tool calls, and structured data. By mimicking the OpenAI Responses API, Harmony provides developers with a familiar interface while enabling more advanced capabilities such as multiple output channels, instruction hierarchies, and tool namespaces. The format is essential for ensuring gpt-oss models operate correctly, as they are trained to rely on this structure for generating and organizing their responses. For users accessing gpt-oss through third-party providers like HuggingFace, Ollama, or vLLM, Harmony formatting is handled automatically, but developers building custom inference setups must implement it directly. With its flexible design, Harmony serves as the foundation for creating more interpretable, controlled, and extensible interactions with open-weight language models.

Phonon TTS is an open-source text-to-speech inference engine that generates natural-sounding speech locally on computers, mobile devices, and web browsers. Built in Rust, it operates without PyTorch or a cloud connection after downloading its models. The software provides compact 31-million and 40-million parameter models for efficient deployment. It supports English, French, German, Spanish, and Portuguese speech synthesis. Users can select predefined voices, create custom voices, or clone voices for supported applications. Its streaming architecture produces audio progressively to minimize playback delays. Hardware acceleration includes Apple Core ML, compatible Snapdragon NPUs, and GPU backends. Phonon integrates through Python, Swift, Rust, JavaScript, Android libraries, and OpenAI-compatible speech APIs.

Open-XiaoAI is an open-source framework that takes deeper control of compatible Xiaomi XiaoAI smart speakers by accessing their audio input and output paths. It extends the earlier MiGPT concept beyond cloud API responses and enables developers to build custom voice experiences directly around the speaker hardware. Demonstrations include custom wake words, Xiaozhi AI integration, MiGPT integration, Gemini Live API access, and stereo pairing. The architecture uses separate client and server components, with the client running on modified speaker firmware. Official instructions target the XiaoAI Speaker Pro LX06 and Xiaomi Smart Speaker Pro OH2P. The project is archived and no longer maintained, but it remains a flexible foundation for experimental multimodal and agent-driven smart-speaker projects.