Wafer
Wafer delivers the fastest open source LLMs for enterprise through serverless and dedicated inference built for production AI workloads. Its serverless inference gives teams access to top open models with no infrastructure, no deployment overhead, and fast APIs, including GLM-5.2-Fast for low-latency inference with EAGLE speculative decoding and a per-stream throughput SLA, GLM-5.2 as a flagship model with stronger coding and reasoning capabilities, and more. Wafer’s technology uses agents that optimize inference across the stack, identifying and enhancing bottlenecks in orchestration, algorithms, serving engines, GPU kernels, and diverse hardware. It profiles the stack to see whether latency or throughput comes from scheduling, decoding, kernels, memory pressure, or hardware fit, then tries many paths and ships the measured winner. Instead of relying on a single switch or heuristic, Wafer searches model, engine, kernel, and hardware combinations.
Learn more
OpenVINO
The Intel® Distribution of OpenVINO™ toolkit is an open-source AI development toolkit that accelerates inference across Intel hardware platforms. Designed to streamline AI workflows, it allows developers to deploy optimized deep learning models for computer vision, generative AI, and large language models (LLMs). With built-in tools for model optimization, the platform ensures high throughput and lower latency, reducing model footprint without compromising accuracy. OpenVINO™ is perfect for developers looking to deploy AI across a range of environments, from edge devices to cloud servers, ensuring scalability and performance across Intel architectures.
Learn more
LocalAI
LocalAI is a free, open source, local-first AI platform designed as a drop-in replacement for the OpenAI API, allowing developers to run large language models and other AI systems entirely on their own hardware without relying on cloud services. It provides a complete AI stack for local inferencing, enabling text generation, image creation with diffusion models, audio transcription and speech synthesis, embeddings for semantic search, and multimodal capabilities such as vision analysis. It is compatible with OpenAI API specifications, allowing existing applications to integrate seamlessly by simply switching endpoints, while supporting a wide range of open source model families that can run on CPU or GPU, including consumer-grade devices. LocalAI emphasizes privacy and control by ensuring all processing happens locally, keeping data on-device and eliminating external dependencies.
Learn more
Kimi K2.7 Code
Kimi K2.7 Code is an open-source, coding-focused agentic AI model developed by Moonshot AI for long-horizon software engineering tasks. It is designed to improve coding performance, agent workflows, and real-world development assistance compared with earlier Kimi K2 versions. The model supports a 256K context window, making it useful for working with large codebases, long technical documents, and complex multi-step programming tasks. Kimi K2.7 Code is available through Kimi Code and API access, with OpenAI- and Anthropic-compatible options for easier integration into developer workflows. It is also listed on Hugging Face and supports deployment through inference engines such as vLLM, SGLang, and KTransformers. With improved agentic capabilities, long-context support, and reduced thinking-token usage compared with K2.6, Kimi K2.7 Code gives developers a flexible open-source option for AI-assisted coding.
Learn more
