Wafer
Wafer delivers the fastest open source LLMs for enterprise through serverless and dedicated inference built for production AI workloads. Its serverless inference gives teams access to top open models with no infrastructure, no deployment overhead, and fast APIs, including GLM-5.2-Fast for low-latency inference with EAGLE speculative decoding and a per-stream throughput SLA, GLM-5.2 as a flagship model with stronger coding and reasoning capabilities, and more. Wafer’s technology uses agents that optimize inference across the stack, identifying and enhancing bottlenecks in orchestration, algorithms, serving engines, GPU kernels, and diverse hardware. It profiles the stack to see whether latency or throughput comes from scheduling, decoding, kernels, memory pressure, or hardware fit, then tries many paths and ships the measured winner. Instead of relying on a single switch or heuristic, Wafer searches model, engine, kernel, and hardware combinations.
Learn more
NVIDIA TensorRT
NVIDIA TensorRT is an ecosystem of APIs for high-performance deep learning inference, encompassing an inference runtime and model optimizations that deliver low latency and high throughput for production applications. Built on the CUDA parallel programming model, TensorRT optimizes neural network models trained on all major frameworks, calibrating them for lower precision with high accuracy, and deploying them across hyperscale data centers, workstations, laptops, and edge devices. It employs techniques such as quantization, layer and tensor fusion, and kernel tuning on all types of NVIDIA GPUs, from edge devices to PCs to data centers. The ecosystem includes TensorRT-LLM, an open source library that accelerates and optimizes inference performance of recent large language models on the NVIDIA AI platform, enabling developers to experiment with new LLMs for high performance and quick customization through a simplified Python API.
Learn more
OptoCompiler
Synopsys OptoCompiler is the industry's first unified electronic and photonic design platform, combining mature and dedicated photonic technology with Synopsys' industry-proven electronic design tools to enable engineers to produce and verify complex photonic integrated circuit designs quickly and accurately. By providing schematic-driven layout and advanced photonic layout synthesis in a single platform, OptoCompiler bridges the gap between photonic experts and integrated circuit designers to make photonic design accessible, fast, and flexible. OptoCompiler supports electronic-photonic co-design to ensure scalable design processes and offers comprehensive features for hierarchical design, enabling multiple designers to work closely together to shorten product development cycle times. The platform includes dedicated native photonic simulators, in conjunction with industry-standard electrical simulators, for accurate simulation results that account for statistical variations.
Learn more
vLLM
vLLM is a high-performance library designed to facilitate efficient inference and serving of Large Language Models (LLMs). Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. It offers state-of-the-art serving throughput by efficiently managing attention key and value memory through its PagedAttention mechanism. It supports continuous batching of incoming requests and utilizes optimized CUDA kernels, including integration with FlashAttention and FlashInfer, to enhance model execution speed. Additionally, vLLM provides quantization support for GPTQ, AWQ, INT4, INT8, and FP8, as well as speculative decoding capabilities. Users benefit from seamless integration with popular Hugging Face models, support for various decoding algorithms such as parallel sampling and beam search, and compatibility with NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs, and more.
Learn more
