Mirai

NVIDIA TensorRT is an ecosystem of APIs for high-performance deep learning inference, encompassing an inference runtime and model optimizations that deliver low latency and high throughput for production applications. Built on the CUDA parallel programming model, TensorRT optimizes neural network models trained on all major frameworks, calibrating them for lower precision with high accuracy, and deploying them across hyperscale data centers, workstations, laptops, and edge devices. It employs techniques such as quantization, layer and tensor fusion, and kernel tuning on all types of NVIDIA GPUs, from edge devices to PCs to data centers. The ecosystem includes TensorRT-LLM, an open source library that accelerates and optimizes inference performance of recent large language models on the NVIDIA AI platform, enabling developers to experiment with new LLMs for high performance and quick customization through a simplified Python API.

Zyphra is an artificial intelligence company based in Palo Alto with a growing presence in Montreal and London. We’re building MaiaOS, a multimodal agent system combining advanced research in next-gen neural network architectures (SSM hybrids), long-term memory & reinforcement learning. We believe the future of AGI will involve a combination of cloud and on-device deployment strategies with an increasing shift toward local inference. MaiaOS is built around a deployment framework that maximizes inference efficiency for real-time intelligence. Our AI & product teams come from leading organizations and institutions including Google DeepMind, Anthropic, StabilityAI, Qualcomm, Neuralink, Nvidia, and Apple. We have deep expertise across AI models, learning algorithms, and systems/infrastructure with a focus on inference efficiency and AI silicon performance. Zyphra's team is committed to democratizing advanced AI systems.