Business Software for ONNX

The Intel® Distribution of OpenVINO™ toolkit is an open-source AI development toolkit that accelerates inference across Intel hardware platforms. Designed to streamline AI workflows, it allows developers to deploy optimized deep learning models for computer vision, generative AI, and large language models (LLMs). With built-in tools for model optimization, the platform ensures high throughput and lower latency, reducing model footprint without compromising accuracy. OpenVINO™ is perfect for developers looking to deploy AI across a range of environments, from edge devices to cloud servers, ensuring scalability and performance across Intel architectures.

The workflow automation platform for complex, mission-critical data and ML processes at scale. Flyte makes it easy to create concurrent, scalable, and maintainable workflows for machine learning and data processing. Flyte is used in production at Lyft, Spotify, Freenome, and others. At Lyft, Flyte has been serving production model training and data processing for over four years, becoming the de-facto platform for teams like pricing, locations, ETA, mapping, autonomous, and more. In fact, Flyte manages over 10,000 unique workflows at Lyft, totaling over 1,000,000 executions every month, 20 million tasks, and 40 million containers. Flyte has been battle-tested at Lyft, Spotify, Freenome, and others. It is entirely open-source with an Apache 2.0 license under the Linux Foundation with a cross-industry overseeing committee. Configuring machine learning and data workflows can get complex and error-prone with YAML.

Small-footprint, edge-optimized SQL database engine with built-in AI. Azure SQL Edge, a robust Internet of Things (IoT) database for edge computing, combines capabilities such as data streaming and time series with built-in machine learning and graph features. Extend the industry-leading Microsoft SQL engine to edge devices for consistent performance and security across your entire data estate, from cloud to edge. Develop your applications once and deploy them anywhere across the edge, your on-premises data center, or Azure. Built-in data streaming and time series, with in-database machine learning and graph features for low-latency analytics. Data processing at the edge for online, offline, or hybrid environments to overcome latency and bandwidth constraints. Deploy and update from the Azure portal or your enterprise portal for consistent security and turnkey management. Detect anomalies and apply business logic at the edge using the built-in machine learning capabilities.

ML.NET is a free, open source, and cross-platform machine learning framework designed for .NET developers to build custom machine learning models using C# or F# without leaving the .NET ecosystem. It supports various machine learning tasks, including classification, regression, clustering, anomaly detection, and recommendation systems. ML.NET integrates with other popular ML frameworks like TensorFlow and ONNX, enabling additional scenarios such as image classification and object detection. It offers tools like Model Builder and the ML.NET CLI, which utilize Automated Machine Learning (AutoML) to simplify the process of building, training, and deploying high-quality models. These tools automatically explore different algorithms and settings to find the best-performing model for a given scenario.

Our high-throughput storage systems can serve millions of small, random files to GPU-based training servers accelerating overall training times. We offer high-bandwidth, low-latency networks for connecting distributed training servers as well as transporting data between storage and servers. Other cloud providers squeeze you with extra fees and charges to get your data out of their storage clouds, and those can add up fast. We consider ourselves an extension of your team. We work with you to set up scheduling services, help with best practices, and provide superior support. Workflows can vary from company to company. Cirrascale works to ensure you get the right solution for your needs to get you the best results. Cirrascale is the only provider that works with you to tailor your cloud instances to increase performance, remove bottlenecks, and optimize your workflow. Cloud-based solutions to accelerate your training, simulation, and re-simulation time.

Groq is on a mission to set the standard for GenAI inference speed, helping real-time AI applications come to life today. An LPU inference engine, with LPU standing for Language Processing Unit, is a new type of end-to-end processing unit system that provides the fastest inference for computationally intensive applications with a sequential component, such as AI language applications (LLMs). The LPU is designed to overcome the two LLM bottlenecks, compute density and memory bandwidth. An LPU has greater computing capacity than a GPU and CPU in regards to LLMs. This reduces the amount of time per word calculated, allowing sequences of text to be generated much faster. Additionally, eliminating external memory bottlenecks enables the LPU inference engine to deliver orders of magnitude better performance on LLMs compared to GPUs. Groq supports standard machine learning frameworks such as PyTorch, TensorFlow, and ONNX for inference.

The Intel Open Edge Platform simplifies the development, deployment, and scaling of AI and edge computing solutions on standard hardware with cloud-like efficiency. It provides a curated set of components and workflows that accelerate AI model creation, optimization, and application development. From vision models to generative AI and large language models (LLM), the platform offers tools to streamline model training and inference. By integrating Intel’s OpenVINO toolkit, it ensures enhanced performance on Intel CPUs, GPUs, and VPUs, allowing organizations to bring AI applications to the edge with ease.

Optimized AI is ready to launch on-device and allows you to deploy your AI models on actual devices. With LaunchX automation, you can simplify conversion and effortlessly measure performance on target devices. Customize the AI platform to meet your hardware specifications. Enable seamless AI model deployment with a tailored software stack. Nota’s AI technology empowers intelligent transportation systems, facial recognition, and security and surveillance. The company’s solutions include a driver monitoring system, driver authentication, and smart access control system. Nota‘s current projects cover a wide range of industries including construction, mobility, security, smart home, and healthcare. Nota’s partnership with top-tier global market leaders including Nvidia, Intel, and ARM has helped accelerate its entry into the global market.

SiMa offers a software-centric, embedded edge machine learning system-on-chip (MLSoC) platform that delivers high-performance, low-power AI solutions for various applications. The MLSoC integrates multiple modalities, including text, image, audio, video, and haptic inputs, performing complex ML inference and presenting outputs in any modality. It supports a wide range of frameworks (e.g., TensorFlow, PyTorch, ONNX) and can compile over 250 models, providing customers with an effortless experience and world-class performance-per-watt results. Complementing the hardware, SiMa.ai is designed for complete ML stack application development. It supports any ML workflow customers plan to deploy on the edge without compromising performance and ease of use. Palette's integrated ML compiler accepts any model from any neural network framework.

The Qualcomm Cloud AI SDK is a comprehensive software suite designed to optimize trained deep learning models for high-performance inference on Qualcomm Cloud AI 100 accelerators. It supports a wide range of AI frameworks, including TensorFlow, PyTorch, and ONNX, enabling developers to compile, optimize, and execute models efficiently. The SDK provides tools for model onboarding, tuning, and deployment, facilitating end-to-end workflows from model preparation to production deployment. Additionally, it offers resources such as model recipes, tutorials, and code samples to assist developers in accelerating AI development. It ensures seamless integration with existing systems, allowing for scalable and efficient AI inference in cloud environments. By leveraging the Cloud AI SDK, developers can achieve enhanced performance and efficiency in their AI applications.

The Qualcomm AI Hub is a resource portal for developers aiming to build and deploy AI applications optimized for Qualcomm chipsets. With a library of pre-trained models, development tools, and platform-specific SDKs, it enables high-performance, low-power AI processing across smartphones, wearables, and edge devices.