Audience
Individuals wanting an advanced Machine Learning solution
About ONNX
ONNX defines a common set of operators - the building blocks of machine learning and deep learning models - and a common file format to enable AI developers to use models with a variety of frameworks, tools, runtimes, and compilers. Develop in your preferred framework without worrying about downstream inferencing implications. ONNX enables you to use your preferred framework with your chosen inference engine. ONNX makes it easier to access hardware optimizations. Use ONNX-compatible runtimes and libraries designed to maximize performance across hardware. Our active community thrives under our open governance structure, which provides transparency and inclusion. We encourage you to engage and contribute.
Popular Alternatives
Xilinx
The Xilinx’s AI development platform for AI inference on Xilinx hardware platforms consists of optimized IP, tools, libraries, models, and example designs. It is designed with high efficiency and ease-of-use in mind, unleashing the full potential of AI acceleration on Xilinx FPGA and ACAP. Supports mainstream frameworks and the latest models capable of diverse deep learning tasks. Provides a comprehensive set of pre-optimized models that are ready to deploy on Xilinx devices. You can find the closest model and start re-training for your applications! Provides a powerful open source quantizer that supports pruned and unpruned model quantization, calibration, and fine tuning. The AI profiler provides layer by layer analysis to help with bottlenecks. The AI library offers open source high-level C++ and Python APIs for maximum portability from edge to cloud. Efficient and scalable IP cores can be customized to meet your needs of many different applications.
Learn more
HPE Ezmeral ML OPS
HPE Ezmeral ML Ops provides pre-packaged tools to operationalize machine learning workflows at every stage of the ML lifecycle, from pilot to production, giving you DevOps-like speed and agility. Quickly spin-up environments with your preferred data science tools to explore a variety of enterprise data sources and simultaneously experiment with multiple machine learning or deep learning frameworks to pick the best fit model for the business problems you need to address. Self-service, on-demand environments for development and test or production workloads. Highly performant training environments—with separation of compute and storage—that securely access shared enterprise data sources in on-premises or cloud-based storage. HPE Ezmeral ML Ops enables source control with out of the box integration tools such as GitHub. Store multiple models (multiple versions with metadata) for various runtime engines in the model registry.
Learn more
NVIDIA Triton Inference Server
NVIDIA Triton™ inference server delivers fast and scalable AI in production. Open-source inference serving software, Triton inference server streamlines AI inference by enabling teams deploy trained AI models from any framework (TensorFlow, NVIDIA TensorRT®, PyTorch, ONNX, XGBoost, Python, custom and more on any GPU- or CPU-based infrastructure (cloud, data center, or edge). Triton runs models concurrently on GPUs to maximize throughput and utilization, supports x86 and ARM CPU-based inferencing, and offers features like dynamic batching, model analyzer, model ensemble, and audio streaming. Triton helps developers deliver high-performance inference aTriton integrates with Kubernetes for orchestration and scaling, exports Prometheus metrics for monitoring, supports live model updates, and can be used in all major public cloud machine learning (ML) and managed Kubernetes platforms. Triton helps standardize model deployment in production.
Learn more
OctoAI
OctoAI is world-class compute infrastructure for tuning and running models that wow your users.
Fast, efficient model endpoints and the freedom to run any model. Leverage OctoAI’s accelerated models or bring your own from anywhere. Create ergonomic model endpoints in minutes, with only a few lines of code. Customize your model to fit any use case that serves your users. Go from zero to millions of users, never worrying about hardware, speed, or cost overruns.
Tap into our curated list of best-in-class open-source foundation models that we’ve made faster and cheaper to run using our deep experience in machine learning compilation, acceleration techniques, and proprietary model-hardware performance technology.
OctoAI automatically selects the optimal hardware target, applies the latest optimization technologies, and always keeps your running models in an optimal manner.
Learn more
Integrations
Company Information
ONNX
onnx.ai/
Videos and Screen Captures
You Might Also Like
Our Free Plans just got better! | Auth0 by Okta
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your secuirty. Auth0 now, thank yourself later.
Product Details
Platforms Supported
SaaS
Training
Documentation
Videos
Support
Online