AWS NeuronAmazon Web Services
|
||||||
Related Products
|
||||||
About
It supports high-performance training on AWS Trainium-based Amazon Elastic Compute Cloud (Amazon EC2) Trn1 instances. For model deployment, it supports high-performance and low-latency inference on AWS Inferentia-based Amazon EC2 Inf1 instances and AWS Inferentia2-based Amazon EC2 Inf2 instances. With Neuron, you can use popular frameworks, such as TensorFlow and PyTorch, and optimally train and deploy machine learning (ML) models on Amazon EC2 Trn1, Inf1, and Inf2 instances with minimal code changes and without tie-in to vendor-specific solutions. AWS Neuron SDK, which supports Inferentia and Trainium accelerators, is natively integrated with PyTorch and TensorFlow. This integration ensures that you can continue using your existing workflows in these popular frameworks and get started with only a few lines of code changes. For distributed model training, the Neuron SDK supports libraries, such as Megatron-LM and PyTorch Fully Sharded Data Parallel (FSDP).
|
About
Xinity is open-source, OpenAI-compatible LLM inference software that lets European enterprises run generative AI entirely on their own servers. The platform installs on existing hardware and exposes an OpenAI-compatible API, so existing applications migrate by changing one base URL. No cloud dependency, no data egress, no exposure to the US CLOUD Act. The core engine is open source under Apache 2.0 and supports open-weight models, including European sovereign models, with automatic model routing, audit trails on every inference request, role-based access control, and multi-node orchestration. Xinity is built in Vienna, Austria for regulated industries such as finance, healthcare, legal, public sector, and media, including fully air-gapped environments, and is designed for GDPR and EU AI Act requirements.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Supported
Cloud
Not Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Organizations in need of an SDK solution with a compiler, runtime, and profiling tools that unlocks high-performance and cost-effective deep learning acceleration
|
Audience
European enterprises in regulated industries (finance, healthcare, legal, public sector, media) and IT teams that need to run LLM inference on their own infrastructure
|
|||||
Support
Phone Support
Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
No information available.
Free Version
Supported
Free Trial
Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Supported
|
|||||
Company InformationAmazon Web Services
Founded: 2006
United States
aws.amazon.com/machine-learning/neuron/
|
Company InformationXinity
Founded: 2025
Austria
xinity.ai
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
AWS Deep Learning AMIs
Supported
AWS Deep Learning Containers
Supported
AWS Trainium
Supported
Amazon EC2 Capacity Blocks for ML
Supported
Amazon EC2 G5 Instances
Supported
Amazon EC2 Inf1 Instances
Supported
Amazon EC2 P4 Instances
Supported
Amazon EC2 P5 Instances
Supported
Amazon EC2 Trn1 Instances
Supported
Amazon EC2 Trn2 Instances
Supported
|
Integrations
AWS Deep Learning AMIs
Not Supported
AWS Deep Learning Containers
Not Supported
AWS Trainium
Not Supported
Amazon EC2 Capacity Blocks for ML
Not Supported
Amazon EC2 G5 Instances
Not Supported
Amazon EC2 Inf1 Instances
Not Supported
Amazon EC2 P4 Instances
Not Supported
Amazon EC2 P5 Instances
Not Supported
Amazon EC2 Trn1 Instances
Not Supported
Amazon EC2 Trn2 Instances
Not Supported
|
|||||
|
|
|