Audience
Enterprises requiring a solution for deploying AI inference workloads across multi-cloud environments without the complexity of managing underlying infrastructure
About NVIDIA DGX Cloud Serverless Inference
NVIDIA DGX Cloud Serverless Inference is a high-performance, serverless AI inference solution that accelerates AI innovation with auto-scaling, cost-efficient GPU utilization, multi-cloud flexibility, and seamless scalability. With NVIDIA DGX Cloud Serverless Inference, you can scale down to zero instances during periods of inactivity to optimize resource utilization and reduce costs. There's no extra cost for cold-boot start times, and the system is optimized to minimize them. NVIDIA DGX Cloud Serverless Inference is powered by NVIDIA Cloud Functions (NVCF), which offers robust observability features. It allows you to integrate your preferred monitoring tools, such as Splunk, for comprehensive insights into your AI workloads. NVCF offers flexible deployment options for NIM microservices while allowing you to bring your own containers, models, and Helm charts.
Other Popular Alternatives & Related Software
Verda
Verda is a frontier AI cloud platform delivering premium GPU servers, clusters, and model inference services powered by NVIDIA®. Built for speed, scalability, and simplicity, Verda enables teams to deploy AI workloads in minutes with pay-as-you-go pricing. The platform offers on-demand GPU instances, custom-managed clusters, and serverless inference with zero setup. Verda provides instant access to high-performance NVIDIA Blackwell GPUs, including B200 and GB300 configurations. All infrastructure runs on 100% renewable energy, supporting sustainable AI development. Developers can start, stop, or scale resources instantly through an intuitive dashboard or API. Verda combines dedicated hardware, expert support, and enterprise-grade security to deliver a seamless AI cloud experience.
Learn more
NVIDIA DGX Cloud Lepton
NVIDIA DGX Cloud Lepton is an AI platform that connects developers to a global network of GPU compute across multiple cloud providers through a single platform. It offers a unified experience to discover and utilize GPU resources, along with integrated AI services to streamline the deployment lifecycle across multiple clouds. Developers can start building with instant access to NVIDIA’s accelerated APIs, including serverless endpoints, prebuilt NVIDIA Blueprints, and GPU-backed compute. When it’s time to scale, DGX Cloud Lepton powers seamless customization and deployment across a global network of GPU cloud providers. It enables frictionless deployment across any GPU cloud, allowing AI applications to be deployed across multi-cloud and hybrid environments with minimal operational burden, leveraging integrated services for inference, testing, and training workloads.
Learn more
Radiant
Radiant is a fully integrated AI infrastructure platform designed to deliver end-to-end capabilities for building and scaling AI systems. It combines compute, software, energy, and capital into a unified ecosystem, enabling organizations to move from concept to deployment efficiently. Radiant’s AI Cloud includes NVIDIA-accelerated computing along with MLOps tools such as inference, fine-tuning, model registry, and serverless Kubernetes. Its proprietary software platform supports intelligent scheduling, automated node management, and secure multi-tenancy for large-scale operations. With infrastructure designed to scale from thousands to over 100,000 GPUs, Radiant ensures consistent performance and operational control. The platform also integrates energy solutions through its powered-land portfolio, optimizing costs and sustainability. Backed by significant capital resources, Radiant can support large-scale AI initiatives globally.
Learn more
NVIDIA Triton Inference Server
NVIDIA Triton™ inference server delivers fast and scalable AI in production. Open-source inference serving software, Triton inference server streamlines AI inference by enabling teams deploy trained AI models from any framework (TensorFlow, NVIDIA TensorRT®, PyTorch, ONNX, XGBoost, Python, custom and more on any GPU- or CPU-based infrastructure (cloud, data center, or edge). Triton runs models concurrently on GPUs to maximize throughput and utilization, supports x86 and ARM CPU-based inferencing, and offers features like dynamic batching, model analyzer, model ensemble, and audio streaming. Triton helps developers deliver high-performance inference aTriton integrates with Kubernetes for orchestration and scaling, exports Prometheus metrics for monitoring, supports live model updates, and can be used in all major public cloud machine learning (ML) and managed Kubernetes platforms. Triton helps standardize model deployment in production.
Learn more
Company Information
NVIDIA
Founded: 1993
United States
developer.nvidia.com/dgx-cloud/serverless-inference
Videos and Screen Captures
Other Useful Business Software
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Product Details
Platforms Supported
Cloud
Training
Documentation
Live Online
Webinars
In Person
Videos
Support
Phone Support
Online
