+
+

Related Products

  • RunPod
    205 Ratings
    Visit Website
  • Google Cloud Run
    312 Ratings
    Visit Website
  • Site24x7
    858 Ratings
    Visit Website
  • JS7 JobScheduler
    1 Rating
    Visit Website
  • Chainguard
    46 Ratings
    Visit Website
  • Convesio
    53 Ratings
    Visit Website
  • LabWare LIMS
    113 Ratings
    Visit Website
  • JOpt.TourOptimizer
    8 Ratings
    Visit Website
  • Runn
    34 Ratings
    Visit Website
  • SDS Manager
    4 Ratings
    Visit Website

About

NVIDIA Cloud Functions (NVCF) is a serverless API designed to deploy and manage AI workloads on GPUs, providing security, scalability, and reliability. It supports HTTP polling, HTTP streaming, and gRPC protocols for accessing workloads. Cloud Functions is primarily suited for shorter-running, preemptable workloads such as inferencing and fine-tuning. It supports two function types: "Container" and "Helm Chart", allowing users to define functions based on their specific requirements. Workloads are ephemeral and preemptable, so users should ensure they save their work appropriately. Models, containers, helm charts, and additional resources are hosted and pulled from the NGC Private Registry. To get started, users can follow the functions quickstart guide, which provides an end-to-end workflow for creating and deploying a container-based function using the fastapi_echo_sample container.

About

NVIDIA DGX Cloud Serverless Inference is a high-performance, serverless AI inference solution that accelerates AI innovation with auto-scaling, cost-efficient GPU utilization, multi-cloud flexibility, and seamless scalability. With NVIDIA DGX Cloud Serverless Inference, you can scale down to zero instances during periods of inactivity to optimize resource utilization and reduce costs. There's no extra cost for cold-boot start times, and the system is optimized to minimize them. NVIDIA DGX Cloud Serverless Inference is powered by NVIDIA Cloud Functions (NVCF), which offers robust observability features. It allows you to integrate your preferred monitoring tools, such as Splunk, for comprehensive insights into your AI workloads. NVCF offers flexible deployment options for NIM microservices while allowing you to bring your own containers, models, and Helm charts.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers looking for a solution to deploy and manage AI workloads on GPUs

Audience

Enterprises requiring a solution for deploying AI inference workloads across multi-cloud environments without the complexity of managing underlying infrastructure

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

NVIDIA
Founded: 1993
United States
docs.nvidia.com/cloud-functions/index.html

Company Information

NVIDIA
Founded: 1993
United States
developer.nvidia.com/dgx-cloud/serverless-inference

Alternatives

Alternatives

Categories

Categories

Integrations

Helm
NVIDIA DGX Cloud
Amazon Web Services (AWS)
CoreWeave
Datadog
Docker
Google Cloud Platform
Grafana
Kubernetes
Llama
Microsoft Azure
NVIDIA AI Foundations
NVIDIA Cloud Functions
NVIDIA DGX Cloud Serverless Inference
NVIDIA NIM
Nebius
Oracle Cloud Infrastructure
Splunk Cloud Platform
Yotta

Integrations

Helm
NVIDIA DGX Cloud
Amazon Web Services (AWS)
CoreWeave
Datadog
Docker
Google Cloud Platform
Grafana
Kubernetes
Llama
Microsoft Azure
NVIDIA AI Foundations
NVIDIA Cloud Functions
NVIDIA DGX Cloud Serverless Inference
NVIDIA NIM
Nebius
Oracle Cloud Infrastructure
Splunk Cloud Platform
Yotta
Claim NVIDIA Cloud Functions and update features and information
Claim NVIDIA Cloud Functions and update features and information
Claim NVIDIA DGX Cloud Serverless Inference and update features and information
Claim NVIDIA DGX Cloud Serverless Inference and update features and information