NVIDIA virtual GPU Integrations

NVIDIA TensorRT is an ecosystem of APIs for high-performance deep learning inference, encompassing an inference runtime and model optimizations that deliver low latency and high throughput for production applications. Built on the CUDA parallel programming model, TensorRT optimizes neural network models trained on all major frameworks, calibrating them for lower precision with high accuracy, and deploying them across hyperscale data centers, workstations, laptops, and edge devices. It employs techniques such as quantization, layer and tensor fusion, and kernel tuning on all types of NVIDIA GPUs, from edge devices to PCs to data centers. The ecosystem includes TensorRT-LLM, an open source library that accelerates and optimizes inference performance of recent large language models on the NVIDIA AI platform, enabling developers to experiment with new LLMs for high performance and quick customization through a simplified Python API.

AWS Marketplace is a curated digital catalog that enables customers to discover, purchase, deploy, and manage third-party software, data products, AI agents, and services directly within the AWS ecosystem. It provides access to thousands of listings across categories like security, machine learning, business applications, and DevOps tools. With flexible pricing models such as pay-as-you-go, annual subscriptions, and free trials, AWS Marketplace simplifies procurement and billing by integrating costs into a single AWS invoice. It also supports rapid deployment with pre-configured software that can be launched on AWS infrastructure. This streamlined approach allows businesses to accelerate innovation, reduce time-to-market, and maintain better control over software usage and costs.

Armet AI is a secure, turnkey GenAI platform built on Confidential Computing that encloses every stage, from data ingestion and vectorization to LLM inference and response handling, within hardware-enforced secure enclaves. It delivers Confidential AI with Intel SGX, TDX, TiberTrust Services and NVIDIA GPUs to keep data encrypted at rest, in motion and in use; AI Guardrails that automatically sanitize sensitive inputs, enforce prompt security, detect hallucinations and uphold organizational policies; and Data & AI Governance with consistent RBAC, project-based collaboration frameworks, custom roles and centrally managed access controls. Its End-to-End Data Security ensures zero-trust encryption across storage, transit, and processing layers, while Holistic Compliance aligns with GDPR, the EU AI Act, SOC 2, and other industry standards to protect PII, PCI, and PHI.

SF Compute is a marketplace platform that offers on-demand access to large-scale GPU clusters, letting users rent powerful compute resources by the hour, not requiring long-term contracts or heavy upfront commitments. You can choose between virtual machine nodes or Kubernetes clusters (with InfiniBand support for high-speed interconnects), and specify the number of GPUs, duration, and start time as needed. It supports flexible “buy blocks” of compute; for example, you might request 256 NVIDIA H100 GPUs for three days at a capped hourly rate, or scale down/up dynamically depending on budget. For Kubernetes clusters, spin-up times are fast (about 0.5 seconds); VMs take around 5 minutes. Storage is robust, including 1.5+ TB NVMe and 1 TB + RAM, and there are no data transfer (ingress/egress) fees, so you don’t pay to move data. SF Compute’s architecture abstracts physical infrastructure behind a real-time spot-market and dynamic scheduler.

NVIDIA Base Command Manager offers fast deployment and end-to-end management for heterogeneous AI and high-performance computing clusters at the edge, in the data center, and in multi- and hybrid-cloud environments. It automates the provisioning and administration of clusters ranging in size from a couple of nodes to hundreds of thousands, supports NVIDIA GPU-accelerated and other systems, and enables orchestration with Kubernetes. The platform integrates with Kubernetes for workload orchestration and offers tools for infrastructure monitoring, workload management, and resource allocation. Base Command Manager is optimized for accelerated computing environments, making it suitable for diverse HPC and AI workloads. It is available with NVIDIA DGX systems and as part of the NVIDIA AI Enterprise software suite. High-performance Linux clusters can be quickly built and managed with NVIDIA Base Command Manager, supporting HPC, machine learning, and analytics applications.

IBM Spectrum LSF Suites is a workload management platform and job scheduler for distributed high-performance computing (HPC). Terraform-based automation to provision and configure resources for an IBM Spectrum LSF-based cluster on IBM Cloud is available. Increase user productivity and hardware use while reducing system management costs with our integrated solution for mission-critical HPC environments. The heterogeneous, highly scalable, and available architecture provides support for traditional high-performance computing and high-throughput workloads. It also works for big data, cognitive, GPU machine learning, and containerized workloads. With dynamic HPC cloud support, IBM Spectrum LSF Suites enables organizations to intelligently use cloud resources based on workload demand, with support for all major cloud providers. Take advantage of advanced workload management, with policy-driven scheduling, including GPU scheduling and dynamic hybrid cloud, to add capacity on demand.

Azure Marketplace is a comprehensive online store that provides access to thousands of certified, ready-to-use software applications, services, and solutions from Microsoft and third-party vendors. It enables businesses to discover, purchase, and deploy software directly within the Azure cloud environment. The marketplace offers a wide range of products, including virtual machine images, AI and machine learning models, developer tools, security solutions, and industry-specific applications. With flexible pricing options like pay-as-you-go, free trials, and subscription models, Azure Marketplace simplifies the procurement process and centralizes billing through a single Azure invoice. It supports seamless integration with Azure services, enabling organizations to enhance their cloud infrastructure, streamline workflows, and accelerate digital transformation initiatives.

NVIDIA Magnum IO is the architecture for parallel, intelligent data center I/O. It maximizes storage, network, and multi-node, multi-GPU communications for the world’s most important applications, using large language models, recommender systems, imaging, simulation, and scientific research. Magnum IO utilizes storage I/O, network I/O, in-network compute, and I/O management to simplify and speed up data movement, access, and management for multi-GPU, multi-node systems. It supports NVIDIA CUDA-X libraries and makes the best use of a range of NVIDIA GPU and networking hardware topologies to achieve optimal throughput and low latency. In multi-GPU, multi-node systems, slow CPU, single-thread performance is in the critical path of data access from local or remote storage devices. With storage I/O acceleration, the GPU bypasses the CPU and system memory, and accesses remote storage via 8x 200 Gb/s NICs, achieving up to 1.6 TB/s of raw storage bandwidth.

Mistral Compute is a purpose-built AI infrastructure platform that delivers a private, integrated stack, GPUs, orchestration, APIs, products, and services, in any form factor, from bare-metal servers to fully managed PaaS. Designed to democratize frontier AI beyond a handful of providers, it empowers sovereigns, enterprises, and research institutions to architect, own, and optimize their entire AI environment, training, and serving any workload on tens of thousands of NVIDIA-powered GPUs using reference architectures managed by experts in high-performance computing. With support for region- and domain-specific efforts, defense technology, pharmaceutical discovery, financial markets, and more, it offers four years of operational lessons, built-in sustainability through decarbonized energy, and full compliance with stringent European data-sovereignty regulations.

IREN’s AI Cloud is a GPU-cloud platform built on NVIDIA reference architecture and non-blocking 3.2 TB/s InfiniBand networking, offering bare-metal GPU clusters designed for high-performance AI training and inference workloads. The service supports a range of NVIDIA GPU models with specifications such as large amounts of RAM, vCPUs, and NVMe storage. The cloud is fully integrated and vertically controlled by IREN, giving clients operational flexibility, reliability, and 24/7 in-house support. Users can monitor performance metrics, optimize GPU spend, and maintain secure, isolated environments with private networking and tenant separation. It allows deployment of users’ own data, models, frameworks (TensorFlow, PyTorch, JAX), and container technologies (Docker, Apptainer) with root access and no restrictions. It is optimized to scale for demanding applications, including fine-tuning large language models.