+
+

Related Products

  • CDK Global
    332 Ratings
    Visit Website
  • LeanData
    1,070 Ratings
    Visit Website
  • RunPod
    167 Ratings
    Visit Website
  • Stigg
    25 Ratings
    Visit Website
  • groundcover
    32 Ratings
    Visit Website
  • Setplex
    10 Ratings
    Visit Website
  • RentGuruz
    8 Ratings
    Visit Website
  • RouteGenie
    48 Ratings
    Visit Website
  • Epicor Prophet 21
    224 Ratings
    Visit Website
  • TripMaster
    111 Ratings
    Visit Website

About

Software is what turns a vehicle into an intelligent machine. The NVIDIA DRIVE™ Software stack is open, empowering developers to efficiently build and deploy a variety of state-of-the-art AV applications, including perception, localization and mapping, planning and control, driver monitoring, and natural language processing. The foundation of the DRIVE Software stack, DRIVE OS is the first safe operating system for accelerated computing. It includes NvMedia for sensor input processing, NVIDIA CUDA® libraries for efficient parallel computing implementations, NVIDIA TensorRT™ for real-time AI inference, and other developer tools and modules to access hardware engines. The NVIDIA DriveWorks® SDK provides middleware functions on top of DRIVE OS that are fundamental to autonomous vehicle development. These consist of the sensor abstraction layer (SAL) and sensor plugins, data recorder, vehicle I/O support, and a deep neural network (DNN) framework.

About

VLLM is a high-performance library designed to facilitate efficient inference and serving of Large Language Models (LLMs). Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. It offers state-of-the-art serving throughput by efficiently managing attention key and value memory through its PagedAttention mechanism. It supports continuous batching of incoming requests and utilizes optimized CUDA kernels, including integration with FlashAttention and FlashInfer, to enhance model execution speed. Additionally, vLLM provides quantization support for GPTQ, AWQ, INT4, INT8, and FP8, as well as speculative decoding capabilities. Users benefit from seamless integration with popular Hugging Face models, support for various decoding algorithms such as parallel sampling and beam search, and compatibility with NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs, and more.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Automakers that want to build autonomous vehicles

Audience

AI infrastructure engineers looking for a solution to optimize the deployment and serving of large-scale language models in production environments

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

NVIDIA
Founded: 1993
United States
www.nvidia.com/en-us/self-driving-cars/drive-platform/software/

Company Information

VLLM
United States
docs.vllm.ai/en/latest/

Alternatives

DriveMod

DriveMod

Cyngn

Alternatives

OpenVINO

OpenVINO

Intel
PRODRIVER

PRODRIVER

embotech

Categories

Categories

Integrations

KServe
Alibaba Cloud Anti-Bot Service
Alibaba Cloud SSL Certificates Service
CapametriX
Cisco Kinetic
Docker
DraftAid
FPT AI Factory
Frenos
Lamini
Medical LLM
Modelry
NVIDIA Onyx
Polargrid
Promethium
QC Ware Forge
Solvision Invoicing
Sporo
VAST Data
Voicy.ai

Integrations

KServe
Alibaba Cloud Anti-Bot Service
Alibaba Cloud SSL Certificates Service
CapametriX
Cisco Kinetic
Docker
DraftAid
FPT AI Factory
Frenos
Lamini
Medical LLM
Modelry
NVIDIA Onyx
Polargrid
Promethium
QC Ware Forge
Solvision Invoicing
Sporo
VAST Data
Voicy.ai
Claim NVIDIA DRIVE and update features and information
Claim NVIDIA DRIVE and update features and information
Claim VLLM and update features and information
Claim VLLM and update features and information