Open Source Linux Autonomous Driving Software

CARLA has been developed from the ground up to support development, training, and validation of autonomous driving systems. In addition to open-source code and protocols, CARLA provides open digital assets (urban layouts, buildings, vehicles) that were created for this purpose and can be used freely. The simulation platform supports flexible specification of sensor suites, environmental conditions, full control of all static and dynamic actors, maps generation and much more. Multiple clients in the same or in different nodes can control different actors. CARLA exposes a powerful API that allows users to control all aspects related to the simulation, including traffic generation, pedestrian behaviors, weathers, sensors, and much more. Users can configure diverse sensor suites including LIDARs, multiple cameras, depth sensors and GPS among others. Users can easily create their own maps following the OpenDrive standard via tools like RoadRunner.

Coach is a python framework that models the interaction between an agent and an environment in a modular way. With Coach, it is possible to model an agent by combining various building blocks, and training the agent on multiple environments. The available environments allow testing the agent in different fields such as robotics, autonomous driving, games and more. It exposes a set of easy-to-use APIs for experimenting with new RL algorithms and allows simple integration of new environments to solve. Coach collects statistics from the training process and supports advanced visualization techniques for debugging the agent being trained. Coach supports many state-of-the-art reinforcement learning algorithms, which are separated into three main classes - value optimization, policy optimization, and imitation learning. Coach supports a large number of environments which can be solved using reinforcement learning.

openpilot is an open-source driver assistance system designed to improve upon the existing driver assistance of most modern cars today. openpilot gives you Tesla Autopilot-like functionality with functions like Adaptive Cruise Control (ACC), Automated Lane Centering (ALC), Forward Collision Warning (FCW) and Lane Departure Warning (LDW). All these with just a push of a button. openpilot also includes a camera-based driver monitoring feature that alerts distracted and asleep drivers while it is engaged. openpilot supports over 85 car makes and models of various years, and the list of supported vehicles continues to grow, including community-supported cars and features. Thousands of drivers have trusted openpilot and have rediscovered the joy of driving again with openpilot. While engaged, openpilot includes camera-based driver monitoring that works both day and night to alert the driver when their eyes are not on the road ahead.

Easily collect, transform, and transfer vehicle data to the cloud in near-real-time. AWS IoT FleetWise makes it easy and cost-effective for automakers to collect, transform, and transfer vehicle data to the cloud in near-real-time and use it to build applications with analytics and machine learning that improve vehicle quality, safety, and autonomy. Train autonomous vehicles (AVs) and advanced driver assistance systems (ADAS) with camera data collected from a fleet of production vehicles. Improve electric vehicle (EV) battery range estimates with crowdsourced environmental data, such as weather and driving conditions, from nearby vehicles. Collect select data from nearby vehicles and use it to notify drivers of changing road conditions, such as lane closures or construction. Use near real-time data to proactively detect and mitigate fleet-wide quality issues.

3D visual perception tasks, including 3D detection and map segmentation based on multi-camera images, are essential for autonomous driving systems. In this work, we present a new framework termed BEVFormer, which learns unified BEV representations with spatiotemporal transformers to support multiple autonomous driving perception tasks. In a nutshell, BEVFormer exploits both spatial and temporal information by interacting with spatial and temporal space through predefined grid-shaped BEV queries. To aggregate spatial information, we design spatial cross-attention that each BEV query extracts the spatial features from the regions of interest across camera views. For temporal information, we propose temporal self-attention to recurrently fuse the history BEV information. Our approach achieves the new state-of-the-art 56.9\% in terms of NDS metric on the nuScenes \texttt{test} set, which is 9.0 points higher than previous best arts and on par with the performance of LiDAR-based baseline.

Alpamayo 1 is a pre-trained reasoning model developed by NVIDIA to support research and development in autonomous driving systems. It combines perception, reasoning, and action prediction into a unified architecture, enabling it to interpret complex driving scenarios and generate trajectory plans. The model is designed as a foundational component rather than a complete driving stack, allowing developers to build custom autonomous vehicle applications on top of it. It incorporates vision-language-action modeling, enabling it to process sensor data and contextual information simultaneously. Alpamayo supports tasks such as trajectory prediction, auto-labeling, and reasoning-based decision making. The system is optimized for high-performance GPU environments and is intended primarily for experimentation and benchmarking. Overall, it represents an advanced step toward integrating reasoning into autonomous driving pipelines.

Alpamayo2-Super is NVIDIA’s flagship open reasoning Vision-Language-Action (VLA) model for autonomous vehicle development, designed to accelerate Level 4 robotaxi and autonomous driving systems. Built on the NVIDIA Cosmos platform, it enables vehicles to perceive, reason, plan, and generate driving actions using human-like decision making rather than relying solely on predefined rules. The model processes multi-camera video, navigation signals, and driving context to produce driving trajectories alongside interpretable Chain-of-Causation reasoning, improving transparency for validation and safety analysis. Alpamayo2-Super is part of the broader NVIDIA Alpamayo ecosystem, which also includes simulation frameworks, reinforcement learning infrastructure, datasets, and physical AI tools for end-to-end autonomous vehicle development. It integrates with AlpaGym for closed-loop reinforcement learning and Cosmos-Dreams for large-scale driving simulation, allowing developers to train, evaluate,

This project intends to develop a system to control the vehicles over a wireless network. Each vehicle contains embedded software that interfaces with a set of sensors and actuators that allow the vehicle to navigate, to communicate with roadside sensors,

Software Infrastructure for Stanford's Autonomous Vehicles

HighwayEnv is an OpenAI Gym-compatible environment focused on autonomous driving scenarios. It provides flexible simulations for testing decision-making algorithms in highway, intersection, and merging traffic situations.

Autonomous driving is gaining increasing attention in the computer vision research community, as vision based scene understanding is key to self-driving cars. In this web page, we make image datasets public for the purpose of furthering research in scene understanding.