Download Latest Version 1.5.0 source code.tar.gz (263.5 kB)
Email in envelope

Get an email when there's a new version of VectorizedMultiAgentSimulator (VMAS)

Home / VMAS-1.4.0
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2024-02-07 1.2 kB
VMAS-1.4.0 source code.tar.gz 2024-02-07 169.1 kB
VMAS-1.4.0 source code.zip 2024-02-07 256.0 kB
Totals: 3 Items   426.3 kB 0

Differentiable VMAS

That's right, VMAS is now fully differentiable!

How do I use it?

Just set grad_enabled=True at environement construction time and have any input that requires gradients. This can be actions or scenario parameters. VMAS will keep track of the computation graph on that tensor over time.

What does it mean?

It means that you can differentiate any VMAS output, enabling differentaition of the transition dynamics, reward functions, and observation functions.

Why is it useful?

You can now optimize parameters in VMAS scenarios (e.g., parameters of the various scenario functions or simply initial state values) using losses computed on rewards or observations. It further allows you to backpropagate through time (simulation steps).

What's Changed

Full Changelog: https://github.com/proroklab/VectorizedMultiAgentSimulator/compare/VMAS-1.3.4...VMAS-1.4.0

Source: README.md, updated 2024-02-07