TorchRL Files

Async Collector execution

This release major upgrades is a patch to collector.start() to allow collectors (single or multi-proc) to run asynchronously. [#2935]

An example is provided in the async SAC example. [#2946]

Single-agent reset

Fixes [#2958] where partial resets are not handled correctly when a BatchedEnv is transformed - as the "done" checks were inconsistent. We now enforce that root "_reset" entries always precede their respective leaves.

Fix shifted values in GAE using LSTMs

Using an LSTM within GAE is facilitated by ensuring that shifted=True and shifted=False work properly (with appropriate warnings/errors if other hyperparameters need to be set). [#2941]

Full Changelog: https://github.com/pytorch/rl/compare/v0.8.0...v0.8.1