Search Results for "flow"

...Traditional pipeline parallelism methods (e.g. 1F1B or staggered pipelining) leave gaps because forward and backward phases can’t fully overlap with communication. DualPipe addresses that by scheduling micro-batches from both ends of the pipeline in a bidirectional fashion—i.e. some micro-batches flow forward while others flow backward—so that computation on one partition can coincide with communication for another.

...Other notebooks examine reinforcement learning through PPO, SAC, TD3, VPG, and MuZero experiments. Transformer, recurrent-network, counterfactual-regret, and normalizing-flow examples broaden the collection. The notebooks are designed to be read directly on GitHub, making the repository useful for studying algorithms through working code.