Download Latest Version v2.2.0_ Falcon, macOS support, and more.zip (160.0 kB)
Email in envelope

Get an email when there's a new version of Petals

Home / v1.1.5
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2023-05-09 2.3 kB
v1.1.5_ Faster fine-tuning, bug fixes, and more.tar.gz 2023-05-09 87.9 kB
v1.1.5_ Faster fine-tuning, bug fixes, and more.zip 2023-05-09 124.9 kB
Totals: 3 Items   215.1 kB 1

Highlights

⏱ Faster fine-tuning. Fine-tuning uses ~2x less traffic (tensors are now sent in bfloat16 by default) and builds routes using a heuristic maximizing the swarm's throughput. This should address timeout errors that could happen during fine-tuning.

🐞 Bug fixes. On servers, this release fixes out-of-memory errors and freezing network throughput evals. On clients, it fixes issues with slicing RemoteSequential and silently ignoring unsupported .generate() kwargs. Also, this release fixes warnings originated from hivemind.p2p and hivemind.compression.

🛣️ Updated throughput formula. We have updated the throughput formula to reflect that servers hosting many blocks still run forward and backward passes through only one block at a time. Don't be surprised if your throughput became smaller than in 1.1.4 — these numbers are not directly comparable!

🖼️ Improved lower-level interfaces. We have refactored lower-level interfaces, such as RemoteSequential and RemoteSequenceManager, to be more reliable (e.g. when doing retries) and much easier to use. Some rarely used low-level functions in petals.dht_utils were removed.

What's Changed

Full Changelog: https://github.com/bigscience-workshop/petals/compare/v1.1.4...v1.1.5

Source: README.md, updated 2023-05-09