Name | Modified | Size | Downloads / Week |
---|---|---|---|
Parent folder | |||
README.md | 2025-06-06 | 1.0 kB | |
v1.2.0 source code.tar.gz | 2025-06-06 | 4.2 MB | |
v1.2.0 source code.zip | 2025-06-06 | 4.6 MB | |
Totals: 3 Items | 8.8 MB | 0 |
New Features
TensorDict support for EBC and EC
an EBC/EC module can now take in TensorDict
as the data input in alternative to KeyedJaggedTensor
: [#2581] [#2596]
Customized Embedding Lookup Kernel Support
NVIDIA dynamicemb package depends on an old TorchRec release (r0.7) plus a PR(#2533), refactor TorchRec embedding lookup structures to be easy to plug in a customized emb-lookup kernel: [#2887] [#2891]
Prototype of Dynamic Sharding
Add initial dynamic sharding API and test. This current version supports EBC, TW, and Sharded Tensor. And other variants beyond those configurations (e.g. CW, RW, DTensor etc..): [#2852] [#2875] [#2877] [#2863]
TorchRec 2D Parallel for EmbeddingCollection
Adding support for EmbeddingCollection modules in 2D parallel. This supports all sharding types that are supported for EC. [#2737]
Changelog
- Support MCH for semi-sync (assuming no eviction): [#2753]
- Multi forward MCH eviction fix: [#2836]
- Fix RW Support and checkpointing: [#2890]