Download Latest Version
v3.3.4 source code.tar.gz (3.2 MB)
Get an email when there's a new version of Text Generation Inference
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2025-06-19 | 447 Bytes | |
| v3.3.4 source code.tar.gz | 2025-06-19 | 3.2 MB | |
| v3.3.4 source code.zip | 2025-06-19 | 3.8 MB | |
| Totals: 3 Items | 7.0 MB | 5 | |
Fix for Neuron models exported with batch_size 1.
What's Changed
- [gaudi] gemma3 text and vlm model intial support. need to add sliding window … by @sywangyi in https://github.com/huggingface/text-generation-inference/pull/3270
- Neuron backend fix by @dacorvo in https://github.com/huggingface/text-generation-inference/pull/3273
Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v3.3.3...v3.3.4