Name | Modified | Size | Downloads / Week |
---|---|---|---|
Parent folder | |||
README.md | 2024-01-18 | 265 Bytes | |
v0.5.0 source code.tar.gz | 2024-01-18 | 935.7 kB | |
v0.5.0 source code.zip | 2024-01-18 | 1.0 MB | |
Totals: 3 Items | 2.0 MB | 0 |
What's Changed
- Add tensorrt-llm backend (v0.6.1).
- Add embedding backend.
- Add Mixtral serve config.
- Upgrading vllm support to (v0.2.5)
- Upgrading ray to v2.9.1
Thanks for contributions from: @avnishn @csivanich @sihanwang41 @Yard1 @tterrysun