Download Latest Version
v1.15.0 source code.tar.gz (54.9 MB)
Get an email when there's a new version of Xorbits Inference
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2025-12-13 | 3.3 kB | |
| v1.15.0 source code.tar.gz | 2025-12-13 | 54.9 MB | |
| v1.15.0 source code.zip | 2025-12-13 | 55.9 MB | |
| Totals: 3 Items | 110.8 MB | 11 | |
What's new in 1.15.0 (2025-12-13)
These are the changes in inference v1.15.0.
New features
- FEAT: added more detailed instructions for engine unavailability. by @OliverBryant in https://github.com/xorbitsai/inference/pull/4308
- FEAT: [model] Z-Image-Turbo support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4333
- FEAT: [model] DeepSeek-V3.2 support by @Jun-Howie in https://github.com/xorbitsai/inference/pull/4344
- FEAT: [model] PaddleOCR-VL support by @leslie2046 in https://github.com/xorbitsai/inference/pull/4354
- FEAT: add llama_cpp json schema output by @OliverBryant in https://github.com/xorbitsai/inference/pull/4282
- FEAT: PaddleOCR-VL implementation by @leslie2046 in https://github.com/xorbitsai/inference/pull/4304
- FEAT: multi replicas on a single GPU && add launch strategy by @OliverBryant in https://github.com/xorbitsai/inference/pull/4358
Enhancements
- ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4343
- ENH: update model "MiniMax-M2" JSON by @XprobeBot in https://github.com/xorbitsai/inference/pull/4342
- ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4349
- ENH: support lauching with --device cpu by @hubutui in https://github.com/xorbitsai/inference/pull/4352
- ENH: add glm-4.5 tool calls support && vllm StructuredOutputsParams support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4357
Bug fixes
- BUG: fix manage cache models missing by @OliverBryant in https://github.com/xorbitsai/inference/pull/4329
- BUG: [llm, vllm]: support ignore eos by @ZhikaiGuo960110 in https://github.com/xorbitsai/inference/pull/4332
- BUG: Multimodal settings for video parameters are not taking effect. by @OliverBryant in https://github.com/xorbitsai/inference/pull/4338
- BUG: Soft links cannot be completely deleted by @OliverBryant in https://github.com/xorbitsai/inference/pull/4337
- BUG: Packages with identical names in virtual environments error by @OliverBryant in https://github.com/xorbitsai/inference/pull/4348
- BUG: Fix typo in xinference/deploy/docker/Dockerfile.cu128 by @hubutui in https://github.com/xorbitsai/inference/pull/4350
- BUG: custom embedding model register fail by @OliverBryant in https://github.com/xorbitsai/inference/pull/4335
- BUG: [UI] fix the bug in the copy function. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4355
- BUG: [UI] control Select dropdown width to prevent it from becoming too wide. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4356
Documentation
- DOC: add new models and v1.14.0 release notes by @qinxuye in https://github.com/xorbitsai/inference/pull/4305
Others
- Fixed- workflow Vulnerability by @barakharyati in https://github.com/xorbitsai/inference/pull/4328
- CHORE: add i18n for replica details by @leslie2046 in https://github.com/xorbitsai/inference/pull/4306
New Contributors
- @barakharyati made their first contribution in https://github.com/xorbitsai/inference/pull/4328
- @ZhikaiGuo960110 made their first contribution in https://github.com/xorbitsai/inference/pull/4332
- @hubutui made their first contribution in https://github.com/xorbitsai/inference/pull/4350
Full Changelog: https://github.com/xorbitsai/inference/compare/v1.14.0...v1.15.0
