LMDeploy - Browse /v0.15.0 at SourceForge.net

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2026-07-31	8.7 kB	0
v0.15.0 source code.tar.gz	2026-07-31	2.3 MB	0
v0.15.0 source code.zip	2026-07-31	3.3 MB	1
Totals: 3 Items		5.6 MB	1

What's Changed

🚀 Features

Support long-context and MTP prefix-cache hits by @grimoire in https://github.com/InternLM/lmdeploy/pull/4688
[Feature] Add guided decoding support for speculative decoding by @windreamer in https://github.com/InternLM/lmdeploy/pull/4559
feat(turbomind): memory allocator, object cache, and scheduler integration by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4717
feat: add AgRs all2all backend by @irexyc in https://github.com/InternLM/lmdeploy/pull/4739
DeepSeek V4 support by @grimoire in https://github.com/InternLM/lmdeploy/pull/4554
Support memdecode by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4767

💥 Improvements

Force blksize=128 for linear attention on ascend by @jinminxi104 in https://github.com/InternLM/lmdeploy/pull/4705
refactor: unify interleaved MRoPE rotary embedding by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4644
Refine multi-node support on ascend-A3 by @jinminxi104 in https://github.com/InternLM/lmdeploy/pull/4711
[Improve]: Remove dlblas from lmdeploy by @RunningLeon in https://github.com/InternLM/lmdeploy/pull/4682
replace sync with wait event in h2d by @grimoire in https://github.com/InternLM/lmdeploy/pull/4709
Respect --server-port in DP mode when proxy-url is set by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4712
add --language-model-only for text-only VLM inference and remove --disable-vision-encoder by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4716
Optimize TTFT by @grimoire in https://github.com/InternLM/lmdeploy/pull/4695
Optimize BaseResponseParser streaming and add parser benchmark by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4697
Support fp8 moe only for qwen3.5 by @RunningLeon in https://github.com/InternLM/lmdeploy/pull/4740
clear runtime state in sleep by @grimoire in https://github.com/InternLM/lmdeploy/pull/4729
feat(serve): add --generation-config CLI for server sampling defaults by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4708
fix: gzip torch profiler traces by default by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4747
Optimize tp fp8 moe for small average router per expert by @grimoire in https://github.com/InternLM/lmdeploy/pull/4751
refactor(pytorch): clarify scheduler and input-maker control flow by @grimoire in https://github.com/InternLM/lmdeploy/pull/4727
Guard DP dummy inputs around pending work by @grimoire in https://github.com/InternLM/lmdeploy/pull/4738
Remove interactive chat and make inference stateless by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4730
feat(turbomind): Derive composable TurboMind parallel configurations by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4769
Add generic tensor copy and architecture-aware Gated Delta Rule support by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4757
Add GDR CP controls and legacy kernel override by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4779
fix(turbomind): fix zero-centered RMSNorm for Qwen3.5 by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4790

🐞 Bug fixes

fix prefix caching by @grimoire in https://github.com/InternLM/lmdeploy/pull/4700
fix _reduce_split_kernel for triton 3.5.1 by @irexyc in https://github.com/InternLM/lmdeploy/pull/4696
fix triton fp8 all_reduce group by @grimoire in https://github.com/InternLM/lmdeploy/pull/4702
fix(serve): use unique chatcmpl id for chat completions responses by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4707
[Bugfix] Fix ImportError in get_chat_template for builtin chat-template names by @waynehacking8 in https://github.com/InternLM/lmdeploy/pull/4690
[Bugfix] Fix InternVL/InternVL3 LoRA loading TypeError in adapter fallback by @waynehacking8 in https://github.com/InternLM/lmdeploy/pull/4684
Force blksize=128 when head_dim=256 on ascend by @wanfengcxz in https://github.com/InternLM/lmdeploy/pull/4723
fix HCCL port conflict on multi-dp rank startup(single node) by @wanfengcxz in https://github.com/InternLM/lmdeploy/pull/4722
fix: fail fast on invalid serve parsers by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4701
fix: parse multimodal tool messages by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4680
Reprobe once for health request by @RunningLeon in https://github.com/InternLM/lmdeploy/pull/4703
fix: enable graph capture during DP warmup decoding by @wanfengcxz in https://github.com/InternLM/lmdeploy/pull/4728
fix: proper XGrammar integration for guided decoding by @windreamer in https://github.com/InternLM/lmdeploy/pull/4726
fix: release multimodal payload after mp handoff by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4725
Fix MTP recurrent state round-trip for Qwen3.5 by @RunningLeon in https://github.com/InternLM/lmdeploy/pull/4744
Fix mtp dpmeta and guard the warmup by @RunningLeon in https://github.com/InternLM/lmdeploy/pull/4741
Fix GLM MTP by @RunningLeon in https://github.com/InternLM/lmdeploy/pull/4749
fix false negative healthy status check for turbomind by @irexyc in https://github.com/InternLM/lmdeploy/pull/4745
fix(vl): forward tools to multimodal chat templates by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4759
fix: restrict remote media domains by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4734
fix(turbomind): restore INT8 KV quant-param offset in block layout by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4764
fix(turbomind): avoid async TP shutdown deadlock by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4770
fix: bound grouped GEMM scheduling by routed tokens by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4771
feat(turbomind): enable SM90 GDR PDL and fix CP matrix layout by @lzhangzz in https://github.com/InternLM/lmdeploy/pull/4787
fix(serve): auto-generate batch completion sessions to avoid id collision (#4773) by @Anai-Guo in https://github.com/InternLM/lmdeploy/pull/4774
feat(turbomind): restore metrics reporting by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4768
fix: skip interns2 preview time-series weights by @CUHKSZzxy in https://github.com/InternLM/lmdeploy/pull/4801
fix(serve): handle missing logprobs attrs on TurbomindEngineConfig in Anthropic messages by @lvhan028 in https://github.com/InternLM/lmdeploy/pull/4800