| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2026-06-25 | 786 Bytes | |
| v0.5.13 source code.tar.gz | 2026-06-25 | 1.1 MB | |
| v0.5.13 source code.zip | 2026-06-25 | 1.1 MB | |
| Totals: 3 Items | 2.2 MB | 1 | |
Added
HF_ENDPOINTsupport for Hugging Face model metadata fetches, so users behind a mirror can point whichllm at a compatible Hub endpoint. (#128, [#131])- Manual detected-GPU overrides for usable VRAM and bandwidth, useful for iGPU and unified-memory systems where automatic detection is too conservative. (#132, [#133])
- README guidance for safer first-run flags when users want full-GPU, usable-speed recommendations with extra VRAM headroom.
Fixed
- Search terms such as
7B,0.5B, and500Mnow match model parameter size instead of plain substrings, soqwen 7bno longer returns1.7Bor30B-A3Bby accident. (#107, [#126]) - GGUF sizing now treats FP16 and ternary
TQ1_0/TQ2_0quant types correctly, avoiding underestimates for those files. (#125)