Download Latest Version v0.5.16 source code.zip (1.2 MB)
Email in envelope

Get an email when there's a new version of whichllm

Home / v0.5.13
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2026-06-25 786 Bytes
v0.5.13 source code.tar.gz 2026-06-25 1.1 MB
v0.5.13 source code.zip 2026-06-25 1.1 MB
Totals: 3 Items   2.2 MB 1

Added

  • HF_ENDPOINT support for Hugging Face model metadata fetches, so users behind a mirror can point whichllm at a compatible Hub endpoint. (#128, [#131])
  • Manual detected-GPU overrides for usable VRAM and bandwidth, useful for iGPU and unified-memory systems where automatic detection is too conservative. (#132, [#133])
  • README guidance for safer first-run flags when users want full-GPU, usable-speed recommendations with extra VRAM headroom.

Fixed

  • Search terms such as 7B, 0.5B, and 500M now match model parameter size instead of plain substrings, so qwen 7b no longer returns 1.7B or 30B-A3B by accident. (#107, [#126])
  • GGUF sizing now treats FP16 and ternary TQ1_0 / TQ2_0 quant types correctly, avoiding underestimates for those files. (#125)
Source: README.md, updated 2026-06-25