Download Latest Version
node-llama-cpp-electron-example.Windows.3.22.0.arm64.exe (133.0 MB)
Add to Preferred Sources
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2026-09-12 | 3.1 kB | |
| v3.21.0 source code.tar.gz | 2026-09-12 | 22.0 MB | |
| v3.21.0 source code.zip | 2026-09-12 | 22.4 MB | |
| Totals: 3 Items | 44.3 MB | 0 | |
3.21.0 (2026-09-12)
Features
LlamaRankingContext: add an option to chunk large documents (#645) (a5532a9) (documentation:RankingOptions["onOverflow"])LlamaModel:lazyModesupport (#645) (a5532a9) (documentation:LlamaModelOptions["lazyMode"])- get model and context memory usage (#645) (a5532a9) (documentation:
LlamaModel["memoryUsage"],LlamaContext["memoryUsage"]) - native jinja implementation fallback (#645) (a5532a9)
Bug Fixes
- reading gguf files that have no tensors (#645) (a5532a9)
- reading network gguf file retry conditions (#645) (a5532a9)
- add missing supported quant file name (#645) (a5532a9)
- check arch features directly from
llama.cpp(#645) (a5532a9) - align the Vulkan device reading more with
llama.cpp(#645) (a5532a9) - Metal 4 tensor API issues on M5 mac machines (#645) (a5532a9)
Shipped with llama.cpp release v0.4.0
To use the latest
llama.cpprelease available, runnpx -n node-llama-cpp source download --release latest. (learn more)
