Download Latest Version
now with llama.cpp support for running LLMs locally source code.zip (2.0 MB)
Get an email when there's a new version of ChatCraft.org
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| now with llama.cpp support for running LLMs locally source code.tar.gz | 2024-07-08 | 1.9 MB | |
| now with llama.cpp support for running LLMs locally source code.zip | 2024-07-08 | 2.0 MB | |
| README.md | 2024-07-08 | 672 Bytes | |
| Totals: 3 Items | 3.9 MB | 0 | |
This release has better non-openai provider support. Most notably llama.cpp (github.com) and deepseek work now.
See blog post for details on using chatcraft with llama.cpp.
Changes
- simplify message format, improve unofficial-openai provider compatibility by @tarasglek in https://github.com/tarasglek/chatcraft.org/pull/661
- make model listing llama.cpp friendly by @tarasglek in https://github.com/tarasglek/chatcraft.org/pull/662
Full Changelog: https://github.com/tarasglek/chatcraft.org/compare/v2.2.0...v2.2.1