Improve documentation around local model configuration
Open Source Local First Ai Agent
Brought to you by:
sosidudku
Originally created by: johnojo175-dev
I've been looking through the project and noticed that the model configuration could use a bit more explanation. Since Atomic Agent is built around local inference, users will likely try different GGUF models, quantizations, and context sizes.
It would be helpful to include recommendations for:
I think this would reduce setup friction, especially for people who are new to running local LLMs.
Ticket changed by: sosidudku1
Originally posted by: sosidudku1
Thanks, this one points at a real gap. A local-model setup guide (supported model families, quantization vs RAM and VRAM, common pitfalls) is planned as part of the Quick Start docs effort. PR [#38] will also make model setup itself much simpler. Closing here; the guide will land in the docs.
Related
Tickets: #38