Originally created by: sosidudku1
The managed llama-server is spawned as a detached daemon, so after closing the terminal it keeps holding RAM and VRAM until atomic-agent models stop is run manually. Staying warm between sessions is a fair default (model load takes tens of seconds), but there is currently no way to opt out.
Proposal, either of:
localModels.managed.stopOnExit that stops the chat daemon when the last CLI session exitsEither would also help users on 16 GB machines where the idle model blocks other work.
Related: PR [#50] already adds daemon teardown when switching to an external server, so the stop path exists; this issue is about the exit and idle cases.
Ticket changed by: Ooooze