#76 Support a fallback chain of models/providers when the primary is unavailable

[Anonymous]

Originally created by: sosidudku1

Summary

There is no fallback model today. If the configured provider or model is unreachable (endpoint down, rate limited, out of credit), the run stops and the user has to reconfigure manually.

User feedback (Discord)

"it has no fallback model"

"also all fallback models"

The request is explicitly a chain, not a single backup: try the primary, then the second, then the third.

Proposal

Let the user define an ordered list of providers/models. On a retryable failure (connection error, 429, 5xx, model-not-found), the agent moves to the next entry and reports the switch in the UI rather than failing the turn.

Open questions:

• Should a local model be the last resort by default, so the agent always has something to fall back to?
• Should the chain reset to the primary on the next turn, or stay on the working provider for the session?
• Which error classes should trigger a switch vs. a plain retry?

Why it matters

This is a local-first agent that users increasingly point at cloud endpoints. Cloud endpoints fail more often than local ones, and a mid-task failure with no fallback wastes the whole run.

Related: [#75] (provider presets) — both come from the same user session.

[Anonymous]

Originally posted by: sosidudku1

Duplicate of [#70], which covers the same request. Closing this one to keep the discussion in a single place.

[Anonymous]

Ticket changed by: sosidudku1

• status: open --> closed