When testing EVI2, developers noticed that Anthropic had big server load problems after the Claude 3.7 Sonnet launch.
To mitigate potential disruptions in the future, it would be beneficial to allow users to specify a fallback supplemental LLM that can be automatically used when the primary LLM encounters performance issues or downtime.