Circuit breaker
A per-provider, per-model gate that stops sending traffic somewhere after repeated failures, then probes for recovery.
By Lattice editorial · Entry last reviewed · method
What it implies
Provider error rates are real and are not independent across providers. A retry policy that assumes independence turns a partial outage into a total one by stampeding the survivor. Breaker plus jittered retries is the minimum for a gateway worth running.