Abstract
A method is disclosed for detecting a hosted inference provider's outage and pausing a dependent worker fleet or, in a failover mode, re-routing fallback-permitting callers of the platform's model gateway, with no language-model call in the decision path. A stateless scheduled tick gathers two signals: the provider's public status indicator, and synthetic requests to a probe endpoint specified on that gateway. Each probe outcome is classified by response shape as success, upstream failure (the endpoint reports a provider failure) or transport failure (the endpoint was not reached); reachable samples alone are reduced by strict majority, and a tick with no reachable sample is indeterminate. Debounce counters live in one database row per provider, advanced by one time-window-conditioned update so overlapping runs cannot double-count. The probes are authoritative: first entering an outage requires a configured number of consecutive failed ticks, and a non-operational status indicator only substitutes a second, conventionally lower, number. In pause mode the sentinel writes an expiring lease, refreshed on each determinate tick while down or recovering and clamped by a database update trigger to a configured maximum; workers check it before starting new work, an unreadable lease meaning not paused. An indeterminate tick neither refreshes nor clears any effect, so a sentinel that cannot reach its probe endpoint lets the pause lapse, provided it sends no more probes per tick than an in-tick circuit breaker's threshold. Failover enables a fallback-list entry for an alternative provider only after verifying the target, and otherwise degrades to the pause.
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Assuncao, gustavo matthew, "Two-Signal Provider-Outage Sentinel with Probe-Authoritative Debounce, an Indeterminate Tick That Lets a Database-Clamped Fleet-Pause Lease Lapse, and Verify-or-Degrade Failover", Technical Disclosure Commons, ()
https://www.tdcommons.org/dpubs_series/13206