You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit de91c29
Browse filesBrowse the repository at this point in the historyBrowse files
refactor(server): fix the provider-profile source refresh interval
Drop the unreleased provider_profile_source_refresh_interval_seconds
gateway setting. Interceptor provider-profile sources refresh every 10
seconds, matching the supervisor configuration poll interval.
Signed-off-by: Piotr Mlocek <pmlocek@nvidia.com>
Copy file name to clipboardExpand all lines: docs/extensibility/gateway-interceptors.mdx
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -153,7 +153,7 @@ Include a `{ type = "user" }` entry to compose interceptor profiles with importe
153
153
154
154
The gateway validates snapshot structure and provider profile semantics. It treats the configured interceptor as a trusted source and does not verify interceptor-defined signature, hash, or key annotations.
155
155
156
-
The gateway calls `SnapshotProviderProfiles` at startup and then every `provider_profile_source_refresh_interval_seconds` (default 10), not on every profile read. A changed `revision` reaches sandboxes on the next refresh. If the interceptor stays unreachable for three intervals, reads that need the catalog fail closed until it recovers.
156
+
The gateway calls `SnapshotProviderProfiles` at startup and then every 10 seconds, not on every profile read. A changed `revision` reaches sandboxes on the next refresh. If the interceptor stays unreachable for 30 seconds, reads that need the catalog fail closed until it recovers.
# Operator-run supervisor middleware. The gRPC endpoint must be reachable from
218
216
# both the gateway and sandbox supervisors.
@@ -506,7 +504,7 @@ provider_profile_sources = [
506
504
507
505
The gateway validates snapshot structure and provider-profile semantics. It treats a configured interceptor as the source trust boundary and does not verify signature, hash, or key annotations in profile payloads.
508
506
509
-
The gateway fetches each interceptor source's snapshot at startup and then every `provider_profile_source_refresh_interval_seconds` (default 10), and serves profile reads from that copy. When the snapshot revision changes, the gateway pushes new configuration to sandboxes that receive it over their supervisor session. If refreshes keep failing, the gateway serves the last snapshot for up to three intervals, then fails reads that need the catalog with `UNAVAILABLE` until a refresh succeeds.
507
+
The gateway fetches each interceptor source's snapshot at startup and then every 10 seconds, and serves profile reads from that copy. When the snapshot revision changes, the gateway pushes new configuration to sandboxes that receive it over their supervisor session. If refreshes keep failing, the gateway serves the last snapshot for up to 30 seconds, then fails reads that need the catalog with `UNAVAILABLE` until a refresh succeeds.
510
508
511
509
`failure_policy` accepts `fail_closed` or `fail_open`. `timeout` accepts `ms` and `s` suffixes. In `dynamic` mode, binding overrides may select a manifest binding by `id`, `rpc`, or `service` plus `method`; they can disable a binding, narrow its phases, or override its failure policy.
0 commit comments