Provider access stays separate from application control.
01
Preserve the namespaced model boundary
Together model identifiers include the provider and model name. The gateway maps a reviewed identifier to a stable company alias, allowing applications to keep one client configuration while administrators change only compatible targets.
02
Separate chat from embeddings
Chat Completions and embeddings share an OpenAI-compatible surface but are not interchangeable workloads. Route validation keeps their target eligibility explicit, and each application can have its own budget, rate, concurrency, and environment boundary.
03
Verify before paid inference
The connection test reads the model catalog rather than generating a response. Administrators can confirm the credential, review the selected target, and simulate the policy path before allowing the workload to consume provider tokens.
Current shared controls
Status determines what can be configured.
Write-only, encrypted BYOK for implemented provider connections Stable model aliases and protocol-eligible route targets Organization and key budgets, RPM, TPM, and concurrency hard limits Observe, Shadow, Enforce, reason codes, and metadata-only evidence
Beta connections require customer validation against the exact model, payload, streaming mode, region, and provider account before production use.