Model Gateway

The only gateway with context from your systems

Route every request to the right model at the right cost, informed by the data and access rules behind it.

Trusted by global teams connecting data and AI at scale
GSK
Palantir
Anthropic
Office Depot
Google

Every provider, key, and dollar under control

One endpoint in front of every provider — with virtual keys, hard budgets, rate limits, and per-person or agent spend attribution built in.

Model providers, one gateway, every account: OpenAI 2 accounts, Anthropic 1 account, Azure OpenAI different shapes handled, Google Gemini 1 account, Cohere 1 account, Mistral 1 account, AWS Bedrock 1 account
Budgets set by project: support-assistant $1,180 of $2,000, sales-pipeline-agent $310 of $500, research-batch $500 of $500 cap hit, call refused before dispatch, model providers OpenAI, Anthropic, Gemini, plus 5 more
Rate limits per project, requests per minute: research-batch throttled at 100%, support-assistant unaffected at 34%, sales-pipeline-agent unaffected at 22%
Spend by project this week, estimated from your rates: proj-alpha $412, proj-beta $897 spike, proj-ops $186
Virtual keys, one per person, j.chen@acme.com: vk-usr-jchen-4d21 what the person holds, gateway maps key to real credential, sk-prod redacted stays in gateway, vk-usr-mruiz-8a03 revoked

Manage routing, budgets, and failover in one place

Declare each policy once in the gateway and it applies at whatever level you manage AI, user, team, or department, on every request.

Set default models by department, team, or user.

Set a default model at any level—department, team, or user. Defaults cascade down and can be overridden below; change one once and every agent in scope inherits it.

department defaults
team overrides
per-user pins
Default models Department → team → user
Sales dept default: sonnet-4.5
↪ SDR team inherits
↪ Ops team override: haiku
JC↪ j.chen pinned: gpt-5

Governance enforced on every request

Every call resolves its scope, model, budget, and fallback in the gateway before it reaches a provider.

Cascading scopes

Govern thousands of agents with one change. Set a policy at the department, team, or user level and everything in scope inherits it instantly with no per-agent config to chase.

Separate ledgers

Never explain a surprise invoice again. Every scope keeps its own attributed ledger. Soft limits warn, hard limits stop spend before it happens.

Continuous health checks

Your agents stay up even when a provider goes down. The gateway watches every provider and reroutes the instant one degrades, so end users never feel the outage.

Drop-in compatible

Adopt it without rewriting a single agent. OpenAI- and Anthropic-compatible, so migrating is a base URL and API key change. It sits in front of every major provider and open-weight models.

Your business context, applied to any model

The gateway grounds each call in the Context Engine before it reaches a model, so you can spend fewer and cheaper tokens.

Context gathered in one graph

Schemas, data models, semantic definitions, and company knowledge, unified into one graph of what agents need to know.

Applied to every model

Context lives in the gateway, not any one model. The same understanding applies to Claude, GPT, or Gemini, and carries through every failover.

Processed in the engine, not the model

Data is processed in the platform, and the model gets only what the question needs: fewer tokens, no discovery phase.

How a request routes

Every call resolves scope, model, budget, and fallback in the gateway before it reaches a provider: four decisions inside a single request.

Agent request 01 Resolve scope 02 Pick the model 03 Check the budget 04 Health-checked call Answer
01

The gateway resolves who is calling

The request carries the caller's identity, and the gateway maps it to the scope hierarchy of user, team, and department before any model is chosen.


02

Routing rules pick the model

The most specific rule wins: a user pin beats a team override beats a department default. The decision and its source are recorded on the request.


03

The budget check runs before the call

The scope's ledger is checked before tokens are spent. Under a soft limit the request proceeds with a warning; at a hard limit it returns 402, with no invoice surprise.


04

The call goes out health-checked, with fallbacks armed

If the chosen provider is degraded, the request moves down the fallback list instantly. Shared context travels with it, so the answer holds on whichever model serves it.

[email protected] · Sales · Revenue resolved
MODEL claude-sonnet · team override
BUDGET $1,760 left · cap $8,000/mo
FALLBACKS gemini · gpt-5
Routed to Claude Sonnet

It learns from every request.

Because every request runs through the gateway, the context behind it keeps improving. It's a self-learning loop no pass-through gateway can close.

Explore the self-learning
01

Conversational signals.

When a user gets the wrong cut and corrects it, the loop links that intent to the query that finally worked and updates the concept behind it.

02

Query mining.

Commonly queried tables, frequent join paths, and popular filters surface over time, sharpening retrieval with real usage signal.

03

Refined and reconciled, with humans in the loop.

The engine periodically self-reviews for conflicts and gaps. Learned changes surface as reviewable diffs an owner approves, and unresolvable ones go to the right person.

More than a model gateway

The complete package for AI deployment

The model gateway is part of a platform built on controls and security, a context engine, and a live data layer—everything an AI deployment needs, in one platform, instead of assembled from parts.

Explore the AI Gateway
Humans
Copilot Claude ChatGPT Perplexity
Agents
Agentforce LangChain CrewAI n8n
Connect AI Gateway
Gateways

Model, MCP, and Agent gateways—routing, guardrails, cost controls

Controls & security

Identity, policy, and guardrails enforced at every step

Context engine

Company knowledge, semantics, and schema on every request

Data layer

Real-time read/write to hundreds of enterprise sources

Source systems
Salesforce SAP Snowflake NetSuite Databricks HubSpot
+ hundreds more
Models
Sonnet GPT-5 Gemini Grok DeepSeek
Model Gateway in action
Erik Bailey
“Our teams are not even thinking about Connect AI. They're just saying, ‘This is Claude’ or ‘This is Copilot.’ It's the plumbing behind the scenes that's enabling it. And the best plumbing is invisible.”
Erik Bailey
CIO, Anaqua
FAQ

Questions teams ask.

  • What does migrating to the gateway take?
  • What happens when a budget cap is hit?
  • What do end users see when a provider goes down?
  • Do we lose what agents learned when we swap models?

One endpoint. Every model. Full control.

Route by user, team, and department, cap spend at every level, and fail over across providers, all from the Model Gateway, with your context intact.