Uber's Agent Gateway Is the Asset That Outlasts Any Model
OpenAI just turned adoption into an admin toggle, so control belongs to whoever owns the single path into your systems.
Tool servers cost almost nothing to generate; authorising them still costs attention
The most consequential detail in Uber's design is that most of its 800+ tool servers were never hand-written. Each is an MCP server, the emerging standard connector that lets an AI agent call a company system. A workflow called AutoCrawler generates them from Uber's existing API definitions, and an LLM writes the tool descriptions, per Alejandro Saucedo's reporting. Anyone who sat through the last round of internal API sprawl has seen this scene before. A company with a mature API estate can now expose its backend to agents at almost no cost, and the scarce inputs move to governance, identity and context cost.
Uber built three controls into the gateway. Authorization for each tool runs through the company's existing access-control system. Sensitive data is redacted in transit. Every tool is registered disabled until someone explicitly turns it on. That last rule means someone above the team has to own which tools get enabled. A team that auto-generates tools without it has effectively handed its internal API catalogue to callers whose behavior nobody can fully predict. Saucedo also expects agent identity to stay unsolved for years, covering both how a user delegates to an agent and how an autonomous agent stays inside its grant.
The gateway doubles as a hedge against model churn
Uber's gateway translates agent calls into the formats its existing backend already understands, so swapping the model behind an agent never touches backend integration. The design is model-agnostic by construction. A skeptic would call that ordinary abstraction-layer hygiene, and the skeptic is right. It still matters in a week when frontier prices converged and one of them carried an introductory label.
The constraint Uber hit at scale was context bloat: agents hauling too many tool descriptions and oversized responses into every call. The fixes were cost engineering. Agents discover tools incrementally and request only the response fields they need. In a "code mode," coding agents write output to files instead of the model's working memory. The volume of context sent will move agent unit economics more than model selection, and Saucedo supplies the arithmetic: at Argon's post-introductory list price, one maxed-out 1M-token output costs $20.
Where the evidence agrees, and where to discount it
TheSequence's research roundup points the same way. NVIDIA and KAIST's Mid-Harness lifted a small 9B-parameter agent from 50.00% to 68.03% first-try success by having a frontier model check candidate actions before they ran. Microsoft and KAIST's CorpusMap improved enterprise retrieval by 6.45 to 11.74 points while using 43% to 65% of the input tokens. In both cases the gain came from the harness (the checks, routing and data navigation around a model). Architecture Notes reports the same pattern inside Anthropic, where a two-week sprint cut claude.ai's time-to-type at the 75th percentile from 3.1 seconds to 0.55 seconds. The gains came from reliable benchmarks, real-user latency checks and automated regression gates, with humans vetoing complexity that wasn't worth the milliseconds.
Saucedo adds the warning this kind of result always needs. A Google Research and Stanford paper found that harnesses tuned repeatedly against one test set lose much of their gain on tasks they were not tuned for. The paper's regularized method posted the smallest in-house gain and the best score on unseen tasks, 43.6 against 39.7 for the baseline. Any team's harness wins measured on its own evals are best read as partly overfit until held-out data confirms them.
The move
OpenAI's Dots converts this from an architecture question into a deadline, because enterprise access arrives when an admin flips a switch. The sequence that holds up is enablement policy first and gateway second; a company that reverses it will spend the following quarter deciding retroactively which tools should have been on. Uber built in-house because it has Uber's engineering bench. Most companies are better placed to assemble the pattern from open-source and commercial parts: a registry, a gateway, an identity broker (Zalando has open-sourced one) and a disabled-by-default rule.
The durable split is renting the model and owning the gateway, because the gateway is what lets a company switch models without rewiring itself.
What to do
Issue an agent-enablement policy this week, owned by the CISO and CIO, that keeps OpenAI's Dots and @ChatGPT switched off in Slack and Teams until approved connectors, permission scopes, spend caps, audit logging and a kill switch are defined.
Have the CTO charter one centrally owned agent gateway this quarter, with every agent-exposed tool disabled by default and tied to existing access control, and route all production agent traffic through it.
Require held-out evaluation data, frozen before tuning begins, for every harness or prompt-optimization gain reported to leadership, starting with this quarter's reviews.