A Router Is a Default Waiting to Happen

Open-weight models are about 25% of AT&T’s AI usage today. Its chief data and AI officer told the Wall Street Journal he expects 70 to 80%, and AT&T already runs a smart router that picks a model per task.

Two days ago Bloomberg reported that Stripe has agreed to buy OpenRouter for over $7 billion (16 August, and Axios puts it closer to $8 billion). Neither company has confirmed it, and Stripe says it does not comment on rumors or speculation.

OpenRouter runs more than 400 models behind one API and charges 5.5% on credit purchases rather than a markup on tokens, so Stripe may have bought a payments business rather than a router. Nobody has said why. What a router does have is the only view of what everyone else spent on tasks like yours, and that view is what turns a choice into a default.

Open weights are what made this choice possible. The question is whose criteria collapse it back down.

The choosing is still the user’s problem. Anyone running multiple subscriptions alongside a local model picks the model, the reasoning level, the tools, and whether the frontier one is worth paying for, before most tasks. That is a routing decision made by hand, several times a day, on no evidence.

Part of the answer is published. BEST-Route (Ding et al., ICML 2025, peer reviewed) routes each query to a model and a sample count based on difficulty, cutting cost up to 60% with under 1% quality loss.

Note what quality means there: a reward model scoring the answers, no human in the measurement at all. It does not price what the answer cost a person to check.

That unmeasured cost is the one I care about. Overseeing a system rather than running it carries its own burden, and it descends from Sheridan’s 1978 supervisory control work. A model that costs pennies but needs five minutes of verification is not the cheap one. Token price prices the model, not the system.

Shneiderman and Maes staged this argument in 1997: should software act for you, or keep you deciding? They never settled it. The $7 billion is the market answering one version of it without the argument.

Source:

Similar Posts