TODAY IN NUMBERS
TECHNOLOGY · SATIRE · BEST-CASE EXTRAPOLATION

Gartner Says Open Models Cost a Twentieth of a Frontier Model, Except When They Are Used

A new Gartner note puts 90 per cent of enterprise agent workflow steps on open-weight models by 2030. The twentyfold saving becomes five or six once the models start answering.

Nine in ten of the steps in an enterprise agent workflow are routine, and open-weight models can handle them at the same quality for a quarter of the price of the cheapest closed model, according to a new document from the analyst firm Gartner.

The paper, "Open-Weight Models Will Run 90% of Enterprise Agentic Workflow Steps", was written last week by the firm's senior director Mark Petty and group vice president Raymond Paquet, and was reported by The Register.

"Nine in 10 agent workflow steps are routine, and open-weight models handle them at parity for a quarter of the price of the cheapest closed model," the pair write. They describe typical operational workflows as involving "hundreds of routine executions, such as classification, tool calling, passing, validating and reconciling data".

Open-weight models, they argue, "can handle hundreds of these routine steps for every one that needs frontier reasoning". Their strategic planning assumption is that "by 2030, 90% of enterprise operational agent workflow steps will execute on open-weight models".

The cost case is stated in two figures. "Against the cheapest closed model at the same score, the open model costs a quarter as much. Against a frontier model run on every step, it costs as little as a twentieth," they write.

They then qualify it. "Current open models can be more verbose and retry more often, so the saving per task against a frontier model is closer to five or six times," the pair add.

The analysts rate the saving as a by-product rather than the point. "Years of workflow history are a large part of what an acquirer pays for in a SaaS company and every routine step sent to a frontier API moves a slice of it outside your perimeter," they write. "Open-weights preserve your control. The cost saving is a bonus."

They expect enterprises to adopt mostly domain-specific open-weight models, which do well where "a small number of highly stable steps run millions of times a month". Models themselves, the paper suggests, are already commodities; the value sits in the harnesses that run agents and route each job to a suitable model without the user noticing. Frontier models remain the engine of research and development, effectively a capital expense, with open-weight models an operating expense afterwards.

The two cost figures in the paper are worth holding side by side. A twentieth is what the open model costs when it is compared with a frontier model. A fifth or a sixth is what it costs when it is asked to do some work.

The difference between the two is attributed, accurately, to verbosity and retries. This newspaper notes that verbosity and retries are not flaws in the comparison. They are what the model does. The twentyfold figure is therefore a measurement taken of the model before it has said anything.

Read in that direction the paper becomes more useful than it first appears. The cheapest conceivable open-weight model answers once, briefly and correctly, which is also the description of the frontier model it is being compared against and priced at a twentieth of.

The harness is offered as the remedy, and on the paper's own logic it is the right one. A harness that routes each job to the most appropriate model will send any step that genuinely needs frontier reasoning to the frontier model, which is the one step in ten where the quoted saving does not apply and the only step anybody was worried about.

The Department of Unnecessary Research accepts the 2030 assumption without amendment, and observes that a forecast in which nine steps in ten are routine, and the saving holds only on routine steps, is a forecast about the steps rather than the models, and could have been filed before either kind of model existed.

SAVINGS CLAIMED IN THE GARTNER NOTEQUESTIONABLE ANALYTICS
100Best case vs frontier
28In practice vs frontier
20Vs cheapest closed model
Multiples quoted in the document, scaled to the largest (20 times = 100): as little as a twentieth of a frontier model, a saving "closer to five or six times" in practice, and a quarter of the cheapest closed model.
THE BORING FACT

In a document titled "Open-Weight Models Will Run 90% of Enterprise Agentic Workflow Steps", Gartner's Mark Petty and Raymond Paquet write that open-weight models handle routine agent steps at a quarter of the price of the cheapest closed model and as little as a twentieth of a frontier model, while acknowledging that in practice the saving against a frontier model is "closer to five or six times".

Source: The Register
OUR PROFESSIONAL CONCLUSION

Because the twentyfold saving disappears once verbosity and retries are counted, the figure describes the model before it answers anything, and the only open model that would achieve it is one that answers once and briefly, which is the frontier model it is being compared against.

REALITY CHECK · BEST-CASE EXTRAPOLATION

Unfortunately, there's a small problem.

Both numbers are real and measure different things: a price-per-token comparison and an observed cost per completed task. A saving that shrinks from twentyfold to fivefold under real workloads is still a saving, not a contradiction.

THE BS DETECTOR

Where did reality end?

Tap the paragraph where this story stopped being true. Then see where everyone else bailed.

 

READER CREDULITY METER

Did you believe this story before the twist?

Be the first reader to answer.

YOU WRITE THE CONCLUSION

Think you can end this story better than our analysts?

One deadpan conclusion, 280 characters at most. Start from the facts above and take them one step too far. Our editor picks the best one each morning, and it runs in the next edition.

280 left
No real people's private lives, no tragedy, nothing that accuses anyone of anything. Our editor reads every entry and prints one; the rest are never published.