The AI Paradox: Models Keep Getting Cheaper, Yet Budgets Keep Rising. How to Control AI Costs Across the Enterprise.

AI models are becoming increasingly affordable, yet companies are spending more than ever. Discover why AI agents can consume up to 30 times more tokens than chatbots—and how to take...
Categoria: Data & AI

AI model providers are competing aggressively on price, and Gartner predicts that inference costs will fall by 90% by 2030. Yet enterprise AI bills continue to rise. The reason is simple: a single enterprise AI agent can consume up to 30 times more tokens than a chatbot, and without process-level monitoring, that consumption can quickly spiral out of control.
In this article, we explain why lower model prices alone won’t solve the problem, what the Uber case teaches us about cost governance, and the practical steps Operations leaders should take before their next AI contract renewal.

Artificial intelligence model providers are engaged in an intense price war. For example, Grok 4.5 costs around 60% less than Anthropic’s comparable models, while Gartner forecasts a 90% decline in inference costs by 2030 (Source: Gartner, 2026).

Yet enterprise AI bills continue to rise.

Il motivo non è che l’AI sia diventata troppo cara, ma che pochissimi la stanno governando: un agente aziendale consuma fino a 30 volte più token di un semplice chatbot e, senza un monitoraggio puntuale per singolo processo, quel consumo cresce in modo incontrollato.

Why Cheaper AI Models Don’t Mean Lower Enterprise Costs

The public price of an AI model tells only half the story. While the cost per token will continue to decline, the volume of tokens consumed is expected to grow far faster than prices fall (Source: Gartner, 2026).

È la stessa dinamica già vissuta con il cloud computing: sconti pubblicizzati sulla carta, ma fatture complessive più alte a fine mese perché il consumo reale cresceva più in fretta dello sconto. La disciplina nata da quell’esperienza — il FinOps — è oggi il punto di riferimento per applicare lo stesso livello di controllo e trasparenza alla spesa AI.

Organizations that evaluate AI contracts based solely on the price per token are overlooking the bigger picture—and are likely to face unpleasant surprises when the bill arrives.

An agent is not a chatbot

This is the blind spot that most organizations underestimate. Gartner quantifies it clearly: agentic AI models require between 5 and 30 times more tokens per task than a standard generative AI chatbot.

This is far more than a technical detail—it can mean the difference between an AI budget that remains under control and one that is exhausted within the first quarter. Consider Uber‘s experience: the company reportedly depleted its annual AI budget within the first four months of 2026, forcing it to introduce a monthly spending cap of $1,500 per AI tool (Source: Tom’s Hardware).

Uber’s mistake was not adopting AI agents—it was scaling them without first establishing a clear process map and well-defined consumption metrics. Traditional pricing models, whether based on fixed licenses or linear per-user growth, are not suited to a technology whose costs are driven by process usage intensity rather than by the number of people using it.

The Real Constraint Isn’t Price—It’s Governance

Reducing licenses or cutting user access across the board is not an effective solution, because AI costs vary depending on which agent is running, which process it supports, and the volume of requests it handles.

Maintaining control requires process-level monitoring:

  • Which workflows generate the highest volume of API calls?
  • Which complex tasks could be handled by a smaller, more specialized model?
  • Which agents are consuming budget without a designated business owner accountable for them?

This is exactly the principle behind our Assessment phase in the journey toward becoming an AI Company: before releasing or scaling an agent, we map the underlying process—data, capabilities, and bottlenecks—to understand where AI creates real value and where it simply drives unnecessary computational consumption.

Multi-Model Routing: The Structural Solution

Gartner indica chiaramente la via d’uscita: instradare i task ordinari e ad alta frequenza verso modelli piccoli e focalizzati (SLM), riservando i modelli frontier (più potenti e costosi) solo ai compiti ad alto valore strategico. Pagare il prezzo pieno per un’attività ripetitiva è uno spreco che si moltiplica per centinaia di migliaia di esecuzioni al mese.

Mentre molti fornitori enterprise mettono oggi a disposizione router tecnici preconfigurati, la vera sfida resta strategica: serve definire i tetti di spesa per processo e nominare un Process Owner che ne monitori i KPI mese per mese. È la stessa logica con cui progettiamo i nostri agenti verticali come Shopfloor AI: strumenti verticali pensati per compiti precisi di fabbrica, capaci di operare in modo efficiente senza drenare risorse su modelli sovradimensionati.

Three Concrete Actions for Operations Teams (Before the Next Renewal)

If you lead Operations or are preparing to renew your company’s AI contracts, here are three key steps to take:

  1. Map workload by process, not by user: Identify which activities will rely on AI agents over the next 12 months, estimate average token consumption, and set a maximum spending threshold.
  2. Include quarterly review clauses: Negotiate a spending cap review based on actual consumption data recorded during the first months of usage.
  3. Assign a Process Owner to each agent: An agent without a clearly accountable owner becomes a silent cost that no one will ever monitor.

In Conclusion

The decline in official AI model prices is good news only if token consumption remains stable. In a real enterprise environment, however, usage volume grows with every new agent introduced.

Before signing the next contract or deploying a new agent, the golden rule is simple: map processes first, then set the budget with full awareness—rather than discovering the real cost after the fact.

At AzzurroDigitale, we help companies navigate this exact challenge: supporting them through the Assessment phase to define where, how, and with what expected returns AI agents should be integrated into their operational workflows.

Frequently Asked Questions (FAQ)

Why are enterprise AI costs rising if model prices are falling?

Because the price per token is falling, but the volume of tokens consumed is growing faster as companies adopt AI agents, which require far more calls than a chatbot. Without monitoring, consumption rises faster than the discount.

How many tokens does an AI agent consume compared with a chatbot?

According to Gartner, an enterprise agent can consume 5 to 30 times more tokens than a standard generative chatbot for the same task, because it has to reason over several steps, query systems and check results.

What is FinOps applied to artificial intelligence?

It is the discipline, born in cloud computing, that brings transparency and continuous control to spending: in the AI context it means monitoring token consumption per process, not just the model’s list price.

How can companies reduce the cost of AI agents?

By mapping processes before scaling, routing repetitive tasks to smaller models (multi-model routing), setting spending caps per process and assigning a Process Owner to every active agent.

Share on

Facebook
X
LinkedIn
WhatsApp
Threads

You might be interested in

OEE: what it is, how to calculate it, and how to improve it

Data & AIDigital Transformation

From Data Swamp to Data-Driven

Digital TransformationData & AI

Everyone is talking about AI.

Few are truly ready to use it.

Find out where your company stands before you invest.