Gil Allouche
← All writing
ReferenceRunning a company with AI

What AI can actually do for a business, and what it costs

The four things AI does inside a company, each with a measured result, what a triage agent costs per run, and the two jobs I would not hand it.

September 19, 2026·Gil Allouche·10 min read
A reference explainer. Every factual claim links to its source; where this is an opinion from operating experience, it says so.

The answer, and the two price tags behind it

OpenAI sells the same model at half price if you can wait 24 hours for the answer (Batch API). Anthropic charges a fraction of the base input rate for tokens it reads out of cache instead of processing fresh (prompt caching docs). Those two lines on two pricing pages say more about what AI can do for a business than any capability list:

AI moves a specific class of work — reading, drafting, classifying, and multi-step tool use over text — from being priced in salaried hours to being priced in tokens, and your job is to find the workflows that survive being done by something fast, cheap, non-deterministic, and sometimes confidently wrong.

That is the whole answer.

Four capabilities that have measured results, not anecdotes

I built Metadata.io from $0 to $15M ARR on machine-driven campaign execution and hold six patents in AI-driven marketing, and I am building a zero-human company now — agents doing the work, me paying the bills. So I have opinions. They are worth less than the handful of things that have actually been measured in a controlled setting.

CapabilityMeasured resultWhere it stops
Writing and revising codeDevelopers given GitHub Copilot completed a standard HTTP-server task 55.8% faster than the control group (arXiv:2302.06590)One scoped task, not a codebase migration; review load moves to the human
Handling support conversationsAcross 5,179 agents, an LLM assistant raised issues resolved per hour 14% on average and 34% for the least experienced (NBER w31161)Gains concentrate in novices; experienced agents gained little
Classifying and routing unstructured inputConstrained decoding makes output conform to a supplied JSON Schema (OpenAI structured outputs)Schema conformance is not correctness. A well-formed wrong label still routes the ticket wrong
Running multi-step work with toolsMETR measured a 50%-success time horizon of roughly one hour of human-equivalent task length, doubling about every seven months (METR, March 2025)50% success. Half the hour-long tasks fail

Read the last row twice. It is the single most useful number in this field for an operator. An agent chain that needs eight hours of unattended judgement is not a product yet; an agent that does a twenty-minute job and hands back a diff is.

Audio is the quiet one. Transcription runs at a listed $0.006 per minute on OpenAI's pricing page — roughly thirty-six cents an hour of recorded speech. Every sales call, support call, and interview your company has ever recorded is now searchable text for less than the coffee budget.

Where the money shows up, and where it usually doesn't

The headline case is public and self-reported. Klarna said its AI assistant handled 2.3 million conversations in its first month — about two-thirds of chats — cut average resolution time from 11 minutes to under 2, did the equivalent work of 700 full-time agents, and was expected to drive a $40M profit improvement in 2024 (Klarna press release, Feb 2024).

Treat that as a company statement, not an audit. It is a press release, published by the company, with no methodology attached.

My position: headcount reduction is the least reliable place to look for AI return, and coverage is the most reliable. Headcount savings require the AI to be as good as the person it replaces on the hard 10% of cases, which is exactly where the METR 50% number bites. Coverage requires only that the AI be better than nothing, because nothing is what you currently do.

So the work that gets funded first in a company that already knows its numbers is unglamorous. Every support ticket gets read and tagged instead of a 2% manual sample. Every recorded sales call gets a structured summary scored against your own qualification fields. Every inbound lead gets enriched and researched before a human sees it, at a marginal cost measured in cents. Nobody was ever going to staff any of that, which is the point: none of it fires anyone, and all of it produces a dataset you did not have last quarter — the input to every later automation decision. Adoption is still early enough that this is a real edge rather than table stakes. Fewer than one in ten U.S. firms reported using AI to produce goods or services in the Census Bureau's Business Trends and Outlook Survey through 2025.

The cost side has been moving in your favour hard. The 2025 AI Index reports a roughly 280-fold drop in the inference cost of reaching a GPT-3.5-level score between November 2022 and October 2024 (Stanford HAI). A workflow you priced out as uneconomic in 2023 is trivially cheap now. Re-run the arithmetic before you conclude anything.

What a working agent actually costs per run

Here is a scenario worth pricing: a ticket-triage agent. It reads a support ticket, pulls the customer record, searches your docs, decides a category and priority, and writes a suggested reply. Call it six model turns, about 8,000 input tokens per turn once you count the system prompt and retrieved context, and 700 output tokens. Run it on 20,000 tickets a month.

Move the sliders and the model picker. The point is not my numbers — it is the shape of the curve when you change model tier.

What would this cost you?
40
15,000
5,000
per run
$2.70
full pass
$13,500

Arithmetic on published list prices. Retries are billed too, so a step that fails twice before working costs three times this.

Three levers change the total more than any prompt engineering.

LeverWhy it moves the billThe catch
Model tierA mini-tier model listed at $0.15 per million input tokens and $0.60 per million output on OpenAI's pricing page against a frontier model is a 10–30× swingMost triage steps do not need frontier reasoning. The final drafting step does
CachingA long, stable system prompt re-sent on every turn is the most common source of waste; Anthropic prices cache reads at a fraction of base input tokens (docs)Cache writes carry a premium, so caching only pays if the prefix is genuinely reused
BatchingOpenAI's Batch API is 50% off with a 24-hour windowNothing interactive. Overnight enrichment, backfills, and nightly report generation belong here; nobody is waiting

The thing that wrecks a budget is not the per-token price. It is turn count. An agent that should take six turns and takes sixty because it keeps re-reading the same page has multiplied your bill by ten and produced nothing.

The failure modes you are buying

Unbounded loops. The most common production failure in tool-using agents is the model repeating a step, re-reading the same source, or ping-ponging between two tools until something runs out. The fix is a hard step cap and a wall-clock timeout enforced outside the model, in the orchestration layer — not requested politely in the prompt. Durable-execution systems exist for exactly this: timeouts, retries, and idempotency keys as infrastructure (Temporal docs).

Prompt injection through retrieved content. If your agent reads a web page, an email, or a PDF a stranger wrote, that text is now instructions competing with yours. Prompt injection and insecure output handling are the top entries in the OWASP Top 10 for LLM Applications for a reason. Any agent with both untrusted input and a write-capable tool is one crafted sentence away from doing something you did not ask for.

Schema-valid nonsense. Structured outputs guarantee the shape, not the truth. You need a validation step that checks values against reality — does that customer ID exist, is that refund amount inside policy — before anything is written anywhere.

You own the output. Legally and commercially, the company is responsible for what its automated system says and does. The EU AI Act entered into force on 1 August 2024 with obligations phasing in on a published schedule (Regulation (EU) 2024/1689), and NIST's AI Risk Management Framework exists as a public way to document what you decided and why. Write the decision down before an incident, not after.

Every automation decision reduces to two dimensions: how expensive it is to undo, and how fast you can tell whether it was right.

Decision boundary for handing work to an agent, by reversibility and verification costUnattended agentticket tagging, enrichmentAgent, sampled auditresearch memos, draftsAgent plus approvalrefunds, code mergesKeep it humanpricing, contracts, firingsecondshoursVerification costcheap undono undoReversibility

Top-left is where you start. Bottom-right is where pilots go to die.

What I would not use

I would not give an agent spend authority. Not a card, not an ads budget, not a procurement flow. I took Metadata.io through $50M of raised capital and I am running autonomous agents in production on my own projects today, and I still put irreversible money movement behind a human approval or a hard-capped, pre-authorised limit. The reason is the loop failure above: the same bug that burns sixty turns instead of six burns sixty thousand dollars instead of six thousand.

I would not start with a multi-agent swarm. The default architecture people reach for — a planner, a researcher, a critic, a writer — multiplies token cost and failure surface before anything works once. Anthropic's own engineering guidance says to find the simplest composition that solves the problem and only add agentic complexity when simpler patterns fall short (Building effective agents). One model, three tools, a step cap. I wrote up the honest version of what a multi-agent system is and is not in multi-agent systems, defined without the hype, and the minimum viable build in three tools, a step cap, a JSONL note.

I would not buy a platform that hides the prompt and the logs. If you cannot see the exact prompt sent, the tool calls made, the tokens spent per run, and the failures, you cannot debug it and you cannot price it. That is not a vendor preference. It is the difference between an asset and a black box you rent. For tool plumbing, Model Context Protocol is the open option worth standardising on rather than a proprietary connector format.

I would not automate a process nobody can describe. If a human cannot write down the inputs, the tools, and the pass/fail check for a task, an agent will not discover them. Ambiguity is not a prompt problem.

I would keep GUI-driving agents off systems of record. Pixel-level computer use is real and occasionally the only option for software with no API, but the error modes are worse — a misclick writes to the wrong field with no schema to catch it. The trade-offs are in a computer use agent drives a GUI with pixels, not APIs.

Where humans stay, judged task by task and not by job title

"Can AI do sales?" is the wrong shape of question. Prospect research, list building, call summarisation, CRM hygiene, and first-draft follow-up are all in the top-left quadrant above. Negotiating a non-standard contract term with a customer who is already annoyed is not. Split the role into tasks and score each one on reversibility and verification cost, which is what I do in will sales be replaced by AI? Answer it task by task.

The same logic settles the strategic question underneath all of this. If your competitor can call the same model, on the same public pricing page, with a similar prompt, the model is not the advantage. What survives is your proprietary data, your distribution, your workflow depth, and the accumulated record of which automations worked — a point I argue in an AI moat is what survives when your rival uses your model.

The part I would act on this week is instrumentation. Every agent run should write one line: inputs, tools called, turns used, tokens in and out, outcome, and whether a human had to fix it. It costs nothing but the decision to log it. Without that file you are guessing, and guessing is the most expensive thing in the stack.

Sources

  1. OpenAI Batch API guide50% discount and 24-hour completion window for batched inference
  2. OpenAI API pricingPer-million-token prices for mini-tier models; Whisper per-minute audio price
  3. Anthropic prompt caching documentationCache reads priced at a fraction of base input tokens; cache writes at a premium
  4. OpenAI structured outputs guideSchema-guaranteed model output, which is what makes classification results machine-usable
  5. METR — Measuring AI Ability to Complete Long Tasks50%-success time horizon of roughly one hour and the ~7-month doubling trend
  6. The Impact of AI on Developer Productivity: Evidence from GitHub Copilot (arXiv:2302.06590)Controlled trial: 55.8% faster task completion with Copilot
  7. Generative AI at Work (NBER Working Paper 31161)14% average productivity gain for customer support agents, 34% for the least experienced
  8. Klarna press release on its AI assistantCompany self-reported volumes, resolution-time change and profit-impact estimate
  9. Stanford HAI AI Index Report 2025Inference cost decline for a fixed capability level between Nov 2022 and Oct 2024
  10. Anthropic — Building effective agentsVendor guidance to start with the simplest composition before multi-agent systems
  11. OWASP Top 10 for LLM ApplicationsPrompt injection and insecure output handling as catalogued risk classes
  12. Regulation (EU) 2024/1689 (AI Act), EUR-LexEntry into force and phased application dates for obligations
  13. NIST AI Risk Management FrameworkPublic framework for documenting AI risk decisions
  14. Model Context ProtocolOpen protocol for exposing tools and data to models
  15. Temporal documentationDurable execution, retries and timeouts enforced outside the model
  16. U.S. Census Bureau Business Trends and Outlook SurveyFirm-level AI use in producing goods and services

Related