legaltech.fyi Beta

The Op-Ed

The Infinite Compute Mirage

Legal AI vendors are burning millions on agentic tokens while law firms write blank checks, proving that software isn't eliminating overhead—it's just moving it to the cloud.

The legaltech.fyi editorial desk · 2026-09-24 ·3 min read

An AI-assisted editorial, reviewed by a human before publishing. It reasons over our own tracker data (and cited context). A point of view, not legal advice.

In June, legal tech darling Harvey saw its gross margins collapse from 50% to negative 50%. The startup was burning through compute so fast that every time a lawyer asked its agentic workflows to analyze a matter, Harvey effectively paid for the privilege of serving them. The vendor eventually patched the bleeding by swapping underlying architectures to an open-weight model post-trained on Moonshot AI's Kimi K3, but the underlying arithmetic remains exposed.

We are watching a massive, industry-wide shell game. The narrative sold to managing partners was simple: replace expensive human hours with high-margin software subscriptions, pocket the difference, and watch efficiency soar. Instead, agentic AI tools fan out across firm repositories, consume trillions of tokens, and generate astronomical cloud infrastructure bills. The overhead hasn't disappeared. It merely shifted from associate salaries to server farms.

The tech industry didn't liberate legal practice from tedious labor. It simply replaced associate overtime with a permanent tax paid directly to cloud providers.

The Illusion of Software-Scale Margins

The bull case for legal tech rests on the assumption that vendors can achieve traditional enterprise software economics. Legora is reportedly seeking funding at an $8.5 billion valuation after passing $100 million in ARR, while Chamelio secured $26 million to replace contract management systems with autonomous agents. Meanwhile, reporting by CodeHistory highlights how Harvey reached a $15.5 billion valuation backed by 80% of the Am Law 100.

That market exuberance ignores basic unit economics. Traditional SaaS platforms scale with near-zero marginal cost per user. Agentic legal tools do the exact opposite. As TBPN Digest reported, Harvey’s token consumption spiked 20-fold as lawyers transitioned from basic single-prompt queries to reasoning-powered agents that churn through entire matter histories. Selling flat per-seat subscriptions on top of hyper-metered compute foundations is a guaranteed way to lose money.

Firms Are Funding the Compute Burn

Law firms are not insulated from this burn; they are aggressively bankrolling it. Morgan & Morgan committed $1 billion over a decade toward its proprietary MX2 platform, while Kirkland & Ellis pledged $500 million to build internal tools alongside Palantir. These are eye-watering figures spent to build internal engines that face the exact same token-consumption realities as commercial vendors.

As bestlawfirms.com noted, recent industry commentary highlights that legal AI adoption has done nothing to kill the billable hour, with law firm revenues climbing nearly 12% in early 2026. The real cost burden sits in implementation and compute. When an agent loops endlessly through discovery sets, someone pays for those tokens. Today it is the venture-backed vendor taking the loss; tomorrow, those costs will be passed down directly to law firm tech budgets via metered pricing and hard usage caps.

A Cloud-Provider Tax on the Practice of Law

Worse still, these runaway compute costs buy zero immunity from professional liability. The Tenth Circuit recently proposed a rule requiring lawyers to certify human verification of AI-assisted filings, spurred by hallucinated submissions that earned one attorney a $1,000 sanction. Federal courts are making clear under Rule 11 that no amount of agentic token burn excuses a lawyer from independently verifying the record.

So where does that leave the working practitioner? You are paying thousands per seat for software that burns through compute like a furnace, only to spend your own unbillable hours double-checking its math to avoid getting sanctioned by a federal judge. The tech industry didn't liberate legal practice from tedious labor. It simply replaced associate overtime with a permanent tax paid directly to cloud providers.

From the archive

courts 2026-09-21 · 3 min read
Judges Can Hallucinate Rulings With Impunity. Why Are Lawyers Financed for AI?

A troubling double standard is emerging in federal court: absolute immunity for judicial AI errors, but strict liability for the bar.

Read the op-ed →
risk 2026-09-17 · 2 min read
The Ninety-Nine Cent Pass

Sanctions designed to dodge state bar reporting prove partners are treats hallucination checks as an associate chore rather than a supervisory duty.

Read the op-ed →
money 2026-09-14 · 2 min read
Big Law’s Executive AI Hiring Spree Isn't Innovation. It's Asset Creation.

Firms are spending half a billion dollars on proprietary software and executive talent to manufacture capital assets before the billable hour collapses.

Read the op-ed →
money 2026-09-10 · 3 min read
The Board Wants AI Right Now, but Nobody Left a Credit Card on the Desk

Corporate mandates to deploy legal software without new capital are cannibalizing existing operations while transferring unchecked risks onto in-house counsel.

Read the op-ed →
practice 2026-09-07 · 4 min read
Big Law’s Equity Model Just Met Its First Structural Competitor

When the former head of Sidley Austin trades an equity partnership for an AI firm, the vendor era is officially over.

Read the op-ed →
money 2026-08-27 · 3 min read
Law Firms Are Spending Millions on AI for an Audience of None

Procurement budgets are soaring based on vendor promises, while nobody inside the building is tracking whether any of it actually works.

Read the op-ed →
courts 2026-08-24 · 3 min read
Judges Get Immunity for AI Misuse While Lawyers Get Sanctioned

A federal court just ruled that judicial immunity protects judges who delegate decisions to AI, creating a dangerous double standard.

Read the op-ed →
risk 2026-08-20 · 3 min read
Your New AI Assistant Has a Memory. That Is a Malpractice Trap.

Persistent context across Word and Outlook solves your prompt fatigue, but it quietly shreds client confidentiality if you do not clear the cache.

Read the op-ed →
money 2026-08-17 · 3 min read
The $1.5 Billion AI Copyright Tax Will Kill Legal Tech Innovation

Anthropic’s record settlement draws a fatal distinction that prices boutique startup models out of the courtroom.

Read the op-ed →
practice 2026-08-12 · 4 min read
AI research is useful only after the lawyer verifies it

A new comparison study should end the sales pitch that legal AI replaces research instead of sitting in front of it.

Read the op-ed →
money 2026-08-05 · 3 min read
AI in law will reward proof, not enthusiasm

The firms that win will be the ones that can show where AI saves time, where it creates risk, and how that changes pricing.

Read the op-ed →
practice 2026-08-05 · 4 min read
UP’s AI ban gets the training question backwards

A first-year ban on generative AI may look cautious, but lawyers will not be entering a profession that lets them avoid the tool, only one that punishes them for trusting it blindly.

Read the op-ed →
courts 2026-08-05 · 5 min read
Courts are done treating fake AI citations as a slap on the wrist

The new Uprise sanction matters because it looks less like an embarrassment and more like the start of a repeatable discipline model for lawyers who file AI output without checking it.

Read the op-ed →
practice 2026-08-05 · 4 min read
Law firms should make AI training mandatory, not optional

Pinsent Masons’ safeguards, a wave of firm-side AI promotion, and recent sanctions all point to the same fix: supervised training has to become part of ordinary professional duty.

Read the op-ed →
courts 2026-08-04 · 3 min read
AI citation sanctions need to hurt more

California’s latest $10,000 fine shows the fake-citation problem is no longer a one-off embarrassment; it is a repeated professional failure that courts should punish publicly and hard.

Read the op-ed →
risk 2026-08-04 · 4 min read
AI filings are getting lawyers disciplined for a reason

The lesson from this week’s sanction cluster is simple: if AI drafts it, somebody must verify it before it leaves the building.

Read the op-ed →
courts 2026-08-04 · 4 min read
AI citation sanctions are becoming malpractice by another name

The courts are no longer treating fake AI citations as an embarrassment. They are building a repeatable sanctions routine, and lawyers who keep filing unverified output are doing it on purpose.

Read the op-ed →
practice 2026-08-01 · 4 min read
Texas just made the AI privilege fight about proof, not panic

A Texas Business Court minute entry did not bless ChatGPT as magic. It treated the chat log like work product, which leaves lawyers with the old questions: what was shared, who saw it, and whether anyone preserved the record.

Read the op-ed →
Get the op-ed in your inbox
Our take on law and AI, plus what actually moved, on the weekdays you choose.