I've been building on top of large language models since GPT-3 was the shiny new thing, and if there's one lesson that never stops being true, it's this: the ground under your unit economics moves more than most people building "AI wrapper" businesses like to admit. The latest reminder came via OpenRouter's listing for GPT-5.6, which landed with roughly half the token price of its predecessor. Same model class, same capability tier, half the cost of running it.
That's not a rounding error. That's the kind of shift that quietly rewrites what's possible for anyone running a product where the AI call is the product.
Why this matters more than the headline suggests
Everyone in this space watches capability benchmarks. Fewer people watch the price-per-million-tokens line, and that's a mistake, because for a working SaaS the price line is the one that actually shows up on your P&L every month.
When inference costs halve, three things become true almost overnight:
Your margins improve if you do nothing. If you were running BookMasher or MarketMasher on the previous generation and swap in the cheaper model at the same quality, your COGS drops and your margin widens. Free money, in a sense — though I'd never trust "free" without testing quality first.
Your competitors' floor drops. If a price war starts on the tools layer (and it will, because everyone's margin just improved), the market price customers expect to pay can fall. You need to decide fast whether you're pocketing the saving or passing it on to win volume.
Things that were previously too expensive to offer become viable. This is the interesting one, and it's where I spend most of my thinking time.
What becomes possible that wasn't before
Halved inference cost doesn't just make existing features cheaper — it changes what you can afford to attempt. A few examples from my own stack:
With Article2Video, generating multiple script variants and picking the best one via a second AI pass used to be a luxury feature I'd gate behind a higher tier. At half the cost, it becomes something I can offer by default, because the economics finally support doing more work per customer request rather than less.
With BookMasher, multi-pass editing — draft, critique, rewrite, polish — was always the dream. The honest reason most AI writing tools ship a single-pass output is that multi-pass costs money at scale. When the per-call cost drops, four passes cost what two used to. That's not a marginal improvement to a feature list; that's the difference between "AI-assisted" and something that actually reads like it's been edited.
With RSSMasher and the aggregation-heavy tools, cost per item processed matters enormously because volume is the whole point. A price cut there means I can either process more sources for the same spend or add a quality layer — sentiment filtering, better summarisation, duplicate detection — that wasn't previously worth the margin hit.
The trap: don't just bank the saving
Here's where I'd caution anyone running an AI SaaS right now. The lazy move is to swap the model, watch your margin improve, and leave your product exactly as it was. That works for about six months, until a competitor uses the same saving to add features you don't have, or undercuts your price, or both.
Falling inference costs are deflationary for the whole category. If you don't reinvest the saving into either better output or lower price, someone else will, and they'll take your customers doing it. I've watched this pattern play out with cloud compute, with stock imagery APIs, with translation services — the tools that survived the price drops were the ones that used the headroom to get better, not just cheaper to run.
What I'm actually doing about it
Practically, this means running quality evaluations against the new pricing tier before switching anything in production — cheaper is only useful if the output holds up. Where it does, I'm looking at where extra AI passes genuinely improve output rather than just padding the process. And I'm resisting the urge to drop prices reflexively before working out whether the market actually wants cheaper tools or better ones. In my experience it's almost always the latter.
Inference costs will keep falling. That's the one certain trend in this whole industry. The people who win aren't the ones who spot the price cut first — they're the ones who work out fastest what new gold they can make from the same raw content now that it costs half as much to run through the furnace.
— Wayne