Product daily

Synthesized by Clarity (Claude) from 28 sources · May contain errors — spot one? [email protected] · Methodology →

OpenAI's 80% Luna Cut Is Built to Reprice in Two Quarters

Sources
28
Words
1,943
Read
10min

Topics Agentic AI LLM Inference AI Capital

◆ The signal

The cost floor under that rate card rose while the card fell, which makes the cut a concession that can be withdrawn rather than a new baseline. We've seen this shape of discount before: cheap tier now, quiet reprice once the compute contracts settle. The spread says what it's for. The discounted tier and Terra, the tier above it, now sit exactly 10x apart on input and output, a gap built to route traffic down-tier for roughly two quarters. If the migration you're planning assumes that rate card holds past two quarters, budget the withdrawal alongside it.

◆ INTELLIGENCE MAP

Intelligence map

  1. 01

    Token Prices Fell While Compute Costs Rose

    act now

    OpenAI cut GPT-5.6 Luna 80% to $0.20/$1.20 per million tokens and Terra 20% to $2/$12, leaving flagship Sol unchanged, per The Information's reporting. Every AI feature you shelved on unit economics since Q1 needs a re-score, because the low tier moved an order of magnitude. The complication is direction: a16z's chart pack puts 12-month H100 contracts just under $2.50 per GPU-hour, roughly 40% above November. The invoice relief is a vendor concession, not a falling cost base.

    10x
    low versus mid tier price
    7
    sources
    • Luna cut
    • Terra cut
    • H100 12-mo contract
    1. Luna output per 1M tokens$1.2
    2. Terra output per 1M tokens$12
  2. 02

    Cache-Hit Rate Now Beats Model Choice

    monitor

    DeepSeek shipped V4-Flash 0731 one day after the OpenAI cuts, scoring 50 on Artificial Analysis' index against Luna's 51 at roughly 60% lower cost per task, with MIT-licensed weights on Hugging Face the same day. The number that decides your bill is the cached-versus-uncached input spread on that rate card, which the pricing dive works through. Prompt-prefix stability becomes a spec line rather than an engineering preference: a timestamp at the top of a system prompt pays the uncached rate on every single request.

    50x
    cached versus uncached input
    3
    sources
    • AA index
    • Cost per task
    1. Cached input per 1M$0.0028
    2. Uncached input per 1M$0.14
  3. 03

    The Harness Outperformed Every Model Upgrade

    monitor

    Cursor moved cloud agents from about 10% of merged pull requests to more than half, and the dive below traces that jump to environment design rather than a model upgrade. Your agent success rate is capped by environment and pipeline design — both of which sit inside your own roadmap.

    38.3%
    up from 13.3% on ARC-AGI-3
    5
    sources
    • Cursor merged PRs
    • Token output
    1. ARC-AGI-3 before harness change13.3%
    2. ARC-AGI-3 after harness change38.3%
    3. SWE-Atlas QnA, single model32.3%
    4. SWE-Atlas QnA, four agents62.1%
  4. 04

    Prompt Injection Became A Permanent Constraint

    monitor

    Microsoft confirmed a self-propagating prompt-injection worm moving through Copilot-generated documents, and the technical postmortem calls the only complete fix — teaching a model to separate instructions from data — impossible today. That gap is a commercial opening: Pathlock surveyed agent auditability across finance, HR, procurement and supply chain, and the dive below sizes it. Any PRD line promising injection prevention will not survive an enterprise security review. Containment and audit trails are the claims you can defend.

    53%
    cannot verify agent actions
    6
    sources
    • Disclosure to patch
    1. Organizations unable to verify AI agent actions53
  5. 05

    The Autonomy Ceiling Got Quantified

    background

    Benchmark results put the best available agents at 43.5% on Terminal-Bench 3.0 business workflows, 26.2% on Zapier's computer-automation suite and 25.3% on diagnosing realistic production outages, with one model fabricating causes 40% of the time. Elastic-sponsored survey data has 70% of IT leaders expecting agentic productivity gains while fewer than 25% reach production. A roadmap item promising end-to-end autonomous completion is writing support tickets, not features.

    26.2%
    best computer automation score
    4
    sources
    • Computer-automation tasks completed
    1. Terminal-Bench 3.0 business workflows43.5%
    2. ARC-AGI-330.2%
    3. Zapier AutomationBench26.2%
    4. Production incident root cause25.3%

◆ DEEP DIVES

Deep dives

  1. 01

    The 80% Cut Is Rented Margin

    act now evidence: high

    The spread is the instruction, not the discount

    A platform PM opened the new rate card and backed out the pre-cut numbers. The decision was already sitting there. Luna and Terra used to sit roughly 2.5x apart ($1.00/$6.00 against $2.50/$15.00). They now sit exactly 10x apart on input and output both, per The Information's reporting. That is not a discount. It is a routing instruction. Anything left on the mid tier that a user cannot tell apart from the low tier is paid capability nobody sees.

    An agent session consuming 50k input and 5k output tokens runs $0.16 on Terra against $0.016 on Luna. A million sessions a month is $160k versus $16k. Free-tier limits rationed on inference cost may not need the ration anymore.

    Where the saving leaks back out

    Then two numbers say unit price is the smallest term in the cost equation. Amazon burned $1.8M on a single routine coding task, 860% over budget, and found out only afterward through internal AI usage metrics. Stripe named the mechanism when describing Kai, the internal knowledge platform most of its employees use: most Kai sessions require many turns. Turns-to-resolution sets cost per resolved task. Price per token does not.

    DeepSeek's rate card makes the point from the other side. V4-Flash 0731 charges $0.14 per million uncached input tokens and $0.0028 cached. No model choice repairs a 50x delta. An agent that serializes a fresh tool schema or a session ID into the top of its prompt pays the uncached rate on every request, forever. Artificial Analysis qualified its own Pareto-frontier claim on the near-99% cache-hit path, then publicly corrected a cache-hit calculation minutes after a screenshot of it circulated. That is a fair read on how few teams measure realized hit rate at all.

    The floor under the invoice did not move

    Here the sources genuinely disagree, and the disagreement is the intelligence. The Information reads falling API prices against inflating hardware as a reason to rent inference rather than self-host: Amazon lifted 2026 capex to $220B from $200B, which Andy Jassy attributed to memory chip costs, while Apple's CFO warned advanced chip constraints will increase significantly this quarter. a16z reads the supply side and finds the opposite for anyone modelling their own compute, with 12-month H100 contracts just under $2.50/GPU-hour, roughly 40% above November, Kalshi forwards near $2.78 and A100 spot merely stable rather than collapsing. a16z also dismantles the chart circulating as proof that AI demand is falling. Silicon Data's Token Cost Index measures token-spend intensity, so a mix shift toward cheaper tokens drags it down while B2B spend on Cursor, Anthropic and OpenAI rises in total and at the median across the four biggest-spending industries.

    Read together the picture is coherent. The token price on the invoice is a competitive concession, granted three weeks after launch in response to customer bill shock, and it is reversible. The compute underneath is not getting cheaper on any product timeline.

    A price cut you did not earn can be withdrawn. Cache-hit rate, turn count and spend ceilings are cost reductions you own.

    So the repricing exercise has a second half most teams will skip. Re-score the shelved features at the new rate card, then re-run the survivors at flat and +25% compute. Two questions decide the sprint: does the feature still clear at +25%, and does its cost scale with turns or with tokens. Features that only clear at today's prices belong on a shelf list with a named trigger, not in next quarter's commitment.

    Action items

    • Re-score every AI feature killed on unit economics since Q1 against the new low-tier rate card this sprint, then re-run the survivors at flat and +25% compute before scope locks.
    • Instrument realized cache-hit rate and turns-per-resolved-task on your two highest-volume AI surfaces this sprint, and report both next to activation and retention.
    • Ship hard per-job and per-workspace spend ceilings with a 50%-of-budget alert before any additional agent capability reaches GA.

    Sources:The Information AM · AINews · TLDR AI · a16z · Devshot · TLDR

  2. 02

    Your Best Agent Upgrade This Quarter Is Not A Model

    monitor evidence: high

    Four independent results, one shape

    An engineer kicked off a cloud agent, went to lunch, and came back to a branch that actually ran. Not because the model got smarter that morning. Cursor's headline number is what gets quoted everywhere; the mechanism is the part that transfers to another team. Its cloud agents did not get a better model. They got development environments an agent can discover state in, execute against, and verify deterministically. That is unglamorous, model-agnostic engineering. It compounds with every future price cut instead of being invalidated by one.

    The same shape shows up three more times. AgentRadio lifted SWE-Atlas QnA from 32.3% to 62.1% using asynchronous messaging across four agents, and beat a stronger single-model baseline doing it. Google's Chrome security pipeline pairs automated triage with a fixing agent, a critic agent, and test-writing agents verifying across every supported platform. It surfaced a sandbox escape that had been reading local files undetected for 13+ years. And decomposing an agentic task into guided steps succeeded 100% of the time against 50% for a single one-shot prompt.

    The cost side compounds with the quality side

    InterventionMeasured changeWhat it costs you
    Retained reasoning plus context compactionARC-AGI-3 13.3% to 38.3%, 6x fewer output tokensA harness change, no model migration
    Refactoring an AI-generated codebase83% less token consumption on subsequent updatesThe refactor window you have deferred four times
    Prompt-token reduction in agent frameworksLangChain cut Deep Agents prompt tokens 65%Dependency upgrade plus regression testing
    Post-training only, no architecture changeDeepSeek Terminal-Bench 56.9 to 82.7 at unchanged 284B/13BNothing — this is the vendor doing it for you

    OpenAI ran the same play internally, moving auto-review in ChatGPT and Codex CLI to the cheap tier for a 10x cost reduction. Worth separating the thing being pitched from the thing being done. The pitch is frontier capability. The work is routing and harness design. Across every one of these results, the gains are coming from everything except the model weights.

    Where it stops being free

    Two caveats belong in the planning doc intact. Microsoft's Echoverse work found that shallow evaluation environments actively hurt live-site accuracy while deeper ones improved it. So agent evals running in thin mocks may not merely be under-measuring quality. They may be degrading the thing being tuned against. An organization-owned eval suite with deeper task environments comes before a budget cycle spent on a more expensive model tier. The tradeoff is real and worth naming: that suite is months of work nobody demos.

    The second caveat is strategic and comes from swyx: if models can be distilled, agent harnesses can be distilled. Orchestration cleverness is not a moat. Proprietary environments and eval data are. Cursor's advantage is replicable by any competent team, including whoever competes with that team.

    There is also a downstream constraint most capacity models miss. The mid-2026 consensus on LLM coding productivity is 2x, not 10x, with the weakness localized precisely to reasoning about code structure and documentation. Meanwhile the delivery queue has moved from authoring to review. GitHub shipped stacked pull requests to public preview specifically because AI now generates more change than a human reviews in one sitting, and a single AI code-review vendor claims 2M reviews per week across 6M repositories. That gives the forcing function for this quarter. Generation throughput on one axis, review wait time as a discrete cycle-time stage on the other. Buying more of the first without instrumenting the second funds a longer queue.

    The reliability your team has been waiting on a model release to deliver is already available through decomposition, a critic pass, and an environment an agent can verify itself in.

    Action items

    • Rewrite your top agent epic from a single-prompt design into an explicit pipeline — decompose, generate, adversarial critic pass, machine-verifiable gate — and measure task success rate across at least 50 runs before and after.
    • Fund environment legibility as a named roadmap item this quarter: baseline agent task success rate, fix the three worst state-discovery and verification gaps, and track the metric weekly.
    • Instrument review wait time as a discrete stage — pull request open to first review to merge — as a share of total cycle time, before buying more code-generation capacity.

    Sources:TLDR AI · AI Breakfast · AINews · Devshot · TLDR Dev · Pointer

  3. 03

    Prevention Left The Menu; Auditability Is The SKU

    monitor evidence: high

    What the payload actually does

    An analyst opens a finished report, checks the figures, and forwards it. The numbers are wrong and nothing on the page looks unusual. Håkon Måløy's technique hides JSON instructions in white text at small font size inside a Word document. Copilot ingests them whether a user uploads the file or Copilot finds it in OneDrive and pulls it in as context. The result is not exfiltration. It is rewritten figures inside a finished report, with the same hidden instructions copied into the generated output file, so the payload spreads through ordinary document sharing. Disclosed in March, patched roughly 144 days later. Researcher and vendor agree the class remains viable with adjusted prompts.

    The product translation is narrow and cheap. Input filtering is the half every team builds. Almost nobody strips instruction-like content out of generated artifacts, and that omission is what converts one injection into worm-like spread. Output stripping belongs in the definition of done for any feature that reads a customer document and writes a new one.

    The verification market moved before the roadmaps did

    Pathlock's survey number is the commercial half of the story: 53% of organizations cannot fully verify what their AI agents do across finance, HR, procurement and supply chain, four of the most audit-sensitive process domains in the enterprise. Invert it. Roughly 47% say they can. The market has already split into haves and have-nots on agent auditability, and nobody has definitively solved it with runtime tooling.

    Capital is moving on that read. Okta is paying just under $200M for Permiso to monitor employees, service accounts, applications and AI agents after they authenticate, extending visibility into Microsoft Entra ID and Active Directory. The detection evidence is unflattering: of the three organizations reached during frontier-lab evaluation runs, two never detected the activity themselves. Enterprise monitoring stacks are blind to agent-driven activity. That is a demand signal with a price attached. Per-action, per-identity, SIEM-exportable agent logs plus a hard agent-memory reset, packaged as an enterprise tier rather than shipped as telemetry.

    Three spec assumptions that no longer hold

    • Guardrails catch bad tool calls. Agents chain individually benign steps into a full exploit, so single-action filtering misses it. The requirement is sequence-level trajectory scoring. That is a quarter of architecture work, not a sprint.
    • Our integration surface is fine. Researchers disclosed a critical unauthenticated flaw in an exposed MCP bridge chaining code execution, credential theft, AI memory poisoning and persistent compromise. One vulnerability, a complete kill chain. "Do you expose an MCP bridge?" becomes a standing procurement question inside a quarter.
    • Revocation works. The OWAReaper implant establishes server-side mailbox permissions that survive credential rotation and full device rebuilds. The same test runs against any product: revoke a credential, then check whether delegated grants, OAuth tokens, service accounts, background agents and agent memory actually lose access. Two-day audit. "Fully, with a documented revocation SLA" is a differentiator no competitor improvises on a call.

    There is a dated forcing function. Zenity Labs presents PleaseFix chained with Intent Collision, covering 0-click account takeover, data theft and remote code execution, with a claim that every agentic browser on the market was affected, at Black Hat on 8/6. Expect enterprise buyers to pause or gate agentic rollouts that week. A launch landing in that window needs its containment answer to precede the feature demo.

    Prevention is off the menu. What you can still sell is a failure that is scoped, logged and reversible — and almost none of your competitors have that written down.

    Action items

    • Strip prevention language from PRDs, trust-center pages and security collateral this week, replacing it with a documented containment claim: least privilege, egress allowlist, human confirmation on irreversible actions, tamper-evident logs.
    • Add instruction-stripping on generated artifacts to the definition of done for every feature that ingests user-supplied documents, this sprint.
    • Scope per-action, per-identity exportable agent audit logs plus an agent-memory reset control as a named enterprise-tier capability this quarter.

    Sources:CSO First Look · The Hacker News · SANS NewsBites · TLDR IT · Cyberpresso · Bloomberg Technology

◆ QUICK HITS

Quick hits

  • Claude Opus 5 lands at $2.03 per task with no data retention

  • Perplexity made cross-session memory free for every user

  • Models searched for brands they remembered 3.2x more often than unfamiliar ones

  • The EU's Digital Omnibus simplifies AI Act compliance and delays high-risk deadlines

  • Progress is buying Domo's software and customers for $400M after a covenant breach

  • 37signals cut its cool-down to one week and says four-week features now ship in one

  • TanStack and Microsoft both shipped chart grammars designed for AI agents to write

◆ Bottom line

The take.

Every durable lever in today's items sits in a layer you own; every temporary one sits on a vendor's invoice. Price relief arrives as a concession that can be withdrawn, capability parity arrives as a configuration change anyone can copy, and containment arrives as a promise your buyers have stopped accepting at face value. What that breaks is the habit of writing roadmap business cases whose central assumption belongs to a supplier. Make the harness the deliverable this week: measure cost per completed task, then fund the environment, caching and review work that no price change can take back.

— Promit, reading as Product ·

Frequently asked

Should I commit my migration to the new discounted tier's pricing?
Not without budgeting for its withdrawal. Two supply-side datasets show the compute cost floor rose while the rate card fell, so the 80% cut reads as a reversible concession rather than a new baseline, engineered to hold for roughly two quarters. Features that only clear at today's prices belong on a shelf list with a named trigger, not in a quarterly commitment.
Why are the low and mid tiers set exactly 10x apart?
The 10x spread is a routing instruction, not a discount, built to pull traffic down-tier for about two quarters. Anything left on the mid tier that users can't distinguish from the low tier is paid capability nobody sees. An agent session at 50k input and 5k output tokens runs $0.16 on the higher tier versus $0.016 on the discounted one.
If token prices fell, why won't my invoice drop with them?
Because unit price is the smallest term in the cost equation. Realized cache-hit rate and turns-per-resolved-task decide the bill, and neither appears on a standard dashboard. Amazon burned $1.8M on one coding task at 860% over budget, and cached-versus-uncached token rates can differ by 50x, so instrument both on your highest-volume surfaces.
What moves agent reliability if a new model isn't the answer?
Harness design does. Four independent teams lifted task success 20–30 points without changing models by decomposing tasks, adding an adversarial critic pass, and building environments an agent can verify against. Decomposed prompting hit 100% success versus 50% for a single one-shot prompt, and these gains compound with every price cut instead of being reset by one.
What can I still promise enterprise buyers about agent security?
Containment, not prevention. Microsoft has told the market this injection class can't be stopped at the model layer, so a prevention claim is now a liability in security reviews. Sell a failure that is scoped, logged and reversible: least privilege, egress allowlists, human confirmation on irreversible actions, and tamper-evident per-action logs. That 53% of orgs can't verify what their agents do is the market.

◆ Same day, different angle

Read this day as…

◆ Recent in product

Keep reading.

Spot an error? [email protected]