<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:media="http://search.yahoo.com/mrss/">
<channel>
<title>06.ai — chart packs</title>
<link>https://06.ai/</link>
<atom:link href="https://06.ai/feed.xml" rel="self" type="application/rss+xml" />
<description>Chart packs on markets, AI infrastructure and the capital behind it.</description>
<language>en</language>
<lastBuildDate>Wed, 28 Oct 2026 12:16:00 GMT</lastBuildDate>
<item>
  <title>Who owns the most Blackwell per dollar?</title>
  <link>https://06.ai/packs/blackwell-per-dollar</link>
  <guid isPermaLink="true">https://06.ai/packs/blackwell-per-dollar</guid>
  <pubDate>Wed, 28 Oct 2026 12:16:00 GMT</pubDate>
  <description>Nvidia’s Blackwell GPUs owned by each listed company per $1B of market cap, and who is lined up for the most of what comes next. The neoclouds lead by one to two orders of magnitude, mostly because they buy their GPUs with debt.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/blackwell-per-dollar/cover.png" length="62306" type="image/png" />
  <media:content url="https://06.ai/newsletter/blackwell-per-dollar/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/blackwell-per-dollar"><img src="https://06.ai/newsletter/blackwell-per-dollar/thumb.png" alt="Who owns the most Blackwell per dollar?" width="421" height="391"></a><figcaption><a href="https://06.ai/packs/blackwell-per-dollar">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>CoreWeave owns about <strong>16,525</strong> Nvidia Blackwell GPUs per $1B of market cap, <strong>77×</strong> Microsoft’s 214. Most of that gap is debt: CoreWeave’s enterprise value is 2.4× its market cap, and per $1B of enterprise value IREN leads at 11,275. Amazon has the largest disclosed claim on what comes next, at least <strong>3M</strong> Nvidia GPUs through 2028; per dollar, the neoclouds’ unbuilt contracted power is bigger still, if they can finance it.</p>
<ul><li><strong>16,525</strong> — Blackwell GPUs per $1B of market cap, CoreWeave. Microsoft 214, Alphabet 86. Nvidia GPUs only, estimates</li><li><strong>11,275</strong> — Per $1B of enterprise value, IREN. CoreWeave falls to 6,882: its enterprise value is 2.4× its market cap</li><li><strong>846K</strong> — Largest Blackwell owner, Microsoft. B200 and B300 shipped through Q1 2026, per Epoch AI. Meta 519K, Amazon 401K</li><li><strong>3M+</strong> — Largest disclosed next allocation, AWS. Nvidia GPUs: more than 1M from 2026, then 2M more through 2027–28</li></ul>
<h2>Blackwell GPUs per $1B of market cap</h2>
<figure><a href="https://06.ai/packs/blackwell-per-dollar#per-dollar"><img src="https://06.ai/newsletter/blackwell-per-dollar/fig-01.png" alt="Blackwell GPUs per $1B of market cap" width="694" height="376"></a><figcaption>Base estimate, with the range from low to high. Log scale. Market caps at the October 26–27, 2026 closes. Nvidia GPUs only: Alphabet’s TPUs and Amazon’s Trainium aren’t counted.</figcaption></figure>
<h2>Why the neoclouds top the list</h2>
<p><strong>It’s a leverage screen.</strong> GPUs per dollar of market cap rise as the equity shrinks against the fleet. CoreWeave’s roughly 543K Blackwell GPUs sit under $78.9B of enterprise value but $32.9B of market cap; the rest is debt and leases, $31.4B of it recourse debt at June 30. IREN and Nebius carry less (1.16× and 1.05× their market caps), so per dollar of enterprise value IREN moves to first and CoreWeave’s figure falls by more than half, to 6,882.</p>
<p><strong>And the market has marked the equity down.</strong> CoreWeave closed at $59.57 on October 27, against a 52-week high of $141.79; its credit default swaps peaked at 855bp in the run-up to its second-quarter results. IREN closed at $27.44, against $69.58 the night it announced its Nvidia partnership in May. Part of the per-dollar lead is the market discounting the debt behind the fleets.</p>
<p><strong>Owning the GPU isn’t owning the upside.</strong> Most neocloud capacity is contracted out at fixed prices: Microsoft at IREN and Nebius, Meta at Nebius and at CoreWeave, where it signed $21B through 2032 on top of $14B. Shareholders earn what’s left after interest and depreciation, and the customer keeps the margin on what runs on the chips. CoreWeave’s adjusted operating margin was 5% in the second quarter.</p>
<h2>Blackwell GPUs owned</h2>
<figure><a href="https://06.ai/packs/blackwell-per-dollar#owned"><img src="https://06.ai/newsletter/blackwell-per-dollar/fig-02.png" alt="Blackwell GPUs owned" width="694" height="346"></a><figcaption>The same estimates in units. Hyperscaler counts run through Q1 2026; the high end adds two more quarters at Q4 2025’s pace.</figcaption></figure>
<h2>Blackwell shipped by quarter</h2>
<figure><a href="https://06.ai/packs/blackwell-per-dollar#quarterly"><img src="https://06.ai/newsletter/blackwell-per-dollar/fig-03.png" alt="Blackwell shipped by quarter" width="694" height="380"></a><figcaption>Epoch AI’s estimate, B200 and B300 by owner, on one scale. Q1 2026 (paler) is incomplete in the source. Other is everyone Epoch doesn’t name in this series: neoclouds, sovereigns and enterprises. Oracle is counted from its Abilene site instead.</figcaption></figure>
<h2>Who owns the most</h2>
<p><strong>Microsoft, by Epoch AI’s estimate:</strong> about 846K B200 and B300 through the first quarter, ahead of Meta (519K), Amazon (401K) and Alphabet (332K). Epoch’s estimate for Microsoft’s Fairwater Atlanta site alone is about 304K.</p>
<p><strong>The biggest single site is xAI’s.</strong> Epoch puts Colossus 2 at 1.112 million H100-equivalents, about 440K Blackwell GPUs, owned by SpaceX since it bought xAI in February. Abilene, the site Oracle runs for OpenAI, is about 201K.</p>
<p><strong>The counts lag the shipments.</strong> Epoch’s owner series ends in the first quarter and Nvidia has shipped two more quarters since, so every hyperscaler owns more than its base figure today. Two more quarters at the fourth quarter’s pace lift the hyperscalers’ ratios by about half, which doesn’t change the order: the lowest neocloud is still 12× the highest hyperscaler.</p>
<h2>Who is lined up for the next allocation, per $1B of market cap</h2>
<figure><a href="https://06.ai/packs/blackwell-per-dollar#next"><img src="https://06.ai/newsletter/blackwell-per-dollar/fig-04.png" alt="Who is lined up for the next allocation, per $1B of market cap" width="694" height="376"></a><figcaption>Commitments and unbuilt contracted power for deliveries from late 2026 on: mostly Vera Rubin, some Blackwell Ultra, in proportions nobody discloses. Power converted at 3 kW per GPU (2.6–3.4 for the range). Commitments given only as “millions” or “multi-gigawatt” are read at their floor, marked ≥. Log scale.</figcaption></figure>
<h2>What each forward figure rests on</h2>
<ul><li><strong>Nebius NBIS</strong> — GPUs: 1.33M · Per $1B: 31,997 · Announced: Aug 2026 · Target of 5 GW contracted by year-end, less the 0.8–1 GW it expects connected by then. Low: the 3 GW it targeted in February, less 1 GW · In Nvidia’s first Rubin cloud cohort; deployments from late 2026 or early 2027</li><li><strong>CoreWeave CRWV</strong> — GPUs: 900K · Per $1B: 27,397 · Announced: Aug 2026 · 2.7 GW contracted but not yet active: 4.2 GW contracted as of August 11 against 1.5 GW active · First production Vera Rubin NVL72 customer, Cognition, on September 30</li><li><strong>IREN IREN</strong> — GPUs: 167K · Per $1B: 15,015 · Announced: May &amp; Aug 2026 · The 500 MW of IT load it plans to add in 2027. Its Nvidia partnership covers up to 5 GW, a framework rather than orders · No Rubin orders disclosed</li><li><strong>Oracle ORCL</strong> — GPUs: ≥667K · Per $1B: ≥1,745 · Announced: Oct 27, 2026 · “Multi-gigawatt” Vera Rubin expansion on OCI, read at its floor of 2 GW · Vera Rubin NVL72 generally available on OCI now</li><li><strong>Meta META</strong> — GPUs: ≥2M · Per $1B: ≥1,242 · Announced: Feb 18, 2026 · Multiyear Nvidia deal for “millions” of Blackwell and Rubin GPUs, read at its floor of 2 million. No unit count or value disclosed · Vera CPUs from 2027; part of the capacity comes through CoreWeave and Crusoe</li><li><strong>Amazon (AWS) AMZN</strong> — GPUs: ≥3M · Per $1B: ≥1,115 · Announced: Mar 16 &amp; Aug 26, 2026 · More than 1 million Nvidia GPUs from 2026, then 2 million more through 2027–28, across Blackwell Ultra, Rubin and Rubin Ultra. The largest disclosed · In Nvidia’s first Rubin cloud cohort</li><li><strong>SpaceX (xAI) SPCX</strong> — GPUs: 530K · Per $1B: 265 · Announced: 2026 · Colossus build-out toward 1 million GPUs across its sites, less the roughly 470,000 Blackwell counted above · No Rubin volumes disclosed</li><li><strong>Microsoft MSFT</strong> — GPUs: ≥400K · Per $1B: ≥101 · Announced: Jun 2026 · Fairwater sites scaling to “hundreds of thousands” of Vera Rubin superchips, two GPUs each, read at the floor. Rubin it rents from neoclouds, such as 30,000 from Nscale, belongs to them and isn’t counted · In Nvidia’s first Rubin cloud cohort</li><li><strong>Alphabet GOOGL</strong> · No committed Nvidia volume disclosed. Google Cloud’s network design links up to 960,000 Rubin GPUs, a capability rather than an order · In Nvidia’s first Rubin cloud cohort</li></ul>
<h2>Who gets Rubin first</h2>
<p>Nvidia named eight clouds first in line for Vera Rubin: AWS, Google Cloud, Microsoft Azure, Oracle Cloud, CoreWeave, Lambda, Nebius and Nscale. Production shipments began this fall. CoreWeave has had the first customer in production, Cognition, since September 30, and Oracle made Vera Rubin generally available on its cloud on October 27, with a multi-gigawatt expansion to come. Nvidia’s 2026 Rubin output is estimated at only 200K–300K GPUs, and it has historically sent 60%–70% of a new generation’s first year to the hyperscalers, so most of these allocations land in 2027 and 2028.</p>
<p><strong>In GPUs, Amazon and Meta.</strong> AWS committed to more than 1 million Nvidia GPUs from 2026 and 2 million more through 2027–28, the largest disclosed. Meta’s February deal covers “millions” of Blackwell and Rubin GPUs, with no number given. Microsoft is building Fairwater for hundreds of thousands of Rubin superchips and also rents Rubin from neoclouds, 30,000 of them from Nscale in Norway.</p>
<p><strong>Per dollar, the neoclouds, on paper.</strong> CoreWeave has 2.7 GW contracted that isn’t built, Nebius is aiming for 5 GW contracted by year-end, and IREN plans 500 MW more in 2027. That is about 31,997 next-generation GPUs per $1B of Nebius’s market cap and 27,397 per $1B of CoreWeave’s. But capex guided for this year is 1.13× CoreWeave’s market cap and 0.54× Nebius’s, and IREN’s for its fiscal 2027 is 2.48× its own. The next allocation will be paid for by lenders and by customers’ prepayments, not by today’s shareholders.</p>
<h2>The ranking, with leverage</h2>
<p>Sorted by GPUs per $1B of market cap. Enterprise value and guided capex for the four names where debt changes the picture.</p>
<ul><li><strong>CoreWeave CRWV · Neocloud</strong> — Blackwell GPUs: 543K 397K–600K · As of: Jun 2026 · Market cap: $32.9B · Per $1B mkt cap: 16,525 · EV: $78.9B · Per $1B EV: 6,882 · EV ÷ mkt cap: 2.40× · Capex ÷ mkt cap: 1.13×</li><li><strong>IREN IREN · Neocloud</strong> — Blackwell GPUs: 145K 36K–150K · As of: Year-end 2026 (secured) · Market cap: $11.1B · Per $1B mkt cap: 13,063 · EV: $12.9B · Per $1B EV: 11,275 · EV ÷ mkt cap: 1.16× · Capex ÷ mkt cap: 2.48×</li><li><strong>Nebius NBIS · Neocloud</strong> — Blackwell GPUs: 161K 100K–200K · As of: Jun 2026 · Market cap: $41.7B · Per $1B mkt cap: 3,863 · EV: $43.7B · Per $1B EV: 3,684 · EV ÷ mkt cap: 1.05× · Capex ÷ mkt cap: 0.54×</li><li><strong>Oracle ORCL · Leveraged builder</strong> — Blackwell GPUs: 201K 100K–450K · As of: Oct 2026 · Market cap: $382B · Per $1B mkt cap: 527 · EV: $470B · Per $1B EV: 428 · EV ÷ mkt cap: 1.23× · Capex ÷ mkt cap: 0.24×</li><li><strong>Meta META · Hyperscaler</strong> — Blackwell GPUs: 519K 477K–818K · As of: Q1 2026 · Market cap: $1.61T · Per $1B mkt cap: 322</li><li><strong>SpaceX (xAI) SPCX · Leveraged builder</strong> — Blackwell GPUs: 470K 140K–585K · As of: Oct 2026 · Market cap: $2T · Per $1B mkt cap: 235</li><li><strong>Microsoft MSFT · Hyperscaler</strong> — Blackwell GPUs: 846K 780K–1.32M · As of: Q1 2026 · Market cap: $3.95T · Per $1B mkt cap: 214</li><li><strong>Amazon AMZN · Hyperscaler</strong> — Blackwell GPUs: 401K 373K–607K · As of: Q1 2026 · Market cap: $2.69T · Per $1B mkt cap: 149</li><li><strong>Alphabet GOOGL · Hyperscaler</strong> — Blackwell GPUs: 332K 308K–509K · As of: Q1 2026 · Market cap: $3.87T · Per $1B mkt cap: 86</li></ul>
<h2>What a Blackwell allocation is worth</h2>
<p>Rubin is a big step: CoreWeave measured about 10× the tokens per megawatt of a GB200 NVL72 on DeepSeek R1 at matched interactivity. A Blackwell fleet contracted at today’s prices earns them until its contracts end. What it re-contracts for once Rubin is in volume is the main unknown in what it’s worth, and it matters most to owners who borrowed to buy it. <a href="https://06.ai/packs/inference-margins">The </a><a href="https://06.ai/packs/inference-margins">inference-margin</a><a href="https://06.ai/packs/inference-margins"> pack</a> has what a Blackwell GPU earns serving open models now, and <a href="https://06.ai/packs/neocloud-capex-funding">the </a><a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a><a href="https://06.ai/packs/neocloud-capex-funding"> pack</a> what the neoclouds still have to raise.</p>
<p>So owning the allocation through neocloud equity is a levered position on fleet value and refinancing more than on AI margins. Per dollar of enterprise value, with the contracts and their counterparties in view, is the fairer comparison.</p>
<h2>How each count was built</h2>
<p>IREN’s count is the company’s own target. The rest are Epoch AI’s model, Epoch’s site estimates or our conversion of disclosed power, so treat them as estimates.</p>
<ul><li><strong>CoreWeave CRWV</strong> — Implied from power: 1.5 GW active on June 30, less the 360 MW its ~250,000 mostly-Hopper GPUs used at its IPO filing, at about 2.1 kW per Blackwell GPU. Range: 1.9–2.3 kW, and 20% of new power not Blackwell at the low end</li><li><strong>IREN IREN</strong> — Secured fleet: its 150,000-GPU target for year-end 2026 (over 50,000 B300 ordered in March plus Microsoft’s GB300), less a few thousand Hoppers. About a quarter is live: $1B of run-rate revenue against $4B contracted. The low end counts only that quarter</li><li><strong>Nebius NBIS</strong> — Implied from power, low confidence: 170 MW active at the end of 2025, scaled by run-rate revenue ($1.25B to $3B) to about 408 MW in June, less about 70 MW of Hopper, at about 2.1 kW per GPU</li><li><strong>Oracle ORCL</strong> — Abilene alone: Epoch AI’s 509,000 H100-equivalents for the site, about 201,000 Blackwell. Oracle says the Abilene supercluster has more than 100,000; Larry Ellison’s target for the site is more than 450,000. Other OCI regions aren’t counted</li><li><strong>Meta META</strong> — Epoch AI’s chip-owners model: B200 and B300 shipped through Q1 2026 (incomplete). Low: through Q4 2025. High: two more quarters at Q4 2025’s pace</li><li><strong>SpaceX (xAI) SPCX</strong> — Colossus 2: Epoch AI’s 1.112M H100-equivalents, about 440,000 Blackwell, plus 30,000 GB200 in Colossus 1. Low: Epoch’s owner data (140,000 added in Q3 2025). High: Colossus 2 at the reported 555,000</li><li><strong>Microsoft MSFT</strong> — Epoch AI’s chip-owners model, as for Meta. Its site estimate for Fairwater Atlanta alone is about 304,000</li><li><strong>Amazon AMZN</strong> — Epoch AI’s chip-owners model, as for Meta. Nvidia only: Trainium isn’t counted</li><li><strong>Alphabet GOOGL</strong> — Epoch AI’s chip-owners model, as for Meta. Nvidia only: Google’s TPUs, most of its compute, aren’t counted</li></ul>
<h2>What this is anchored on</h2>
<p>Market caps at the October 26–27, 2026 closes.</p>
<ul><li><strong>Hyperscaler Blackwell counts</strong> — B200 and B300 units shipped by owner and quarter, Q4 2024 to Q1 2026 (Q1 2026 incomplete) · <a href="https://epoch.ai/data/ai-chip-owners">Epoch AI, AI Chip Owners (updated May 12, 2026)</a></li><li><strong>Site estimates</strong> — Colossus 2 (SpaceX) 1.112M, Fairwater Atlanta (Microsoft) 769,000, Abilene (Oracle) 509,000 H100-equivalents · <a href="https://epoch.ai/data/ai-data-centers?view=table">Epoch AI, AI data centers (updated Oct 26, 2026)</a></li><li><strong>CoreWeave</strong> — 1.5 GW active and 3.7 GW contracted on June 30, 4.2 GW by August 11; backlog $104B; Meta $21B through 2032 on top of $14B; recourse debt $31.4B; CDS peaked at 855bp · <a href="https://www.techtimes.com/articles/324054/20260812/coreweave-q2-2026-129b-backlog-grew-296b-six-weeks-despite-50-default-odds.htm">TechTimes, Aug 12, 2026</a></li><li><strong>CoreWeave</strong> — Adjusted operating margin 5% in Q2; FY2026 capex guide $35–39B · <a href="https://futurumgroup.com/insights/coreweave-q2-fy-2026-ai-demand-drives-pricing-and-capacity-growth/">Futurum, Aug 2026</a></li><li><strong>CoreWeave baseline</strong> — About 250,000 GPUs, mostly Hopper, on 360 MW at its IPO filing · <a href="https://www.nextplatform.com/2025/03/05/coreweaves-250000-strong-gpu-fleet-undercuts-the-big-clouds/">The Next Platform, Mar 5, 2025</a></li><li><strong>CoreWeave, Rubin</strong> — First production Vera Rubin NVL72 customer (Cognition); about 10× the tokens per megawatt of GB200 NVL72 on DeepSeek R1 · <a href="https://www.coreweave.com/news/coreweave-delivers-nvidia-vera-rubin-nvl72-performance-at-production-scale-starting-with-cognition">CoreWeave, Sep 30, 2026</a></li><li><strong>Nebius</strong> — About 170 MW active at the end of 2025; run-rate revenue $1.25B; Microsoft and Meta capacity delivered · <a href="https://www.sec.gov/Archives/edgar/data/1513845/000110465926013946/tm266173d1_ex99-2.htm">Nebius Q4 2025 shareholder letter</a></li><li><strong>Nebius</strong> — Run-rate revenue $3B at June 30; 5 GW contracted-power target for year-end; FY2026 capex $20–25B; Rubin from late 2026 or early 2027 · <a href="https://www.fool.com/earnings/call-transcripts/2026/08/19/nebius-nbis-q2-2026-earnings-call-transcript/">Nebius Q2 2026 call</a></li><li><strong>IREN</strong> — 150,000-GPU target for year-end 2026; over 50,000 B300 ordered; Nvidia partnership up to 5 GW; $69.58 after hours on May 7 · <a href="https://finance.yahoo.com/sectors/technology/articles/iren-partners-nvidia-5-gw-205851949.html">Blockspace via Yahoo Finance, May 7, 2026</a></li><li><strong>IREN</strong> — $4B contracted run-rate revenue, $1B live after Microsoft accepted Horizon 1; 500 MW more IT load in 2027; FY2027 capex $25–30B · <a href="https://finance.yahoo.com/technology/ai/articles/iren-q4-earnings-call-highlights-230429246.html">Yahoo Finance, Aug 27, 2026</a></li><li><strong>Oracle</strong> — Vera Rubin NVL72 generally available on OCI; multi-gigawatt Vera Rubin expansion planned; more than 100,000 Blackwell in the Abilene supercluster · <a href="https://www.oracle.com/news/announcement/ai-world-nvidia-and-oracle-expand-nvidia-vera-rubin-to-multi-gigawatt-scale-2026-10-27/">Oracle, Oct 27, 2026</a></li><li><strong>Oracle</strong> — Abilene to house more than 450,000 GB200 eventually · <a href="https://www.datacenterdynamics.com/en/news/openai-and-oracle-to-deploy-450000-gb200-gpus-at-stargate-abilene-data-center/">DCD</a></li><li><strong>Oracle</strong> — Net debt $88.3B at August 31, 2026; FY2027 capex guide $90–95B · <a href="https://www.cestriancapitalresearch.com/oracle-corporation-nyse-orcl-q1-fy2027-earnings-record-cds-spreads-88b-net-debt-and-the-openai-question/">Cestrian Capital Research</a></li><li><strong>AWS</strong> — More than 1 million Nvidia GPUs over the next 12 months · <a href="https://www.datacenterdynamics.com/en/news/aws-to-deploy-more-than-one-million-nvidia-gpus-over-next-12-months/">DCD, Mar 16, 2026</a></li><li><strong>AWS</strong> — 2 million additional Nvidia GPUs through 2027–28: Blackwell Ultra, Rubin, Rubin Ultra · <a href="https://theenergymag.com/news/market-news/aws-and-nvidia-to-deliver-2-million-additional-gpus-and-next-generation-infrastructure-for-agentic-and-physical-ai">The Energy Mag, Aug 26, 2026</a></li><li><strong>Meta</strong> — Multiyear deal for millions of Blackwell and Rubin GPUs · <a href="https://pureai.com/Articles/2026/02/18/NVIDIA-expands-multiyear-AI-infrastructure-deal-with-Meta.aspx">PureAI, Feb 18, 2026</a></li><li><strong>Rubin</strong> — First cohort: AWS, Google Cloud, Azure, OCI, CoreWeave, Lambda, Nebius, Nscale; 2026 output estimated at 200,000–300,000, 60–70% to hyperscalers; Fairwater to scale to hundreds of thousands of Vera Rubin superchips; Google network up to 960,000 Rubin GPUs · <a href="https://www.techtimes.com/articles/319203/20260627/nvidia-vera-rubin-ships-this-fall-8-cloud-partners-10x-lower-token-cost-hbm4-triples-bandwidth.htm">TechTimes, Jun 27, 2026</a></li><li><strong>Microsoft</strong> — Rents 30,000 Vera Rubin from Nscale in Norway · <a href="https://letsdatascience.com/news/microsoft-rents-30000-nvidia-vera-rubin-chips-7119dfbe">Let’s Data Science, Apr 14, 2026</a></li><li><strong>SpaceX</strong> — Listed June 12, 2026; owns xAI since February; Colossus across sites toward 1 million GPUs · <a href="https://en.wikipedia.org/wiki/Initial_public_offering_of_SpaceX">Wikipedia</a></li><li><strong>SpaceX</strong> — Colossus 2 reported at 555,000 GPUs · <a href="https://introl.com/blog/xai-colossus-2-gigawatt-expansion-555k-gpus-january-2026">Introl, Jan 2026</a></li><li><strong>Market caps</strong> — Closes on October 26: Microsoft, Alphabet, Amazon, Meta, Oracle, SpaceX · <a href="https://www.stocktitan.net/rankings/companies-market-cap">StockTitan</a></li><li><strong>CoreWeave market</strong> — $59.57 close Oct 27 (52-week range $51.24–$141.79); EV · <a href="https://www.fool.com/coverage/stock-market-today/2026/10/27/stock-market-today-oct-27-coreweave-surges-on-denmark-data-center-launch/">Motley Fool; StockAnalysis</a></li><li><strong>CoreWeave market</strong> — Market cap and enterprise value, Oct 23 (re-marked to Oct 27’s close) · <a href="https://stockanalysis.com/stocks/crwv/market-cap/">StockAnalysis</a></li><li><strong>Nebius market</strong> — $41.66B market cap at the Oct 26 close; debt $10.06B, cash $8.04B · <a href="https://companiesmarketcap.com/nebius-group/marketcap/">CompaniesMarketCap (Nasdaq); TipRanks</a></li><li><strong>IREN market</strong> — $27.44 close Oct 27, $11.10B market cap; debt $7.84B, cash $6.08B · <a href="https://companiesmarketcap.com/iris-energy/marketcap/">CompaniesMarketCap; TipRanks</a></li></ul>
<h2>Method</h2>
<p><strong>Blackwell GPUs</strong> are counted one per B200, B300, GB200 or GB300 GPU package, not per die. For Microsoft, Meta, Amazon and Alphabet they are Epoch AI’s estimates of B200 and B300 shipped through Q1 2026, which Epoch flags as incomplete. Site estimates in H100-equivalents are converted at Epoch’s own ratio, 2.527 per Blackwell GPU.</p>
<p><strong>Power to GPUs.</strong> CoreWeave and Nebius don’t publish GPU counts, so we convert active power at about 2.1 kW of IT load per Blackwell GPU (1.9–2.3): a GB200 or GB300 NVL72 rack draws about 120–140 kW for 72 GPUs, plus networking and storage. CoreWeave’s base removes the 360 MW its mostly-Hopper fleet used at its IPO filing. Nebius’s removes about 70 MW of Hopper from the roughly 408 MW we infer for June from its run-rate revenue. Forward power converts at 3 kW per Rubin-generation GPU (2.6–3.4).</p>
<p><strong>Market cap and enterprise value</strong> use closing prices on October 26 (October 27 for CoreWeave and IREN) and all share classes. Enterprise value adds net debt from the latest balance sheet: CoreWeave’s from StockAnalysis, re-marked to the October 27 price; Oracle’s $88.3B at August 31; Nebius’s and IREN’s from TipRanks. Capex is the latest full-year guide at its midpoint (fiscal 2027 for Oracle and IREN).</p>
<p><strong>Not counted:</strong> GPUs a company rents rather than owns (they count for the owner, so Microsoft’s capacity at Nebius, IREN and Nscale counts for them), Hopper and older GPUs, and other chips: TPUs, Trainium and AMD. Private owners, among them OpenAI, Anthropic, Lambda, Nscale and Crusoe, have no market cap to divide by.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Who makes money serving open models?</title>
  <link>https://06.ai/packs/inference-margins</link>
  <guid isPermaLink="true">https://06.ai/packs/inference-margins</guid>
  <pubDate>Tue, 27 Oct 2026 12:15:00 GMT</pubDate>
  <description>Open-weight models now carry most of OpenRouter’s US traffic, served by dozens of hosts competing on price. What a GPU earns serving them, chip by chip and model by model, who keeps the margin, and who wins if GPU rents invert.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/inference-margins/cover.png" length="61677" type="image/png" />
  <media:content url="https://06.ai/newsletter/inference-margins/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/inference-margins"><img src="https://06.ai/newsletter/inference-margins/thumb.png" alt="Who makes money serving open models?" width="421" height="391"></a><figcaption><a href="https://06.ai/packs/inference-margins">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>Serving DeepSeek’s V4.1-Flash on a Blackwell rack earns about <strong>$39</strong> an hour per GPU at DeepSeek’s off-peak prices, so a host renting the rack covers its rent at <strong>37%</strong> utilization. On an 8-GPU B200 box running NVIDIA’s standard recipe it takes 60%, and an H200 can’t cover its rent at those prices at all. The margin sits with rack-scale serving, frontier-size models and owned GPUs; on the most popular model, 33 hosts compete on price.</p>
<ul><li><strong>$39</strong> — Revenue per GPU-hour, Blackwell rack. V4.1-Flash at DeepSeek’s off-peak prices on a GB300 NVL72, per vLLM. The rack rents for $14.59 a GPU-hour</li><li><strong>37%</strong> — Utilization a renter needs to break even. Same rack. 60% on an 8-GPU B200 box with NVIDIA’s recipe; an H200 would need 120%, so never</li><li><strong>33</strong> — Hosts selling one model for V4.1-Flash on OpenRouter. 15 list exactly DeepSeek’s peak rate; 8 discount by 30–84%</li><li><strong>24.6%</strong> — Zhipu’s gross margin on API sales. H1 2026, from −0.4% a year earlier, after raising API prices about 101% this year</li></ul>
<h2>What a GPU earns, and the utilization a renter needs</h2>
<figure><a href="https://06.ai/packs/inference-margins#earn"><img src="https://06.ai/newsletter/inference-margins/fig-01.png" alt="What a GPU earns, and the utilization a renter needs" width="694" height="504"></a><figcaption>Revenue per GPU-hour at full load. The rack is vLLM’s own figure on SemiAnalysis AgentX traffic. The rest are NVIDIA’s Dynamo recipes on its agent trace (64K-token prompts, 400-token answers, 90% of the prompt cached), priced at each model’s going rate: DeepSeek’s off-peak rate for V4.1-Flash, with the paler bar at the peak rate most OpenRouter hosts post; Z.ai’s list for GLM-5.3-Flash; Moonshot’s $3/$15 for Kimi K3. Ticks are typical on-demand rent on October 20. The right-hand column is the share of hours a renter must sell to cover it.</figcaption></figure>
<p>An owner needs far less. At SemiAnalysis’s owner costs ($1.95 an hour for a B200, $2.65 for a GPU in a GB300 rack) the B200 box covers its costs at 15% utilization and the GB300 rack at 7%. Kimi K3 on H200s doesn’t cover even the cost of owning them.</p>
<h2>How the money comes in</h2>
<p><strong>Routing is price-first.</strong> OpenRouter’s default spreads requests across hosts that have been stable, weighted by the inverse square of price, so a host at half the price draws four times the traffic. It adds no markup to host prices and earns a 5.5% fee when buyers load credits, so a host keeps the price it posts.</p>
<p><strong>The traffic is agents, and mostly input.</strong> In the week to October 14, V4.1-Flash processed 36.6 trillion prompt tokens and 807 billion completion tokens, about 45 to 1, and its biggest senders are coding and agent harnesses. In the week to October 26 it carried 52.8T tokens, 28% of everything in OpenRouter’s daily top 50. Chinese models carry 60% of OpenRouter’s tokens over the last four weeks but 26% of the dollars (<a href="https://06.ai/trackers/openrouter">tracker</a>).</p>
<p><strong>So it’s a cache business priced per input token.</strong> On NVIDIA’s trace, 70% of a V4.1-Flash request’s revenue comes from the 10% of prompt tokens that miss the cache; output is 17%. At OpenRouter’s 45-to-1 mix, uncached input is still about 48%. The cache-read price, which hosts set separately, decides what an agent pays. <a href="https://06.ai/packs/deepinfer">The </a><a href="https://06.ai/packs/deepinfer">DeepInfer</a><a href="https://06.ai/packs/deepinfer"> pack</a> shows the same split from DeepSeek’s side.</p>
<p><strong>Posted isn’t paid.</strong> 15 of the 33 hosts list exactly DeepSeek’s peak rate, $0.30 per million input tokens and $1.20 per million output; 8 run discounts of 30% to 84%. OpenRouter now shows next to the posted prices what buyers actually pay on average, which caching and discounts pull well below the list.</p>
<h2>What one agent request costs at each host</h2>
<figure><a href="https://06.ai/packs/inference-margins#hosts"><img src="https://06.ai/newsletter/inference-margins/fig-02.png" alt="What one agent request costs at each host" width="694" height="650"></a><figcaption>Dollars per 1,000 requests on NVIDIA’s agent trace (64K-token prompt, 90% of it cached, 400-token answer) at each host’s cheapest standard endpoint for V4.1-Flash on October 27, discounts included. Listed companies in orange. Dashed lines: DeepSeek’s own off-peak and peak rates. Two hosts are left out: one lists no cache price and one listing couldn’t be read.</figcaption></figure>
<p>Headline prices mislead. Decart has the 2nd-lowest input-plus-output price but ranks 11th on an agent’s bill, because its cache reads cost $0.018 per million, three times DeepSeek’s peak rate. Alibaba Cloud drops from 10th to 19th the same way. Modal and Google Vertex charge $0.03 for cache reads and cost 3.0× DeepSeek’s off-peak rate per request.</p>
<h2>Which models pay best</h2>
<p><strong>Frontier-size open models, on the newest racks.</strong> Kimi K3 has 2.8 trillion parameters, 104 billion of them active, and nine of the ten platforms that served it in its first weeks charged Moonshot’s $3 input, $15 output. That price holds because the economics only work at rack scale: on NVIDIA’s recipes a GB300 GPU earns $34.91 an hour on K3, a GB200 $12.58 and an H200 $1.35.</p>
<p><strong>New models, for a few days.</strong> StepFun’s Step 5 Preview reached second place on OpenRouter in its first week, and K3 was live on nearly every major platform within 48 hours of its weights. The window before thirty hosts pile in is short.</p>
<p><strong>The Flash tier is where the volume is.</strong> V4.1-Flash, GLM-5.3-Flash and MiniMax’s M3.1-Flash carry the most tokens, and their prices follow cost down: over about 90 days the cheapest input price fell 77% for V4.1-Flash and 90% for GLM-5.3-Flash. GLM-5.3-Flash at Z.ai’s list earns $15.05 an hour on a B200, slightly more than V4.1-Flash at DeepSeek’s off-peak rate. Margins in this tier go to whoever runs the rack-scale stack.</p>
<p><strong>Hopper loses on every model here.</strong> An H200 can’t cover its rent on V4.1-Flash at DeepSeek’s off-peak prices, and NVIDIA doesn’t publish an H100 recipe for the model at all. Free endpoints, MiniMax’s M3.1-Flash and NVIDIA’s Nemotron 3 Ultra among them, carried 12.6T and 5.5T tokens in the week to October 26, free to users, so someone else pays.</p>
<h2>Who keeps the margin</h2>
<p>Reported figures. The measures differ, so compare rows with care.</p>
<ul><li><strong>DeepSeek</strong> — Layer: Lab serving its own open weights · Measure: Theoretical cost-profit ratio, V3 and R1 on H800s priced at $2 an hour · Feb 2025 · Value: 545% · At R1 list prices; DeepSeek said actual revenue was far lower</li><li><strong>Nebius NBIS</strong> — Layer: GPU cloud with a token API · Measure: Adjusted EBITDA margin, AI business · Q2 2026 · Value: 50% · Mostly GPU rental; Token Factory is its fastest-growing line</li><li><strong>Fireworks</strong> — Layer: Inference platform, private · Measure: Gross margin · 2026 · Value: ~50% · Targeting 60%</li><li><strong>Cerebras CBRS</strong> — Layer: Inference cloud on its own chips · Measure: Core gross margin · Q2 2026 · Value: 41% · Cloud services 53% (core) in Q1</li><li><strong>Zhipu 2513.HK</strong> — Layer: Lab selling its open weights by API · Measure: Gross margin on cloud API · H1 2026 · Value: 24.6% · −0.4% a year earlier, after raising API prices about 101% this year</li><li><strong>MiniMax 0100.HK</strong> — Layer: Lab selling its open weights by API · Measure: Gross margin, whole company · H1 2026 · Value: 17.9% · Open-platform revenue up 703%</li></ul>
<h2>How the margin moved</h2>
<p><strong>2023 to 2025: compute got cheap.</strong> H100 rents fell from peaks near $8 an hour to $2.00 on Silicon Data’s index by December 2025. In February 2025 DeepSeek said its V3 and R1 fleet cost $87,072 a day at $2 an H800-hour against $562,027 of theoretical revenue, about $12.90 per GPU-hour, while warning that actual revenue was far lower.</p>
<p><strong>2026: compute got scarce again.</strong> H100 and H200 contract prices rose about 40% between October 2025 and March 2026 as memory costs passed through. Silicon Data’s H100 index reached $2.88 on October 24, and Ornn’s settled at $3.17 on October 26, up 24.8% in a month.</p>
<p><strong>Token prices split.</strong> The Flash tier fell on architecture: V4.1-Flash activates 8B parameters to read and 16B to write. The frontier tier went up: K3 launched at $3/$15, Zhipu raised API prices about 101% this year, and DeepSeek warned of a significant price increase. Revenue per GPU-hour on Blackwell racks is about three times DeepSeek’s 2025 figure even after its price cuts (<a href="https://06.ai/packs/deepinfer">the </a><a href="https://06.ai/packs/deepinfer">DeepInfer</a><a href="https://06.ai/packs/deepinfer"> pack</a>), so hosts running the rack-scale stack kept ahead of rising rents and hosts on smaller setups fell behind.</p>
<p>The clearest public read is Zhipu: its API sales went from a −0.4% gross margin to 24.6% in a year, with prices about doubled. Selling tokens is still a thin business for anyone without the cheapest capacity. Owning the rack, or the model, is where the margin is.</p>
<h2>If the GPU curve inverts</h2>
<p>GPU rents aren’t inverted now. Silicon Data says its modeled forward curve sloped down in 2025 and moved to contango this year. In mid-2026 its B200 curve was only about 8% lower at 36 months ($5.62 to $5.17), and H100 was flat past 15 months. CME has distributed that curve to subscribers since October 15, and the H100 and B200 futures it planned to list on October 5 were reported as still pending regulatory review. Our own index (<a href="https://06.ai/trackers/gpu-compute-price-index">tracker</a>) started this week and doesn’t yet have enough term quotes to read a curve.</p>
<p>A steep inversion, a high near month and a low back end, would mean scarce capacity now and a supply wave or fast obsolescence later. A GPU-hour can’t be stored, so, as with power or freight, nothing ties the two ends together. Who gains, and who loses:</p>
<h2>Winners and losers in a steeply inverted curve</h2>
<p>Our assessment, roughly in order of how much each gains.</p>
<ul><li>Wins: <strong>Owners of installed GPUs that aren’t under contract</strong> — They sell at the expensive near end and stay off the cheap back end. Their cash margin is the spot rent less power.</li><li>Wins: <strong>Hosts that own their GPUs</strong> — Token prices settle where hosts renting at prompt rates break even. Owners keep the difference, and the inversion widens it.</li><li>Wins: <strong>Buyers who can wait</strong> — Training runs, RL and batch jobs buy the cheap back end. A long position in a deferred future gains as it rolls up toward spot, if spot holds.</li><li>Wins: <strong>Holders of leases fixed near the 2025 low</strong> — They are long compute below market and can undercut renters or sublet where contracts allow.</li><li>Wins: <strong>Capacity that can switch on now</strong> — Energized sites and the bottleneck parts, such as HBM. An inverted curve pays for speed.</li><li>Wins: <strong>Brokers and market makers</strong> — Steep curves and wide gaps between chips, regions and indices bring hedging demand and spreads to capture.</li><li>Loses: <strong>New builds that need contracts to borrow</strong> — Lower contracted rates mean less debt per GPU, which slows new supply and pulls the curve back.</li><li>Loses: <strong>Hosts renting at the prompt price</strong> — They pay the scarce price for GPUs and sell tokens at prices set by owners.</li><li>Loses: <strong>Long-dated bets on resale value</strong> — An inverted curve is the market pricing faster depreciation than six-year accounting lives.</li></ul>
<h2>How new hosts get in</h2>
<p>Most of the 33 hosts on V4.1-Flash fit four groups: inference-engine and model companies (Modular, Relace, Morph, Decart, Reka, Cohere), GPU clouds selling tokens as well as GPU-hours (CoreWeave, Nebius, DigitalOcean, Crusoe, GMI, Prime Intellect), Chinese clouds (Baidu, Alibaba, SiliconFlow), and privacy-focused hosts (Phala, Venice).</p>
<p><strong>Uptime first.</strong> Over the day to October 27, OpenRouter served V4.1-Flash 99.91% of the time; without its failover between hosts it would have been 87.81%. Hosts that stay up get the traffic. <strong>Then price:</strong> with inverse-square routing, a launch discount buys share fast. <strong>Pass the quality checks:</strong> OpenRouter publishes each host’s benchmark scores and has a routing mode for tool-calling accuracy, so heavy quantization shows. <strong>Be early, or fast:</strong> day-zero support catches a model before prices converge, and a speed tier sells at a premium (Baseten Fast posts $0.60/$2.40).</p>
<p>The arithmetic sets the floor. A host renting 8-GPU B200 boxes and pricing at DeepSeek’s off-peak rate needs 60% utilization to cover its rent. The hosts that last own their GPUs, fill idle ones, run the rack-scale stack, or have someone else paying.</p>
<h2>Listed ways in</h2>
<p>No listed company only rents GPUs and resells open-model tokens. The listed exposure is GPU clouds with token APIs on their own GPUs, Cerebras on its own chips, and the Hong Kong-listed labs selling their own open weights.</p>
<ul><li><strong>Nebius NBIS</strong> — What it sells: Token Factory: per-token API on 60+ open models, on its own GPUs. Hosts V4.1-Flash on OpenRouter at $0.30/$1.20. · Latest figures: Q2 revenue $582M; AI business 50% adjusted EBITDA margin; bought Eigen AI for $643M</li><li><strong>CoreWeave CRWV</strong> — What it sells: Serverless Inference: per-token API on an open-model catalog, on its own GPUs. Hosts V4.1-Flash on OpenRouter at $0.15/$0.65. · Latest figures: Managed-inference booked ARR went from $1M to over $100M within months of launch</li><li><strong>Cerebras CBRS</strong> — What it sells: Fast inference cloud on its own wafer-scale chips. · Latest figures: IPO in May raised $6.4B; Q2 core cloud revenue $127.7M, up 287%; core gross margin 41%</li><li><strong>DigitalOcean DOCN</strong> — What it sells: Hosts V4.1-Flash ($0.225/$0.90) and Kimi K3 on OpenRouter.</li><li><strong>Zhipu 2513.HK</strong> — What it sells: Sells its own open-weight GLM models by API, including through OpenRouter. · Latest figures: API revenue RMB 825M in H1, up 2,736%, 86.5% of revenue; API gross margin 24.6%</li><li><strong>MiniMax 0100.HK</strong> — What it sells: Sells its own M-series models by API, including through OpenRouter. · Latest figures: Open-platform revenue up 703% in H1; gross margin 17.9%</li><li><strong>Alphabet, Alibaba, Baidu GOOGL · BABA · BIDU</strong> — What it sells: Host V4.1-Flash on OpenRouter: Vertex at the posted rate, Alibaba Cloud at 50% off, Baidu Qianfan at 84% off.</li></ul>
<p>The pure-play hosts are private: Fireworks (over $1B annualized revenue, valued at $17.5B in July), Together ($8.3B), Baseten ($13B) and DeepInfra. Lambda, a GPU cloud, is raising up to $4B before a possible IPO at a $14.5B pre-money valuation.</p>
<h2>What this is anchored on</h2>
<p>Host prices as posted on October 27; rents as of October 20 (the <a href="https://06.ai/packs/deepinfer">DeepInfer</a> pack) and the dates shown.</p>
<ul><li><strong>Rack-scale yield</strong> — $38.96 per GPU-hour at DeepSeek's off-peak prices on one GB300 NVL72 rack, SemiAnalysis AgentX traffic; 954K tokens/s per GPU counting cached input · <a href="https://vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-ep">vLLM blog, Oct 23</a></li><li><strong>Recipe yields</strong> — Output tokens/s per GPU on the agentic trace: V4.1-Flash 1,155 (GB200), 1,088 (B200), 359 (H200), disaggregated · <a href="https://docs.nvidia.com/dynamo/recipes/deepseek-v4-1-flash">NVIDIA Dynamo, DeepSeek-V4.1-Flash recipe</a></li><li><strong>Recipe yields</strong> — Kimi K3: 91.3 (GB300), 32.9 (GB200), 3.54 (H200) output tokens/s per GPU; trace: 64K input, 400 output, 90% cache hits · <a href="https://docs.nvidia.com/dynamo/recipes/kimi-k3">NVIDIA Dynamo, Kimi-K3 recipe</a></li><li><strong>Recipe yields</strong> — GLM-5.3-Flash: 579 output tokens/s per GPU on four B200s · <a href="https://docs.nvidia.com/dynamo/recipes/glm-5-3-flash">NVIDIA Dynamo, GLM-5.3-Flash recipe</a></li><li><strong>Hosts</strong> — 33 hosts for V4.1-Flash with input, output and cache-read prices; pooled availability 99.91% against 87.81% without routing; top apps are agent harnesses · <a href="https://openrouter.ai/deepseek/deepseek-v4.1-flash-20260910">OpenRouter, DeepSeek V4.1-Flash</a></li><li><strong>Routing</strong> — Default routing weights stable hosts by the inverse square of price · <a href="https://openrouter.ai/docs/provider-routing">OpenRouter docs, provider routing</a></li><li><strong>Fees</strong> — No markup on host prices; 5.5% fee on credit purchases · <a href="https://openrouter.ai/docs/faq">OpenRouter FAQ</a></li><li><strong>Traffic mix</strong> — V4.1-Flash, week to Oct 14: 36.62T prompt and 807B completion tokens; Step 5 Preview reached #2 in its first week · <a href="https://metaprompt.ai/posts/most-used-models-openrouter">Metaprompt, from OpenRouter's weekly table</a></li><li><strong>Traffic mix</strong> — Open-weight models carry about 60% of tokens from US-originating requests on OpenRouter, mostly Chinese models · <a href="https://thenewstack.io/openrouter-us-region-routing/">The New Stack</a></li><li><strong>Prices</strong> — V4.1-Flash off-peak $0.15 input, $0.003 cached, $0.60 output; peak hours double · <a href="https://apidog.com/blog/deepseek-v4-1-flash-pricing/">Apidog</a></li><li><strong>Prices</strong> — Kimi K3: 2.8T parameters, 104B active; providers' prices · <a href="https://deepinfra.com/blog/kimi-k3-pricing-providers-cost">DeepInfra</a></li><li><strong>Prices</strong> — Nine of ten K3 platforms at $3/$15 with $0.30 cached; most live within 48 hours of the weights · <a href="https://dev.to/sophiaashi/every-kimi-k3-api-provider-compared-pricing-speed-and-the-one-50-discount-53ge">DEV Community</a></li><li><strong>Prices</strong> — GLM-5.3-Flash $0.15 input, $0.03 cached, $0.50 output · <a href="https://www.orcarouter.ai/blog/minimax-m3-1-flash-vs-glm-5-3-flash">OrcaRouter</a></li><li><strong>Prices</strong> — DeepSeek warned of a significant price increase after launching V4 at very low rates · <a href="https://www.vktr.com/ai-platforms/deepseeks-v41-flash-beats-its-own-flagship-model/">VKTR</a></li><li><strong>Price falls</strong> — V4.1-Flash cheapest input price down 76.7% over about 90 days, $0.30 to $0.07 · <a href="https://pricepertoken.com/pricing-page/model/deepseek-deepseek-v4.1-flash">PricePerToken</a></li><li><strong>Price falls</strong> — GLM-5.3-Flash cheapest input price down 90% over about 90 days · <a href="https://pricepertoken.com/pricing-page/model/z-ai-glm-5.3-flash">PricePerToken</a></li><li><strong>Rents</strong> — H100 rents have come down from historical peaks near $8 an hour · <a href="https://www.thundercompute.com/blog/ai-gpu-rental-market-trends">Thunder Compute</a></li><li><strong>Rents</strong> — H100 $3.17 an hour on Oct 26, up 24.8% in a month · <a href="https://data.ornn.com/">Ornn Compute Price Index</a></li><li><strong>Rents</strong> — Silicon Data H100 index $2.00 (Dec 9, 2025) to $2.88 (Oct 24, 2026); its forward curve moved from sloping down to contango · <a href="https://fourweekmba.com/ai-nvidia-gpu-rents-are-now-priced-to-rise-for-36-months/">FourWeekMBA</a></li><li><strong>Rents</strong> — Mid-2026 forward curve: B200 about 8% lower at 36 months; H100 flat past 15 months · <a href="https://www.silicondata.com/blog/gpu-futures">Silicon Data</a></li><li><strong>Rents</strong> — H100 and H200 contract prices up about 40% from Oct 2025 to Mar 2026 as HBM costs passed through · <a href="https://intuitionlabs.ai/articles/data-center-gpu-pricing-2026">IntuitionLabs</a></li><li><strong>Futures</strong> — CME distributes Silicon Data's forward curves from Oct 15; H100 and B200 futures planned for Oct 5, pending regulatory review · <a href="https://cryptobriefing.com/cme-group-gpu-rental-forward-curve-pricing/">Crypto Briefing; Spheron</a></li><li><strong>Owner cost</strong> — Owner cost per GPU-hour: B200 $1.95, GB200 $2.21, GB300 $2.65 · <a href="https://inferencex.semianalysis.com/compare-per-dollar/deepseek-r1-b200-vs-gb300">SemiAnalysis via InferenceX</a></li><li><strong>Margins</strong> — DeepSeek's Feb 2025 disclosure: $87,072 a day of GPU cost against $562,027 of theoretical revenue · <a href="https://www.scmp.com/tech/big-tech/article/3300734/deepseek-shows-power-v3-r1-models-theoretical-545-profit-margin">South China Morning Post</a></li><li><strong>Margins</strong> — Zhipu cloud API gross margin −0.4% to 24.6%; API prices up about 101% this year · <a href="https://eu.36kr.com/en/p/3964873497320966">36Kr</a></li><li><strong>Margins</strong> — Zhipu API revenue and share; Zhipu and MiniMax gross margins, H1 2026 · <a href="https://eu.36kr.com/en/p/3964573800586498">36Kr</a></li><li><strong>Margins</strong> — MiniMax open-platform revenue up 703.1% · <a href="https://www1.hkexnews.hk/listedco/listconews/sehk/2026/0826/2026082600680.pdf">MiniMax interim results, HKEX</a></li><li><strong>Margins</strong> — Fireworks gross margin about 50%, targeting 60% · <a href="https://sacra.com/c/fireworks-ai/">Sacra</a></li><li><strong>Companies</strong> — Cerebras Q2: core cloud revenue $127.7M, core gross margin 41%, $6.4B IPO · <a href="https://www.sec.gov/Archives/edgar/data/0002021728/000162828026056186/cbrsannouncesfinancialresu.htm">Cerebras 8-K</a></li><li><strong>Companies</strong> — Nebius Q2 revenue $582M; AI business 50% adjusted EBITDA margin · <a href="https://www.cnhinews.com/news/article_1f4b4f84-df6d-59ed-9487-e8775c51781b.html">Zacks via CNHI</a></li><li><strong>Companies</strong> — CoreWeave managed-inference booked ARR from $1M to over $100M · <a href="https://futurumgroup.com/?p=94191">Futurum</a></li><li><strong>Companies</strong> — Fireworks, Together and Baseten valuations and revenue · <a href="https://www.vccafe.com/the-rise-of-the-inference-economy/">VC Cafe</a></li><li><strong>Companies</strong> — Lambda raising up to $4B at $14.5B pre-money · <a href="https://letsdatascience.com/news/lambda-pursues-4-billion-pre-ipo-funding-round-909f4022">Let's Data Science</a></li></ul>
<h2>Method</h2>
<p><strong>Revenue per GPU-hour.</strong> For NVIDIA’s recipes: output tokens per second per GPU ÷ 400 output tokens per request × dollars per request × 3,600. Dollars per request: 64,000 prompt tokens, 10% at the uncached input price and 90% at the cache-read price, plus 400 output tokens. Full load means the recipe’s measured concurrency around the clock. NVIDIA’s output figures include reasoning tokens; its GLM and Kimi runs use a 15% subset of the trace and a simulated speculative-decoding acceptance rate.</p>
<p><strong>The rack</strong> is vLLM’s figure on one GB300 NVL72 at DeepSeek’s off-peak prices, on SemiAnalysis’s AgentX traffic, a different trace from NVIDIA’s. The paler bars double the V4.1-Flash figures, since DeepSeek’s peak rates double every price.</p>
<p><strong>Break-even utilization</strong> is rent ÷ revenue at full load. Rents are typical on-demand prices on October 20, as in the <a href="https://06.ai/packs/deepinfer">DeepInfer</a> pack; committed rents are lower, so these overstate what a long-term renter needs. Owner costs are SemiAnalysis’s total cost of ownership from its 2025 survey.</p>
<p><strong>Not counted:</strong> CPUs, networking, cache storage, staff, a GPU cloud’s own margin on top of the GPU, and capacity sitting idle between peaks. NVIDIA’s trace is more input-heavy than OpenRouter’s 45-to-1 mix.</p>
<p><strong>Hosts</strong> are each host’s cheapest standard-routing endpoint on OpenRouter’s V4.1-Flash page on October 27, at discounted prices where a discount runs; list prices are kept in the data. Token counts for the week to October 26 are from our <a href="https://06.ai/trackers/openrouter">OpenRouter tracker</a>’s daily top 50.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>How many tokens can a GPU make?</title>
  <link>https://06.ai/packs/deepinfer</link>
  <guid isPermaLink="true">https://06.ai/packs/deepinfer</guid>
  <pubDate>Tue, 27 Oct 2026 12:14:00 GMT</pubDate>
  <description>DeepSeek open-sourced the engine behind its own API. Its benchmarks show what a Blackwell GPU now yields, what that is worth, and which chips get the gain. vLLM matched it three days later.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/deepinfer/cover.png" length="52784" type="image/png" />
  <media:content url="https://06.ai/newsletter/deepinfer/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/deepinfer"><img src="https://06.ai/newsletter/deepinfer/thumb.png" alt="How many tokens can a GPU make?" width="421" height="392"></a><figcaption><a href="https://06.ai/packs/deepinfer">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>DeepSeek open-sourced DeepInfer, the engine its own API runs on. Its benchmarks show a Blackwell GPU producing <strong>26,300</strong> output tokens a second at about 103 tokens a second per user, and DeepSeek says it earns <strong>$38</strong> an hour per GPU at its off-peak prices, about three times its 2025 figure. Only Blackwell data-center GPUs and Huawei’s Ascend 950 can run it. Three days later vLLM published results within 6% of it, so the yield is now available to anyone with a Blackwell rack.</p>
<ul><li><strong>6.3×</strong> — Output per decode GPU vs 2025. 11,573 tokens/s at DeepSeek’s production point, against 1,850 for V3 on H800s, at 11.5× the speed per user</li><li><strong>$38</strong> — Revenue per GPU-hour, off-peak. DeepSeek’s figure; vLLM gets $38.96 on agent traffic. $12.91 for V3 in 2025; a GB200 rents for $10.58</li><li><strong>155T</strong> — Tokens a day through one cluster. 94% of them cached input, on our reconstruction; about 2,700 GPUs</li><li><strong>≤6%</strong> — vLLM’s gap to DeepInfer on decode. Oct 23, on GB200 at batch 8 to 256; 954K tokens/s per GPU on agent traffic on a GB300 NVL72</li></ul>
<h2>Output per GPU falls as each user gets faster</h2>
<figure><a href="https://06.ai/packs/deepinfer#decode"><img src="https://06.ai/newsletter/deepinfer/fig-01.png" alt="Output per GPU falls as each user gets faster" width="694" height="442"></a><figcaption>DeepInfer decode on Blackwell at a 131,072-token context, as DeepSeek benchmarked it: output tokens per second per GPU against tokens per second per user, one dot per batch size. EP64 spreads the model’s experts over 64 GPUs in one NVLink domain, which takes a 72-GPU rack; EP8 over one 8-GPU box. Benchmark figures, before DeepSeek’s 80% haircut for live traffic.</figcaption></figure>
<h2>What DeepSeek released</h2>
<p>On October 20 DeepSeek put DeepInfer, the engine behind its own API, on GitHub under the Apache 2.0 license. It serves one model, V4.1-Flash, and runs only on NVIDIA’s Blackwell data-center GPUs (B200, B300 and their 72-GPU racks) and Huawei’s Ascend 950. Hopper GPUs such as the H100 and H200 fail its startup check, and AMD isn’t a build target. It is the offline core: the cache store, request routing and prefill/decode split a live service needs are left out, and the smallest efficient deployment is 64 prefill plus 64 decode GPUs. DeepSeek says the open build is within 5% of its internal one and that live traffic reaches about 80% of these benchmarks.</p>
<h2>Does it change GPU usage?</h2>
<p>Not for DeepSeek, which has run this stack since V4.1-Flash launched in September. For everyone else it set the bar, and the bar was cleared fast. On the dashboard we built on release day, DeepInfer’s curves implied about 2.0× the tokens per GPU vLLM had published on agent traffic a few days earlier (830K a second). On October 23 vLLM, the most widely used open-source engine, published decode results within 6% of DeepInfer’s across its batch sizes, using DeepSeek’s kernels, and 954K tokens a second per GPU on the same agent workload on a GB300 NVL72 rack, with the online serving DeepInfer lacks. That is 15% more than its October 17 figure, with a P90 speed of 196 tokens a second per user against a 100 target then. Anyone hosting V4.1-Flash on a Blackwell rack can now get close to DeepSeek’s own yield with an open engine, which cuts the GPUs a host needs for the same traffic.</p>
<h2>Does it change token yields?</h2>
<p>Against 2025, by a lot. At its production point DeepSeek gets 6.3× the output per decode GPU of its V3 fleet on H800s, at 11.5× the speed per user, and $38 of revenue per GPU-hour against $12.91, even after cutting prices by about three-quarters. Most of that arrived with the model: V4.1-Flash stores 890 bytes of cache per token, against 48,068 for V3.2. The engine is how DeepSeek cashes it in. But the yield depends on the speed sold: 26,300 tokens a second per GPU at 103 per user, falling to 26,300 at 103.</p>
<h2>Do GPU types change differently?</h2>
<p>Yes, and topology matters more than the chip. Decode wants 64 to 128 GPUs in one NVLink domain, which only GB200 and GB300 NVL72 racks offer. An 8-GPU B200 or B300 box keeps up at relaxed speeds and tops out at 239 tokens a second per user. Hopper and AMD gain nothing directly. Ascend 950 is a first-class target, which matters more for China’s chip mix than for anyone’s throughput.</p>
<h2>Cost per million output tokens at market rental</h2>
<figure><a href="https://06.ai/packs/deepinfer#cost"><img src="https://06.ai/newsletter/deepinfer/fig-02.png" alt="Cost per million output tokens at market rental" width="694" height="392"></a><figcaption>Typical rental per GPU-hour on October 20 ÷ output per GPU-hour, after the 80% live-traffic factor. GB200 NVL72 on the EP64 curve at $10.58 an hour; HGX B200 on the EP8 curve at $8.02, scaled to its 90% peak rate. The dashed line is DeepSeek’s off-peak output price. GPU time only: prefill, cache storage and the rest of the stack are extra.</figcaption></figure>
<p>The 8-GPU box is the cheaper way to buy output up to about 130 tokens a second per user; past that the rack wins, by a widening margin. The box costs more per output token than DeepSeek charges off-peak beyond about 225; the rack holds out to about 310. At equal speed the rack makes 1.1× the box’s output per GPU at 105 tokens a second per user and 6.4× at 235.</p>
<h2>What DeepInfer changes, chip by chip</h2>
<p>Per-GPU specs from vendor sheets and coverage, HBM as vendors list it. Scale-up domain is the most GPUs one interconnect domain holds. Rental is the typical on-demand price per GPU-hour on October 20. “What changes” is our assessment.</p>
<ul><li><strong>GB200 NVL72 NVIDIA</strong> — DeepInfer: Runs · FP4 PFLOPS: 10 · HBM GB: 186 · Scale-up: 72 · Rent / hr: $10.58 · Full effect. The setup DeepSeek benchmarks: EP64 decode inside one 72-GPU NVLink domain, Mega MoE kernels, native FP4 weights.</li><li><strong>GB300 NVL72 NVIDIA</strong> — DeepInfer: Runs · FP4 PFLOPS: 15 · HBM GB: 279 · Scale-up: 72 · Rent / hr: $14.59 · Full effect expected; FlashMLA and DeepGEMM build for SM 10.3. Extra HBM matters less now that KV no longer binds; extra FP4 compute helps prefill. Rents for about 38% more than GB200 per GPU-hour.</li><li><strong>HGX B200 NVIDIA</strong> — DeepInfer: Runs · FP4 PFLOPS: 9 · HBM GB: 180 · Scale-up: 8 · Rent / hr: $8.02 · Partial. Runs DeepInfer, but the NVLink island caps decode at EP8: close to parity at relaxed speeds, falls behind fast. DeepSeek uses 8-GPU boxes for prefill.</li><li><strong>HGX B300 NVIDIA</strong> — DeepInfer: Runs · FP4 PFLOPS: 13.5 · HBM GB: 270 · Scale-up: 8 · Rent / hr: $9.99 · Partial, as B200. More HBM and FP4 compute don't lift the EP8 ceiling on fast decode; well suited to prefill.</li><li><strong>H200 NVIDIA</strong> — DeepInfer: No · HBM GB: 141 · Scale-up: 8 · Rent / hr: $5.33 · No direct effect. The engine's startup check rejects anything but SM 10.x and Hopper has no FP4 tensor cores. Gains arrive only as vLLM and SGLang port the ideas.</li><li><strong>H100 NVIDIA</strong> — DeepInfer: No · HBM GB: 80 · Scale-up: 8 · Rent / hr: $4.17 · No direct effect, as H200, with less HBM.</li><li><strong>H800 NVIDIA</strong> — DeepInfer: No · HBM GB: 80 · Scale-up: 8 · No direct effect. The chip DeepSeek served V3 and R1 on in 2025.</li><li><strong>H20 NVIDIA</strong> — DeepInfer: No · HBM GB: 96 · Scale-up: 8 · No direct effect; also the weakest compute in this table.</li><li><strong>MI355X AMD</strong> — DeepInfer: No · FP4 PFLOPS: 10.07 · HBM GB: 288 · Scale-up: 8 · Rent / hr: $5.60 · No direct effect. FP4-capable, but DeepInfer's kernels are CUDA or Ascend only; runs V4.1-Flash through vLLM, SGLang or ATOM.</li><li><strong>MI300X AMD</strong> — DeepInfer: No · HBM GB: 192 · Scale-up: 8 · Rent / hr: $3.65 · No direct effect; no FP4 matrix units, so FP4 experts are dequantized in software.</li><li><strong>Ascend 950 Huawei</strong> — DeepInfer: Runs · FP4 PFLOPS: 2 · HBM GB: 144 · Scale-up: 8,192 · Strategic. First-class target (DeepGEMM-Ascend, DeepEP-Ascend, TileLang). DeepSeek and Huawei built a 128-chip Ascend 950 supernode that fits the decode design; Huawei's SuperPoD scales to 8,192 chips. Peak FP4 per chip is a fifth of GB200's.</li></ul>
<h2>Most tokens are cache reads; most revenue isn’t</h2>
<figure><a href="https://06.ai/packs/deepinfer#recon"><img src="https://06.ai/newsletter/deepinfer/fig-03.png" alt="Most tokens are cache reads; most revenue isn’t" width="694" height="178"></a><figcaption>How $38 per GPU-hour adds up at V4.1-Flash off-peak prices: one prefill GPU per decode GPU, as DeepSeek runs them, both at the production point and the 80% factor. We solve for the share of input that hits the cache so the pair averages DeepSeek’s figure: 95%, close to the 96% that agent benchmarks measure.</figcaption></figure>
<p>At those rates about 2,700 GPUs would carry the 155T tokens a day DeepSeek reports and bill about $0.9B a year off-peak, or $1.1B counting peak hours at double. Reported annualized revenue for all of DeepSeek was about $1.0B at the start of October, so the figures hang together. vLLM’s independent $38.96 on a GB300 NVL72 points the same way.</p>
<h2>Memory no longer limits the batch</h2>
<figure><a href="https://06.ai/packs/deepinfer#kv"><img src="https://06.ai/newsletter/deepinfer/fig-04.png" alt="Memory no longer limits the batch" width="694" height="202"></a><figcaption>How many 131,072-token sessions fit in 100 GB of HBM, by generation, log scale. At DeepInfer’s largest decode batch, 256 such sessions take about 30 GB per GPU, so bandwidth and communication now set decode speed, not memory.</figcaption></figure>
<h2>Then and now</h2>
<p>DeepSeek’s February 2025 fleet averages for V3 and R1 on H800s against V4.1-Flash on DeepInfer at its production point, after the 80% factor. Different chips and price decks; V3 revenue is DeepSeek’s theoretical figure at R1 list prices.</p>
<figure><a href="https://06.ai/packs/deepinfer#gens"><img src="https://06.ai/newsletter/deepinfer/fig-05.png" alt="Output tokens/s per decode GPU — V3 / R1 on H800 · Feb 2025: 1,850 · V4.1-Flash on DeepInfer · Oct 2026: 11,573 · Change: 6.3×; Per-user output speed, tokens/s — V3 / R1 on H800 · Feb 2025: 21 · V4.1-Flash on DeepInfer · Oct 2026: 241 · Change: 11.5×; GPU-hours per billion output tokens — V3 / R1 on H800 · Feb 2025: 150 · V4.1-Flash on DeepInfer · Oct 2026: 24 · Change: −84%; Revenue per GPU-hour — V3 / R1 on H800 · Feb 2025: $12.91 · V4.1-Flash on DeepInfer · Oct 2026: $38.00 · Change: 2.9×; Output, per 1M tokens — V3 / R1 on H800 · Feb 2025: $2.19 · V4.1-Flash on DeepInfer · Oct 2026: $0.60 · Change: −73%; Uncached input, per 1M tokens — V3 / R1 on H800 · Feb 2025: $0.55 · V4.1-Flash on DeepInfer · Oct 2026: $0.15 · Change: −73%; Cached input, per 1M tokens — V3 / R1 on H800 · Feb 2025: $0.140 · V4.1-Flash on DeepInfer · Oct 2026: $0.003 · Change: −98%" width="694" height="457"></a></figure>
<h2>Where the gain comes from</h2>
<p><strong>The model.</strong> V4.1-Flash keeps 890 bytes of cache per token, 3.9× less than V4-Flash, and activates 8B parameters when reading and 16B when writing. Its launch prices show where costs fell: cached input 57% cheaper than V4-Flash, uncached input 32%, output only 9%.</p>
<p><strong>The engine.</strong> Wide expert parallelism is most of it. Bounded replay rebuilds only the last 140 tokens of sliding-window state, which DeepSeek says nearly halves prefill work. Confidence-scheduled drafting verifies fewer guessed tokens per step and adds 5% throughput at the production batch, 11% at the largest.</p>
<p><strong>The hardware.</strong> The model’s expert weights are in FP4, which Blackwell, AMD’s MI355X and Ascend 950 multiply natively and Hopper does not. Decode wants a big NVLink domain, which is why the rack beats the box.</p>
<h2>What it means</h2>
<p><strong>For GPU economics.</strong> A GB200 rents for about $10.58 an hour and, served this way, earns $38 at DeepSeek’s off-peak prices. Serving open models on Blackwell racks is profitable at market GPU prices, so long as the traffic is cache-heavy agent work, and vLLM now makes that available to every host. Third-party hosts charge about DeepSeek’s peak rate, so there is room for their prices to fall toward its off-peak ones (<a href="https://06.ai/packs/token-prices">the </a><a href="https://06.ai/packs/token-prices">token-price</a><a href="https://06.ai/packs/token-prices"> pack</a>).</p>
<p><strong>For older chips.</strong> Hopper rents for less but gets none of this directly, and it can’t do the FP4 math. The yield gap between a Blackwell rack and an H100 widens with each release like this one, which should weigh on Hopper rental prices over time.</p>
<p><strong>For China.</strong> DeepSeek built Ascend 950 support in from the start and is reported to be planning a 160,000-chip Huawei data center. DeepSeek hasn’t published any Ascend throughput, which is the number to watch.</p>
<h2>What this is anchored on</h2>
<p>Decode and prefill points are read off DeepSeek’s benchmark charts; rental prices and DeepInfer figures as of October 20, vLLM’s as of October 23.</p>
<ul><li><strong>DeepInfer</strong> — Engine, supported hardware, decode and prefill benchmark charts, $38 per GPU-hour, 155T tokens a day · <a href="https://github.com/deepseek-ai/DeepInfer">DeepInfer repository</a></li><li><strong>DeepInfer</strong> — Production concurrency, draft verification table, balance factor, KV storage, minimum deployment · <a href="https://github.com/deepseek-ai/DeepInfer/blob/main/doc/inference_deployment_qa.md">DeepInfer deployment Q&amp;A</a></li><li><strong>V4.1-Flash</strong> — Parameters, 890 bytes of KV cache per token, KV series by generation · <a href="https://arxiv.org/abs/2609.19969">DeepSeek-V4.1-Flash technical report</a></li><li><strong>V4.1-Flash</strong> — KV-cache series by generation · <a href="https://www.contextstudios.ai/blog/deepseek-v4-1-flash-890-bytes-kv-cache-per-token">Context Studios</a></li><li><strong>Prices</strong> — V4-Flash and V4.1-Flash off-peak and peak rates; peak hours a week · <a href="https://apidog.com/blog/deepseek-v4-1-flash-pricing/">Apidog</a></li><li><strong>vLLM</strong> — Within 6% of DeepInfer on decode; 954K tokens/s per GPU on AgentX, GB300 NVL72; $38.96 per GPU-hour (Oct 23) · <a href="https://vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-ep">vLLM blog</a></li><li><strong>vLLM</strong> — 830K tokens/s per GPU on AgentX at 100 tok/s per user (Oct 17) · <a href="https://aicoder.com/news/news-20261017-vllm-openrouter-deepseek-v41-flash-1017-day0-serving">AICoder</a></li><li><strong>vLLM</strong> — 5× high-throughput gain on V4.1-Flash since day 0 · <a href="https://vllm.ai/blog/2026-10-07-deepseek-v41-flash">vLLM blog</a></li><li><strong>AgentX</strong> — Median input and output tokens, cache-hit rate · <a href="https://www.matthewswong.com/en/blog/deepseek-v4-1-flash-serving-vllm-vs-sglang/">AgentX workload</a></li><li><strong>AgentPerf</strong> — Tokens/s per MW by system on V4.1-Flash · <a href="https://artificialanalysis.ai/articles/vera-rubin-nvl72-agentperf">Artificial Analysis</a></li><li><strong>AgentPerf</strong> — MI355X, B200 and B300 results · <a href="https://cryptobriefing.com/amd-mi355x-aa-agentperf-deepseek-results/">CryptoBriefing</a></li><li><strong>Rental</strong> — Typical on-demand price per GPU-hour, Oct 20 · <a href="https://savrn.com/ai-index/pricing/gpus">Savrn AI index</a></li><li><strong>Ascend 950</strong> — Specs · <a href="https://www.techradar.com/pro/huawei-ascend-950-vs-nvidia-h200-vs-amd-mi300-instinct-how-do-they-compare">TechRadar</a></li><li><strong>Ascend</strong> — DeepSeek’s Ascend tooling; planned Huawei data center; $1B run-rate · <a href="https://thenextweb.com/news/deepseek-huawei-ascend-tilelang-open-source-cuda">The Next Web</a></li><li><strong>DeepInfer</strong> — Release coverage · <a href="https://www.marktechpost.com/2026/10/20/deepseek-deepinfer-open-source-inference-framework/">MarkTechPost</a></li><li><strong>DeepInfer</strong> — Release coverage · <a href="https://thenextweb.com/news/deepseek-deepinfer-open-source-inference-engine">The Next Web</a></li><li><strong>V3 / R1, 2025</strong> — DeepSeek’s Feb 2025 inference-system figures on H800s · <a href="https://www.analyticsvidhya.com/blog/2025/03/deepseek-inference-system-overview/">Analytics Vidhya</a></li></ul>
<h2>Method</h2>
<p><strong>Reading the charts.</strong> DeepSeek’s decode chart defines output per GPU as per-user speed × requests per GPU, and our readings meet that within 0.5%. Decode output assumes 75% acceptance on 3 draft tokens, as DeepSeek’s chart does; only the step rate is measured. The EP64 curve ran inside one NVLink domain, so on a GB200 or GB300 NVL72 rack; DeepSeek doesn’t say which.</p>
<p><strong>The production point</strong> is DeepSeek’s draft-verification table at 60 sequences per GPU, which it says is where production runs. “After the live-traffic factor” multiplies by 80%, DeepSeek’s ratio of live traffic to its perfectly balanced benchmarks.</p>
<p><strong>Costs</strong> use typical on-demand rental per GPU-hour, not DeepSeek’s own costs, which it doesn’t disclose. HGX B200 output is the EP8 curve scaled by DeepInfer’s own peak-rate table (2,250 against 2,500 TFLOPS).</p>
<p><strong>The revenue check</strong> assumes every GPU runs at the production point around the clock, with prefill at 32,768-token steps. The comparison with vLLM’s earlier result priced one agent request (131,072-token context, 4,096 uncached, 444 output tokens) in DeepInfer GPU-seconds; it set an offline benchmark against a live replay, so it was indicative, and vLLM’s like-for-like decode test on October 23 supersedes it.</p>
<p><strong>What DeepSeek doesn’t disclose:</strong> which Blackwell part ran the benchmarks, whether the cluster behind the daily token figure is NVIDIA, Ascend or both, fleet size, the real cache-hit share, and any Ascend 950 throughput.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Can the cloud pay for the AI capex?</title>
  <link>https://06.ai/packs/cloud-capex-payback</link>
  <guid isPermaLink="true">https://06.ai/packs/cloud-capex-payback</guid>
  <pubDate>Mon, 26 Oct 2026 12:13:00 GMT</pubDate>
  <description>Azure is growing 43% and AWS 37%, the fastest in years. How much of that is AI, what Microsoft’s and Amazon’s AI capex earns from the cloud alone with their OpenAI and Anthropic stakes at zero, and what happens if the labs can’t pay.</description>
  <category>AI returns</category>
  <enclosure url="https://06.ai/newsletter/cloud-capex-payback/cover.png" length="61213" type="image/png" />
  <media:content url="https://06.ai/newsletter/cloud-capex-payback/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/cloud-capex-payback"><img src="https://06.ai/newsletter/cloud-capex-payback/thumb.png" alt="Can the cloud pay for the AI capex?" width="421" height="409"></a><figcaption><a href="https://06.ai/packs/cloud-capex-payback">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>Before AI, both clouds were slowing: Azure from 50% growth in 2021 to 26% in mid-2023, AWS from 40% to 12%. Now Azure grows <strong>43%</strong> and AWS <strong>37%</strong>. We estimate AI accounts for about <strong>26 of Azure’s 43 points</strong> of growth this year and <strong>17 of AWS’s 33</strong>. Renting out compute takes a lot of capital, and so far each dollar has earned more at Amazon than at Microsoft: in 2026, about 40 cents a year of AI revenue for each dollar of AI capex already in service at Amazon, and 26 cents at Microsoft. Count only cloud revenue, charge all the AI capex, value the stakes in OpenAI and Anthropic at zero, and the spending through 2027 earns about <strong>12.8% a year at Amazon</strong> and <strong>3.0% at Microsoft</strong>. Both numbers turn on how quickly capex starts earning, and on two labs that don’t yet make money paying their bills. These are the middle of our ranges.</p>
<ul><li><strong>26 of 43 pts</strong> — AI’s share of Azure’s 2026 growth about $39B of revenue, 32% of Azure, against a no-AI trend of 17% a year</li><li><strong>17 of 33 pts</strong> — AI’s share of AWS’s 2026 growth about $31B, 18% of AWS, against 14.5%; in line with Amazon’s own AI run-rates</li><li><strong>12.8%</strong> — Amazon’s return on AI capex through 2027 a year from AWS alone, stakes at zero. 8.6% charging the $68B it put into OpenAI and Anthropic; 7.2% if the labs pay half their bills from 2028</li><li><strong>3.0%</strong> — Microsoft’s return on AI capex through 2027 from Azure alone; 6.0% counting the Copilots, 2.4% charging the money put into the labs, −6.0% if the labs pay half from 2028</li></ul>
<h2>Both clouds bottomed in 2023; AI turned them back up</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#growth"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-01.png" alt="Both clouds bottomed in 2023; AI turned them back up" width="694" height="352"></a><figcaption>Revenue growth against the same quarter a year earlier. Azure is Microsoft’s “Azure and other cloud services” as reported at the time (fiscal 2024 as restated in August 2024); its fiscal year ends in June. On the narrower definition Microsoft adopted in September, the June 2026 quarter was 42%. Open dots are estimates: Azure 44% in both quarters (Microsoft guides 44–45% in constant currency on the new definition for the September quarter), AWS 32.5%, the middle of analysts’ 30–35% for the third quarter.</figcaption></figure>
<h2>What changed</h2>
<p><strong>Microsoft.</strong> Azure’s growth fell from 50% in the quarter to September 2021 to 26% in the quarter to June 2023, as customers cut their cloud bills. It has climbed since, to 43% in the quarter to June 2026 (42% on the definition Microsoft now reports), and Microsoft guides 44–45% in constant currency for the quarter to September. Azure passed $100B of revenue in the year to June. Microsoft says demand still exceeds the capacity it can bring online and expects to roughly double that capacity in two years.</p>
<p><strong>Amazon.</strong> AWS slowed from 40% at the end of 2021 to 12% in mid-2023. It grew about 17% in the first half of 2025, then 20%, 24%, 28% and, in the second quarter of 2026, 37%, its fastest in 18 quarters. Amazon says it won’t have enough capacity for all of 2026’s demand and expects the same in 2027. The whole market is moving: Synergy Research puts cloud infrastructure spending up 43% in the second quarter, with generative-AI services up 165%.</p>
<h2>Microsoft said how much of Azure’s growth was AI, until AI was 16 points of it</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#azpts"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-02.png" alt="Microsoft said how much of Azure’s growth was AI, until AI was 16 points of it" width="694" height="352"></a><figcaption>Azure revenue growth against a year earlier, split into AI services and the rest. Through the quarter to March 2025 the split is Microsoft’s own; after that it is our estimate, at a 17% trend for the rest (lighter). Growth is as Microsoft first reported it, so the split adds up; the quarters to September and December 2026 are estimates.</figcaption></figure>
<p>Microsoft’s points show AI rising from about 1 point of Azure’s growth in mid-2023 to 16 points by March 2025, when AI services were about 19% of Azure. The rest of Azure slowed as it did so, from 24 points of growth in the quarter to March 2024 to 17 a year later. Microsoft has since given only its AI business’s run-rate, which “surpassed an annual revenue run rate of $37 billion” in April 2026, Copilots included. At a 17% trend for the rest, AI adds about 20 points of Azure’s growth through 2025 and 26 by mid-2026, when it is about 34% of Azure. By the same chain, AI was already about 5% of Azure in 2022. Earlier capex paid for that, so for the returns we leave it, and its growth, out.</p>
<h2>By our estimate AWS will spend about as much on capex this year as it takes in</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#capex"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-03.png" alt="By our estimate AWS will spend about as much on capex this year as it takes in" width="694" height="332"></a><figcaption>Capex as a share of revenue. Microsoft: capex including finance leases, calendar years; 2026 is its April guide of about $190B, before it moved more data-center leases off capex (about $175B on the new basis). Amazon: cash capex plus property bought under finance leases; 2026 is its guide of about $220B plus about $4B of finance leases. AWS: its share of Amazon’s property additions applied to that capex; 2026 at our 75%. The ticks mark Microsoft’s and AWS’s 2019–23 intensity, the baseline we treat as non-AI (in the model it applies to no-AI revenue).</figcaption></figure>
<h2>The backlogs say the demand is there, and that much of it is two labs</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#backlog"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-04.png" alt="The backlogs say the demand is there, and that much of it is two labs" width="694" height="332"></a><figcaption>Contracted revenue not yet recognized, end of quarter, $B. Microsoft: commercial remaining performance obligation, which also covers Microsoft 365 and other commercial contracts; at the end of 2025, 45% of it was OpenAI’s. AWS: Amazon’s performance obligations, primarily AWS; by our arithmetic, OpenAI’s $138B and Anthropic’s more than $100B of commitments make up about half.</figcaption></figure>
<h2>Is growth accelerating?</h2>
<p><strong>Yes, at both, and capacity is the limit.</strong> Azure grew 39–40% for four quarters, then 43%, and Microsoft guides 44–45%. AWS has accelerated for five straight quarters. Microsoft’s commercial backlog reached $678B in June, up 84%; excluding OpenAI it grew 25%, and all of the quarter’s increase came from customers other than the frontier labs. AWS’s went from $195B to $496B in a year, with an average remaining life of 6.4 years, after OpenAI added $100B of commitments and Anthropic more than $100B.</p>
<h2>By our estimate AI adds about $39B to Azure this year and $31B to AWS</h2>
<p>Azure, 2026: $122B of revenue, $39B of it (32%) from AI at a 17% no-AI trend. AI adds about 26 of this year’s 43 points of growth.</p>
<figure><a href="https://06.ai/packs/cloud-capex-payback#uplift"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-05.png" alt="By our estimate AI adds about $39B to Azure this year and $31B to AWS" width="694" height="362"></a><figcaption>Revenue against a no-AI trend. Azure’s follows Microsoft’s own split of AI and the rest in 2023 and 2024, with the AI Azure already had in 2022 kept on the no-AI side; AWS’s starts from 2023. The gap is above-trend revenue; we credit AI with 90% of it from 2025 (at AWS, from 2024). 2026 and 2027 are estimates (dashed): 2027 is what the capacity bought through 2027 can rent for, as in our base case. Choose the business and the no-AI trend.</figcaption></figure>
<h3>By business</h3>
<figure><a href="https://06.ai/packs/cloud-capex-payback#uplift"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-06.png" alt="By our estimate AI adds about $39B to Azure this year and $31B to AWS — AWS" width="694" height="393"></a><figcaption><strong>AWS</strong>, 2026: $171B of revenue, $31B of it (18%) from AI at a 14.5% no-AI trend. AI adds about 17 of this year’s 33 points of growth.</figcaption></figure>
<h2>How we split AI from trend</h2>
<p>Both trends are checked against what the companies themselves disclose. <strong>Azure, 17% a year from 2025:</strong> by Microsoft’s own split, Azure outside AI grew about 24% in 2024 and was down to 19% by early 2025. At 17%, Azure’s AI services ran at about $30B a year in early 2026; add the Copilots and that fits Microsoft’s AI run-rate of more than $37B in April. <strong>AWS, 14.5%:</strong> it grew 13% in 2023 and 19% in 2024, when AI was a small business. At 14.5%, AWS’s AI revenue ran at about $20B a year in the first quarter of 2026 and $32B in the second; Amazon says it was “over $15 billion in Q1 2026” and above $25B in the second quarter. Much above 16%, our method falls short of Amazon’s own figures, so the simulation drops draws that do. The rest of each gap we leave to things that aren’t AI.</p>
<p>At these settings AI adds 19 points to Azure’s growth in 2025 and 26 in 2026, 32% of this year’s revenue, and 5 and 17 points to AWS’s, 18%. AI’s points are the growth in AI’s revenue over last year’s revenue, so they and the rest add up to the year’s growth. Microsoft’s Copilots aren’t counted: Microsoft 365’s commercial cloud revenue has grown 14–16% a year in constant currency since mid-2024, no faster than before Copilot.</p>
<h2>From the cloud alone, Amazon’s AI capex clears 10%; Microsoft’s falls well short</h2>
<p>At a 60% cash margin and the base no-AI trend (Azure 17%, AWS 14.5%): Amazon 13.6% through 2026 and 12.8% with 2027, 8.1% all-in; Microsoft 4.1%, 3.0% and 0.7%.</p>
<figure><a href="https://06.ai/packs/cloud-capex-payback#irr"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-07.png" alt="From the cloud alone, Amazon’s AI capex clears 10%; Microsoft’s falls well short" width="694" height="392"></a><figcaption>Internal rate of return on AI capex with the stakes in OpenAI and Anthropic, and each company’s own models and assistants, at zero. Every dollar of capex above the pre-buildout intensity is charged. 2027 capex is our estimate: $225B at Microsoft on its old lease definition, $290B at Amazon with 75% to AWS. All-in adds the cash put into the labs (Amazon $68B, Microsoft about $14B), half of Microsoft’s neocloud contracts (the half we assume serves its own teams, about $38B over 2026–33) and running costs for the share of the fleet that doesn’t rent to customers. The line is a 10% hurdle.</figcaption></figure>
<h2>How the return is counted</h2>
<p><strong>Returns.</strong> Cloud revenue needs capacity, so after 2026 we tie AI revenue to it. We assume capex starts earning two quarters after it is spent: servers earn within weeks of landing, data centers a year or more after work starts. On that basis each dollar of incremental capex brought in about 40 cents a year of AI revenue at Amazon in 2026 and 26 cents at Microsoft. Microsoft’s is lower, probably because more of its capex has gone into things Azure’s revenue doesn’t show: its own models and Copilots, capacity for OpenAI’s research, and data-center sites ahead of use. At Microsoft we also leave out the 10% of Azure’s AI revenue we estimate runs on capacity it rents from neoclouds (it paid CoreWeave about $3.4B in 2025), and that capacity’s cost. Each dollar of capacity keeps renting at that rate, less 2.5% a year as compute gets cheaper, at a 60% cash margin before depreciation. That is a little above AWS’s 52% (operating income plus depreciation) in 2025; AWS’s operating margin was 39% in the second quarter of 2026, up from 33% a year earlier.</p>
<p><strong>Costs.</strong> All capex above a pre-buildout intensity: 14% of Microsoft’s no-AI revenue (its 2019–23 average, finance leases included) and 31% of AWS’s, about $449B at Microsoft and $367B at Amazon over 2023–27. Microsoft’s 2026 capex is its April guide, $190B, before it moved more data-center leases off capex. Servers, 60% of capex (Microsoft has said half to two-thirds), are replaced every 6 years at Microsoft and 5 at Amazon, at 75% of their cost, for the 75% of the fleet that rents to customers. Servers get bonus depreciation for tax (100% since 2025), data centers go over 20 years. Nothing is counted after 2040, though the data centers will still stand.</p>
<p><strong>Results.</strong> Through 2026: 13.6% at Amazon, 4.1% at Microsoft. Adding 2027’s build: 12.8% and 3.0%, paid back in 2033 and 2037. The cloud’s return barely depends on whether 2027 is spent, since new capacity earns what the old does as long as it rents at today’s rates; if 2027’s rents for 20% less, the returns fall to 10.4% and 1.3%. The biggest unknown is how long capex takes to start earning, because that sets how much each dollar in service earns today. If capex earns from one quarter after it is spent, more of it is already in service, each dollar earns less, and the returns fall to 6.2% at Amazon and −1.3% at Microsoft; from three quarters, they rise to 20.3% and 7.5%. Every ten points of margin move the returns four to five points. On the same question, Meta’s ads return about 18% and Alphabet’s ads and Cloud 13% (<a href="https://06.ai/packs/ai-capex-payback">the </a><a href="https://06.ai/packs/ai-capex-payback">ad-payback</a><a href="https://06.ai/packs/ai-capex-payback"> pack</a>).</p>
<h2>Payback comes in 2033 at Amazon and 2037 at Microsoft</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#jcurve"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-08.png" alt="Payback comes in 2033 at Amazon and 2037 at Microsoft" width="694" height="362"></a><figcaption>Cumulative after-tax cash flow of each AI program, $B: AI’s share of cloud cash profit, less incremental capex, server replacements and tax; capex through 2027. Dashed: all-in, with the cash put into the labs, running costs for the fleet that doesn’t rent out and, at Microsoft, half its neocloud contracts. The dots mark payback.</figcaption></figure>
<h2>If the labs can’t pay, Microsoft’s return goes negative and Amazon’s drops below 10%</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#labs"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-09.png" alt="If the labs can’t pay, Microsoft’s return goes negative and Amazon’s drops below 10%" width="694" height="342"></a><figcaption>Internal rate of return on AI capex through 2027 if, from 2028, OpenAI and Anthropic pay only part of their bills, and the capacity they stop paying for is re-let at half the price. We put the labs at 80% of Azure’s AI revenue and 50% of AWS’s. Dashed: all-in. The chart stops at −20%; the labels give the values below it.</figcaption></figure>
<h2>Two customers, and two stakes</h2>
<p><strong>The labs are much of the AI revenue.</strong> Microsoft says nearly 90% of Microsoft Cloud’s $214B of revenue in fiscal 2026 came from customers other than frontier-model companies. That leaves the labs about $22–26B, against our estimate of about $29B for all of Azure’s AI revenue that year, so we put them at 80% of it; OpenAI was 45% of Microsoft’s commercial backlog at the end of 2025. At Amazon, OpenAI’s and Anthropic’s commitments are about half the backlog, and we use 50%. The labs pay with money they raise: OpenAI’s own plan has it burning about $278B of cash over 2026–30 (<a href="https://06.ai/packs/ai-labs-funding">the </a><a href="https://06.ai/packs/ai-labs-funding">lab-funding</a><a href="https://06.ai/packs/ai-labs-funding"> pack</a>), though both labs’ revenue is compounding fast (<a href="https://06.ai/packs/ai-lab-revenue">the </a><a href="https://06.ai/packs/ai-lab-revenue">lab-revenue</a><a href="https://06.ai/packs/ai-lab-revenue"> pack</a>). If from 2028 they paid only half their bills, and the capacity they left were re-let at half price, Microsoft’s return through 2027 would fall to −6.0% and Amazon’s to 7.2%.</p>
<p><strong>The stakes are where the payoff might be.</strong> This pack counts them at zero. Amazon carried its Anthropic notes and preferred stock at about $190B at the end of June, against $18B invested, and has booked about $80B of pre-tax gains on them since early 2025; it has also put $50B into OpenAI, which committed another $100B to AWS. Microsoft’s roughly 27% of OpenAI was valued at about $135B in October 2025; OpenAI has since raised money at $852B. Charge the cash put into the labs and value the stakes at nothing, and the returns through 2027 are 8.6% at Amazon and 2.4% at Microsoft; all-in, with running costs and Microsoft’s neocloud contracts too, 8.1% and 0.7%. Count the stakes at their marks and the AI build has already paid for a good part of itself, on paper.</p>
<h2>Amazon’s build clears 10% in about two-thirds of our draws; Microsoft’s in fewer than one in ten</h2>
<figure><a href="https://06.ai/packs/cloud-capex-payback#odds"><img src="https://06.ai/newsletter/cloud-capex-payback/fig-10.png" alt="Amazon’s build clears 10% in about two-thirds of our draws; Microsoft’s in fewer than one in ten" width="694" height="344"></a><figcaption>Internal rate of return across 8,000 draws, each assumption uniform across its range, centered on the base case: the no-AI trend (Azure 14–20%, AWS 13–16%), AI’s share of the gap (80–100%), the lag from capex to revenue (one to three quarters), growth in the second half of 2026 (Azure 42–46%, AWS 30–35%), the share of Azure’s AI revenue on rented capacity (5–15%), the cash margin (50–70%), the fade in revenue per unit of capacity (0–5% a year), the share of the fleet that rents to customers (60–90%), the capex baseline (Microsoft 12–16%, AWS 28–34%), 2027 capex ($195–255B Microsoft, $250–330B Amazon), AWS’s share of Amazon’s capex (65–85%), server life (Microsoft 5–7 years, Amazon 4–6), replacement cost (60–90%), all-in running costs (2–4%) and, in the labs rows, the share of the labs’ bills paid from 2028 (50–100%) and their share of AI revenue (Microsoft 65–95%, Amazon 35–65%). AWS draws that contradict Amazon’s own AI run-rates are dropped (3% of them). Fixed: tax rates, the horizon, 2026 capex, the server share of capex (60%), what new capacity rents for (today’s rate) and the re-let price (half). Bars run from the 10th to the 90th percentile; the dot is the median.</figcaption></figure>
<h2>When does the cash come back?</h2>
<p>AI capex through 2027 clears a 10% return in 64% of our draws for Amazon and 8% for Microsoft, and clears zero in 97% and 72%. All-in, it clears 10% in 36% and 3%. The medians, 12.5% and 3.0%, sit within a point of the base case. Andy Jassy’s case is that the returns come later: “The FCF and ROIC for these investments are cumulatively quite attractive a couple years after being in service.” Amazon’s free cash flow was −$7.6B over the twelve months to June. Microsoft’s was $19.6B in the June quarter, down 23% on a year earlier, and it guides capex up again in fiscal 2027.</p>
<h2>What to watch</h2>
<p><strong>Microsoft, October 28.</strong> Azure against the 44–45% guide, now on the narrower definition; capex against “over $50 billion” for the quarter and any figure for fiscal 2027; whether the backlog keeps growing outside OpenAI.</p>
<p><strong>Amazon, October 29.</strong> AWS against analysts’ 30–35%; capex against $220B for the year and a first word on 2027; the backlog after the OpenAI and Anthropic expansions; the AI run-rate, last above $25B.</p>
<p><strong>The labs’ funding.</strong> OpenAI’s next round and Anthropic’s IPO decide whether the bills behind half of AWS’s backlog, and most of Azure’s AI revenue, get paid. In our base case a lab dollar is worth the same as any other; the labs chart shows what happens when it isn’t.</p>
<h2>What this is anchored on</h2>
<p>No-AI trends, AI’s share of above-trend revenue, the lag, the second half of 2026, 2027 capex, margins, replacement, rented capacity, the labs’ share of AI revenue, timing of the all-in costs and the returns are our estimates, built from the sources below.</p>
<ul><li><strong>Microsoft FY26 Q4</strong> — Revenue $90.0B, +18%, and $331.8B for the fiscal year; Azure and other cloud services +43%; Azure revenue passed $100B for the first time; free cash flow $19.6B, down 23% · <a href="https://www.sec.gov/Archives/edgar/data/0000789019/000119312526323632/msft-ex99_1.htm">Microsoft FY26 Q4 results (8-K), Jul 29</a></li><li><strong>Microsoft FY26 Q4 call</strong> — Capex $41B, about two-thirds short-lived assets (GPUs and CPUs), including $5.6B of finance leases; data-center useful life extended from 15 to 25 years, so more future data-center leases will be operating leases, outside capex; calendar 2026 capex about $175B on that basis, plans otherwise unchanged; fiscal Q1 2027: Azure about 45% in constant currency, capex over $50B; commercial RPO $678B, +84%, +25% excluding OpenAI, all of the quarter’s increase from customers outside frontier-model companies; Microsoft Cloud gross margin 65%; over 30M paid Microsoft 365 Copilot seats; demand exceeds capacity; capacity to roughly double in two years · <a href="https://www.fool.com/earnings/call-transcripts/2026/08/07/microsoft-msft-q4-2026-earnings-call-transcript/">Microsoft FY26 Q4 call, via The Motley Fool</a></li><li><strong>Microsoft FY26 Q4 call</strong> — Nearly 90% of fiscal 2026 Microsoft Cloud revenue came from customers outside frontier-model companies; a $3.2B gain from the Anthropic investment · <a href="https://www.marketbeat.com/instant-alerts/microsoft-q4-earnings-call-highlights-2026-07-29/">MarketBeat, Jul 29</a></li><li><strong>Microsoft, Sep 2026</strong> — Azure revenue in dollars on a narrower definition: fiscal 2025 $72.6B (quarters $16.0B, $17.3B, $18.5B, $20.7B), fiscal 2026 $101.9B ($22.4B, $24.1B, $26.0B, $29.4B); June 2026 quarter +42% on this basis; fiscal Q1 2027 guide 44–45% in constant currency · <a href="https://www.sec.gov/Archives/edgar/data/0000789019/000119312526380280/d291965dex991.htm">Microsoft FY27 segments and metrics (8-K), Sep 2026</a></li><li><strong>Microsoft FY26 Q3</strong> — AI business “surpassed an annual revenue run rate of $37 billion”, up 123% · <a href="https://www.sec.gov/Archives/edgar/data/0000789019/000119312526191457/msft-ex99_1.htm">Microsoft FY26 Q3 results (8-K), Apr 29</a></li><li><strong>Microsoft FY26 Q3 call</strong> — Capex $31.9B; calendar 2026 capex about $190B, including about $25B from higher component prices · <a href="https://sherwood.news/tech/microsoft-is-planning-to-spend-190-billion-on-capex-this-year/">Sherwood News, Apr 30</a></li><li><strong>Microsoft FY26 Q2 call</strong> — “Approximately 45% of our commercial RPO balance is from OpenAI,” of $625B · <a href="https://www.roic.ai/quote/MSFT:AV/transcripts/2026-year/2-quarter">Microsoft FY26 Q2 call, via roic.ai</a></li><li><strong>Microsoft AI points</strong> — Azure growth included 13 points from AI services, which grew 157% (December 2024 quarter) · <a href="https://www.marketbeat.com/earnings/reports/2025-1-29-microsoft-co-stock">Microsoft FY25 Q2 call, via MarketBeat</a></li><li><strong>Microsoft AI points</strong> — 16 points from AI services in the March 2025 quarter · <a href="https://www.marketbeat.com/earnings/reports/2025-4-30-microsoft-co-stock">Microsoft FY25 Q3 call, via MarketBeat</a></li><li><strong>Microsoft AI points</strong> — Roughly 12 points from AI services in the September 2024 quarter, “similar to last quarter” · <a href="https://www.nasdaq.com/articles/microsoft-msft-q1-2025-earnings-call-transcript">Microsoft FY25 Q1 call, via Nasdaq</a></li><li><strong>Microsoft AI points</strong> — 8 points in the June 2024 quarter; 7 and 6 in the March 2024 and December 2023 quarters; roughly 3 in September 2023 and 1 in June 2023 · <a href="https://www.microsoft.com/en-us/investor/events/FY-2024/earnings-fy-2024-q4">Microsoft earnings calls, Jul 2023–Jul 2024</a></li><li><strong>Microsoft FY24 recast</strong> — Azure growth for fiscal 2024 restated to 31%, 33%, 35% and 34% by quarter · <a href="https://www.sec.gov/Archives/edgar/data/789019/000119312524204403/d846847dex991.htm">Microsoft metric recast (8-K), Aug 2024</a></li><li><strong>Microsoft capex</strong> — Capex including finance leases by quarter, $6.6B (September 2022) to $41B (June 2026); finance leases $11.1B, $6.7B, $4.7B and $5.6B in the quarters of fiscal 2026, mostly for large data-center sites · <a href="https://www.fool.com/earnings/call-transcripts/2025/10/29/microsoft-msft-q1-2026-earnings-call-transcript">Microsoft earnings calls, fiscal 2023–26</a></li><li><strong>Microsoft baseline</strong> — Cash capex from $13.9B in fiscal 2019 to $28.1B in fiscal 2023, about 12% of revenue; in fiscal 2023, $31.9B including finance leases. Our 14% baseline adds finance leases · <a href="https://www.microsoft.com/en-us/investor/events/FY-2023/earnings-FY-2023-Q4">Microsoft results and calls, fiscal 2019–23</a></li><li><strong>Microsoft leases</strong> — Data-center leases signed but not yet commenced of $329.1B at June 30, 2026, starting from fiscal 2027 through fiscal 2033 · <a href="https://btw.media/en/microsoft-329-1bn-uncommenced-datacentre-leases">btw.media, on the fiscal 2026 10-K</a></li><li><strong>Microsoft–OpenAI</strong> — Microsoft holds about 27% of OpenAI Group PBC, valued at about $135B; OpenAI contracted an incremental $250B of Azure services; Microsoft loses its right of first refusal on compute · <a href="https://blogs.microsoft.com/blog/2025/10/28/the-next-chapter-of-the-microsoft-openai-partnership/">Microsoft, Oct 28, 2025</a></li><li><strong>Microsoft–OpenAI</strong> — Microsoft stops paying OpenAI a revenue share; OpenAI’s payments to Microsoft continue through 2030 under a cap; Microsoft’s license becomes non-exclusive · <a href="https://openai.com/index/next-phase-of-microsoft-partnership">OpenAI, Apr 27</a></li><li><strong>Microsoft–OpenAI</strong> — $13B of funding commitments to OpenAI, $11.8B funded at Mar 31, 2026 · <a href="https://www.sec.gov/Archives/edgar/data/0000789019/000119312526191507/msft-20260331.htm">Microsoft 10-Q, quarter to Mar 31</a></li><li><strong>Microsoft–Anthropic</strong> — Anthropic committed to buy $30B of Azure compute; Microsoft to invest up to $5B in Anthropic · <a href="https://blogs.microsoft.com/blog/2025/11/18/microsoft-nvidia-and-anthropic-announce-strategic-partnerships/">Microsoft, Nov 18, 2025</a></li><li><strong>Microsoft neoclouds</strong> — Dedicated GPU capacity for Microsoft worth about $17.4B through 2031, up to about $19.4B with additional services · <a href="https://www.sec.gov/Archives/edgar/data/1513845/000110465925088312/tm2525580d1_6k.htm">Nebius (6-K), Sep 2025</a></li><li><strong>Microsoft neoclouds</strong> — A five-year, $9.7B AI cloud contract with Microsoft · <a href="https://www.sec.gov/Archives/edgar/data/1878848/000114036125040072/ef20058139_ex99-1.htm">IREN (8-K), Nov 2025</a></li><li><strong>Microsoft neoclouds</strong> — Neocloud contracts above $60B: Nscale about $23B, Nebius up to $19.4B, IREN $9.7B, Lambda and CoreWeave; mostly five-year terms · <a href="https://introl.com/blog/microsoft-60-billion-neocloud-spending-2025">Introl, citing Bloomberg, Nov 2025</a></li><li><strong>Microsoft neoclouds</strong> — The Nebius capacity is for Microsoft’s internal teams building models and a consumer assistant · <a href="https://finance.yahoo.com/news/microsoft-inks-33-billion-deals-191655037.html">Tom’s Hardware, citing Bloomberg, Oct 2025</a></li><li><strong>CoreWeave</strong> — About 67% of 2025 revenue of $5.1B came from Microsoft · <a href="https://www.sec.gov/Archives/edgar/data/1769628/000176962826000104/crwv-20251231.htm">CoreWeave 10-K, 2025</a></li><li><strong>Amazon Q2 2026</strong> — AWS revenue $42.2B, +37% (36.7%), operating income $16.6B; “Exceeded a $25 billion annual revenue run rate for AWS’s AI business”, and the same for Amazon’s chips business; Q3 guidance: revenue $197–202B, operating income $22.5–26.5B; free cash flow −$7.6B over twelve months · <a href="https://www.sec.gov/Archives/edgar/data/0001018724/000101872426000024/amzn-20260630xex991.htm">Amazon Q2 2026 results (8-K), Jul 30</a></li><li><strong>Amazon Q2 2026</strong> — Performance obligations, primarily AWS, about $496B with a 6.4-year average remaining life; OpenAI expanded its $38B commitment by $100B over 8 years, Anthropic its own by more than $100B over 10 years; $50B invested in OpenAI ($21.3B of it after June 30); $8B of Anthropic notes plus $10B of preferred, carried at about $190B · <a href="https://www.sec.gov/Archives/edgar/data/0001018724/000101872426000026/amzn-20260630.htm">Amazon 10-Q, quarter to Jun 30</a></li><li><strong>Amazon Q2 2026 call</strong> — Cash capex $53.1B in the quarter; about $220B for 2026, up from about $200B on the higher cost of memory; “we will still not have enough capacity to meet all the demand we have in 2026”, and likely the same in 2027 · <a href="https://www.fool.com/earnings/call-transcripts/2026/08/07/amazon-amzn-q2-2026-earnings-call-transcript/">Amazon Q2 2026 call, via The Motley Fool</a></li><li><strong>Amazon letter</strong> — “AWS’s AI revenue run rate is over $15 billion in Q1 2026”; “The FCF and ROIC for these investments are cumulatively quite attractive a couple years after being in service” · <a href="https://www.aboutamazon.com/md/news/company-news/amazon-ceo-andy-jassy-2025-letter-to-shareholders">Andy Jassy, 2025 letter to shareholders, Apr 9</a></li><li><strong>Amazon Q1 2026</strong> — AWS revenue $37.6B, +28%; chips business above a $20B run-rate; backlog about $364B · <a href="https://www.sec.gov/Archives/edgar/data/0001018724/000101872426000012/amzn-20260331xex991.htm">Amazon Q1 2026 results (8-K), Apr 29</a></li><li><strong>Amazon 2025</strong> — AWS revenue $128.7B, operating income $45.6B; 2025 cash capex $128.3B; about $200B of capex planned for 2026 · <a href="https://ir.aboutamazon.com/news-release/news-release-details/2026/Amazon-com-Announces-Fourth-Quarter-Results/">Amazon Q4 2025 results, Feb 5</a></li><li><strong>Amazon segments</strong> — AWS net additions to property and equipment $24.8B, $53.3B and $96.5B in 2023–25; AWS depreciation and amortization $21.5B in 2025 · <a href="https://www.sec.gov/Archives/edgar/data/1018724/000101872426000004/amzn-20251231.htm">Amazon 10-K, 2025 (segment note)</a></li><li><strong>Amazon segments</strong> — AWS net additions to property and equipment $13.1B, $16.5B, $22.0B and $27.8B in 2019–22 · <a href="https://www.sec.gov/Archives/edgar/data/1018724/000101872423000004/R30.htm">Amazon 10-Ks, 2020 and 2022 (segment notes)</a></li><li><strong>Amazon servers</strong> — Useful life of a subset of servers and networking equipment cut from six to five years from January 2025 · <a href="https://www.sec.gov/Archives/edgar/data/1018724/000101872425000004/Financial_Report.xlsx">Amazon 10-K, 2024</a></li><li><strong>Amazon–OpenAI</strong> — $15B invested, $35B more on conditions; the $38B AWS agreement expanded by $100B over 8 years, about 2 GW of Trainium · <a href="https://openai.com/index/amazon-partnership/">OpenAI, Feb 27</a></li><li><strong>Amazon–Anthropic</strong> — Anthropic commits more than $100B over ten years to AWS, up to 5 GW; Amazon invests $5B, up to $20B more · <a href="https://www.anthropic.com/news/anthropic-amazon-compute">Anthropic, Apr 20</a></li><li><strong>AWS Q3</strong> — Analysts expect AWS growth of 30% to 35% in the third quarter; Amazon reports October 29 · <a href="https://www.benzinga.com/trading-ideas/movers/26/10/62522059/amazon-earnings-are-a-week-away-heres-what-to-expect">Benzinga, Oct 22</a></li><li><strong>Microsoft FY27 Q1</strong> — Results after the close on October 28 · <a href="https://finviz.com/news/400058/microsoft-announces-quarterly-earnings-release-date">Microsoft, via Finviz</a></li><li><strong>Cloud market</strong> — Q2 2026 cloud infrastructure spending $143.4B, +43%, the fastest in eight years; GenAI-specific services +165% · <a href="https://www.srgresearch.com/articles/q2-cloud-market-passes-143-billion-highest-growth-rate-in-eight-years">Synergy Research, Jul 30</a></li><li><strong>OpenAI</strong> — Plan of July 2026: negative free cash flow of about $278B over 2026–30 · <a href="https://www.thestar.com.my/tech/tech-news/2026/09/19/openai-forecasts-cash-burn-near-280-billion-by-2030-ft-reports">FT, via Reuters, Sep 18</a></li><li><strong>OpenAI</strong> — Round closed March 31 at $122B and an $852B valuation · <a href="https://techcrunch.com/2026/03/31/openai-not-yet-public-raises-3b-from-retail-investors-in-monster-122b-fund-raise/">TechCrunch, Mar 31</a></li><li><strong>Anthropic</strong> — At least $518B of compute commitments over about a decade, including Amazon $110B and Microsoft $31.4B · <a href="https://www.zawya.com/en/business/anthropics-518bln-ai-buildout-hinges-largely-on-deals-that-cannot-be-canceled-filing-shows-1392642">Reuters, on the draft prospectus, via Zawya</a></li><li><strong>History</strong> — Microsoft quarterly revenue, Azure growth, capex and RPO, fiscal 2022–26; AWS quarterly revenue 2019–2026 · <a href="https://www.microsoft.com/en-us/investor">Microsoft and Amazon earnings releases and filings</a></li></ul>
<h2>Method</h2>
<p><strong>Clock.</strong> Reported through June 2026: Microsoft’s fiscal 2026 and Amazon’s second quarter, both mapped to calendar years. Azure’s revenue is Microsoft’s new dollar series for fiscal 2025–26; earlier quarters are backed out from the growth it reported. The second half of 2026: Azure up 44% and AWS up 32.5%. Capex 2026: Microsoft $190B (its guide before the lease change), Amazon $220B plus finance leases with 75% to AWS; 2027 our estimates.</p>
<p><strong>AI’s share.</strong> Azure: AI services as Microsoft split them through March 2025, less the AI Azure already had in 2022 grown with the rest of Azure; after that, 90% of revenue above a 17% trend. AWS: 90% of revenue above 2023’s revenue grown at 14.5% a year, consistent with Amazon’s AI run-rates. Trends hold through 2027 and fade to 6% by 2035.</p>
<p><strong>Returns.</strong> Cash flows from 2022 to 2040, no terminal value. In: AI revenue at a 60% cash margin. Through 2026 it is the estimate above (at Microsoft, less the 10% we put on rented capacity); after that, each dollar of incremental capex earns what 2026’s AI revenue implies per dollar of capex then in service (26 cents at Microsoft, 40 cents at Amazon), from two quarters after it is spent, fading 2.5% a year. Out: capex above 14% of Microsoft’s no-AI revenue and 31% of AWS’s; servers, 60% of capex, replaced every 6 or 5 years at 75% of their cost for the 75% of the fleet that rents to customers; cash tax at 19% and 17%, with servers getting first-year bonus depreciation (80% in 2023, 60% in 2024, 100% since; the rest over five years) and data centers over 20 years, losses offsetting other income. All-in adds the cash put into the labs (Amazon: $8B of Anthropic notes over 2023–25, $10B of preferred and $50B into OpenAI in 2026; Microsoft: about $9B of its 2023 OpenAI commitment over 2023–25, our timing, and up to $5B into Anthropic), half of Microsoft’s neocloud contracts (about $75B over 2026–33, our timing), and running costs of 3% a year of the cost of the fleet that doesn’t rent to customers, while its servers last. The labs cases cut the labs’ payments from 2028 and re-let what they stop paying for at half price. The base case is the middle of every range in the simulation.</p>
<p><strong>What’s left out.</strong> The stakes in OpenAI and Anthropic, and OpenAI’s revenue share to Microsoft. Microsoft’s Copilots (6.0% if counted at $7–10B a year), Amazon’s use of AI in retail and ads, and every company model or assistant. Operating leases Microsoft signs from fiscal 2027 sit outside its reported capex; our 2026–27 figures keep the old definition. Monte Carlo: 8,000 draws per case with a fixed seed. Model and data: scripts/packs/cloud_payback.py in the site’s repository.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>How much memory can each AI chip get?</title>
  <link>https://06.ai/packs/ai-memory-balance</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-memory-balance</guid>
  <pubDate>Sun, 25 Oct 2026 12:12:00 GMT</pubDate>
  <description>AI accelerator shipments nearly double by 2030, and HBM supply can’t keep up with the memory per chip on today’s roadmaps. We balance HBM supply and demand to 2030, size the memory per accelerator the market can afford, and weigh KV cache, Marvell’s optical pooling, China and Terafab.</description>
  <category>AI memory</category>
  <enclosure url="https://06.ai/newsletter/ai-memory-balance/cover.png" length="67392" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-memory-balance/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-memory-balance"><img src="https://06.ai/newsletter/ai-memory-balance/thumb.png" alt="How much memory can each AI chip get?" width="421" height="433"></a><figcaption><a href="https://06.ai/packs/ai-memory-balance">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>AI accelerator shipments roughly double from about 14M packages in 2026 to 26.5M in 2030, and HBM can’t grow fast enough to give each one the memory on today’s roadmaps. At announced specs, HBM supply falls <strong>18% short</strong> of demand in 2027 and 29–38% short in 2028–30. To balance, the average accelerator can carry about <strong>270 GB</strong> of HBM in 2027 and <strong>430 GB</strong> in 2030, growth of 17% a year against 28% on the roadmaps. The trims now being reported, from Rubin Ultra’s cut to 8-Hi stacks on next year’s ASICs, do roughly that; price does the rest.</p>
<ul><li><strong>~270 GB</strong> — HBM per accelerator, 2027 the fleet average supply can support. Rubin and B300 carry 288 GB</li><li><strong>~430 GB</strong> — HBM per accelerator, 2030. +17% a year from 2027, against +28% on announced roadmaps (~690 GB)</li><li><strong>29% short</strong> — At announced specs, 2028. HBM supply against demand: 18% short in 2027, 38% by 2030. At the trimmed specs, within ±3% every year</li><li><strong>−22% to +52%</strong> — Biggest swing, 2028 unit volumes, from the vendors’ deal books to a power-limited build, at trimmed specs</li></ul>
<h2>At announced specs, HBM supply falls 18–38% short from 2027; the reported trims close the gap</h2>
<p>Base units, base supply: at announced specs supply is 18% short in 2027 and 38% short in 2030; at trimmed specs 2% short in 2027 and 2% short in 2030.</p>
<figure><a href="https://06.ai/packs/ai-memory-balance#balance"><img src="https://06.ai/newsletter/ai-memory-balance/fig-01.png" alt="At announced specs, HBM supply falls 18–38% short from 2027; the reported trims close the gap" width="694" height="382"></a><figcaption>HBM made by SK hynix, Samsung and Micron each year against what accelerators need, in exabytes (EB). Demand counts HBM bought about four months before the accelerator ships, plus about 6% for stacks lost in assembly. Labels: supply ÷ demand − 1 at announced specs. Choose the unit and supply cases.</figcaption></figure>
<h2>What the balance says</h2>
<p><strong>How we count.</strong> Supply is HBM wafer starts times the good terabytes each wafer yields. Demand is units times HBM per package, bought about four months before the accelerator ships, plus about 6% for stacks lost in 2.5D assembly and physical capacity above the usable figure. The lead matters when growth is steep: purchases run 37% above the bits inside 2026’s shipments, because 2027’s step-up is bought early, and 13–17% above in 2027–30.</p>
<p><strong>2026 is roughly balanced (−2%).</strong> That fits the price signal: HBM contract prices paused or slipped in 2026 while commodity DRAM rose about sixfold. In 2025, supply (about 2.8 EB) ran well ahead of the bits shipped inside accelerators. The excess went into inventory across the chain: Nvidia’s own rose from about $10B to $21B over its fiscal 2026 and reached $31.6B by July 2026.</p>
<p><strong>2027 is the crunch at announced specs.</strong> Demand jumps with TPU 8, Trainium 3–4, MI450, MTIA and the first Rubin Ultra builds. Supply grows only 54%: wafer input rises 31% and good bits per wafer 18%, less than node shrinks alone would give because the HBM4 die is larger for its doubled interface. The announced specs would need 7.3 EB against about 6.0 EB available.</p>
<p><strong>2028–30 turns on two things we can’t know yet:</strong> how fast memory per package grows again, and how many packages the power grid can absorb. New cleanrooms lift supply 33% in 2028 and about 24% a year after. If memory per package grows about 17% a year, the market stays balanced; if it follows the announced roadmaps, supply falls more than a third short.</p>
<h3>How this compares with published views</h3>
<figure><a href="https://06.ai/packs/ai-memory-balance"><img src="https://06.ai/newsletter/ai-memory-balance/fig-02.png" alt="Goldman Sachs (Jun) — 2026: −5.4% · 2027: −6.0% · 2028: −4.3%; J.P. Morgan (Sep) — −16% across 2026–28; SemiAnalysis (via Luminix) — 2026: ~−6% · 2027: ~−9%; This pack, trimmed specs — 2026: −2% · 2027: −2% · 2028: +3%; This pack, announced specs — 2026: −6% · 2027: −18% · 2028: −29%" width="712" height="289"></a></figure>
<p>Supply ÷ demand − 1. Goldman sits between our two cases; J.P. Morgan’s deeper −16% came in September, after the first trims were reported.</p>
<p><strong>The commodity DRAM squeeze is the same story one step removed.</strong> With nearly every new big-three wafer going to HBM, conventional bit growth has to come from node shrinks and CXMT. AI then takes a second bite through CPU memory: Vera’s LPDDR5X, AMD Helios’s 36 TB of DDR5 per rack, and agentic CPU servers. Counting HBM at its wafer cost, AI systems take roughly 27% of DRAM wafers in 2026 and about 43% in 2027, by our estimate from the rack configurations below. Conventional contract prices compounded roughly sixfold from 3Q25 to 4Q26, with 4Q26 still up 10–15% (TrendForce). IDC expects 2026 PC shipments to fall 11.3% and smartphones 13%. Published 2027 DRAM sufficiency ranges from −1.9% (DS Investment) to −5.9% (Goldman); Micron calls 2027–28 “tighter than 2026”.</p>
<h2>Is Nvidia really cutting memory per GPU?</h2>
<p>Partly. No shipping data-center GPU has lost HBM: Rubin keeps 288 GB, the same as Blackwell Ultra. But Nvidia is reported to be halving Vera’s CPU memory for 2027 builds and cutting Rubin Ultra’s HBM by 75–81% per package against its announced spec. HBM per GPU has stopped growing this generation, and per compute die it is set to fall in the next.</p>
<ul><li><strong>Rubin (VR200), shipping since Aug 2026</strong> — What changed: Still 288 GB of HBM4 on eight 12-Hi stacks. Listed bandwidth fell from 22 TB/s (CES) to 19.2 TB/s, no reason given · Status, Oct 2026: Nvidia’s page. A ZDNet Korea report of 8-Hi orders was contradicted by Counterpoint, which says most Rubin stays 12-Hi</li><li><strong>Vera CPU (LPDDR5X on SOCAMM2)</strong> — What changed: 1.5 TB → 768 GB per CPU; ~54 → ~28 TB per NVL72 rack · Status, Oct 2026: Reported for 2027 supply plans by TrendForce, Daishin and SemiAnalysis (June). Nvidia calls 768 GB a “flexible SKU”; its spec still says “up to 1.5 TB”</li><li><strong>Rubin Ultra (2027–28)</strong> — What changed: Announced: 1 TB of HBM4E on 4 dies. Reported: ~192–256 GB of 8-Hi HBM4 on 2 dies · Status, Oct 2026: SemiAnalysis; The Information. Nvidia: “our roadmap is intact”; no confirmation</li><li><strong>Rubin CPX (128 GB GDDR7)</strong> — What changed: Absent from Nvidia’s October Vera Rubin page; the SRAM-based Groq 3 LPX rack appears instead · Status, Oct 2026: No source ties this to the GDDR7 shortage</li><li><strong>GeForce RTX 50</strong> — What changed: Fewer cards (a 30–40% cut reported for the 16 GB RTX 5070 Ti and 5060 Ti in 1H26), not less memory per card · Status, Oct 2026: Nvidia: “memory supply is constrained”</li></ul>
<p><strong>Per compute die, the cut is real.</strong> Rubin carries 144 GB per die; the reported Rubin Ultra carries 96 GB per die, a third less, against 256 GB per die in the original plan. Half of the package-level drop comes from going from four dies to two, which sources put down to packaging and rack issues rather than memory.</p>
<p><strong>It is not just Nvidia.</strong> AMD reportedly built a 288 GB MI450 for Meta beside the 432 GB MI455X. TrendForce says GPU and ASIC makers are “considering reducing HBM capacity per device” and will evaluate 8-Hi stacks in 2027. The tell: 8-Hi stacks now carry a 10–30% per-gigabit premium over 12-Hi, the reverse of normal pricing.</p>
<p><strong>Why.</strong> SemiAnalysis gives three reasons for Rubin Ultra. There are not enough HBM wafers to build 12-Hi stacks for the logic and CoWoS capacity Nvidia has secured for 2027, and 8-Hi yields more stacks per wafer. HBM cost jumps in 2027: GF Securities estimates memory would have reached about 29% of a Vera Rubin system’s bill of materials without the Vera cut, against Nvidia’s preferred 20%. And workloads are shifting: a 576-GPU domain of 192 GB parts (about 110 TB) still dwarfs a 20.7 TB NVL72.</p>
<p>Nvidia has guided its gross margin down from 75% to 71–72% by the quarter ending January 2027 on “extreme pricing conditions in memory”. Its supply and capacity purchase commitments, mainly memory, rose from $119B to $279B in one quarter. The logic is to protect units by trimming memory per unit: TrendForce describes the Vera cut as “lowering memory per module while increasing total module shipments”, a supply-driven compromise, not a drop in demand. We model the reported trims as the base case and the announced specs as the alternative.</p>
<h2>Spec trims cut HBM demand by 1.2 EB in 2027 and 3.5 EB in 2028, mostly at Nvidia</h2>
<figure><a href="https://06.ai/packs/ai-memory-balance#trims"><img src="https://06.ai/newsletter/ai-memory-balance/fig-03.png" alt="Spec trims cut HBM demand by 1.2 EB in 2027 and 3.5 EB in 2028, mostly at Nvidia" width="694" height="313"></a><figcaption>From HBM demand at announced specs to base-case supply, EB bought in the year, base-case units. Each family moves from its announced to its trimmed specs in turn. Orange lowers the running total, green raises it.</figcaption></figure>
<h2>Supply supports about 270 GB per accelerator in 2027 and 430 GB in 2030</h2>
<figure><a href="https://06.ai/packs/ai-memory-balance#per-package"><img src="https://06.ai/newsletter/ai-memory-balance/fig-04.png" alt="Supply supports about 270 GB per accelerator in 2027 and 430 GB in 2030" width="694" height="430"></a><figcaption>Fleet-average HBM per accelerator package, GB. Supportable: each year’s HBM supply divided by the packages it serves, 65% of that year’s plus 35% of next year’s (about a third of a package’s HBM is bought the year before it ships), after assembly losses. The announced and trimmed paths are averaged the same way, so each gap is that path’s supply-vs-demand. Whiskers: low and high supply cases. Shown: Base.</figcaption></figure>
<h2>How much memory per accelerator the market can afford</h2>
<p>To balance, fleet-average HBM per accelerator can be about 270 GB in 2027, 320 GB in 2028 and 430 GB in 2030: growth of about 17% a year, against 28% on the announced roadmaps. That is feasible. 288 GB stays the flagship through 2027, next-generation parts move to 8-Hi stacks, and capacity beyond that moves off HBM. It is a fleet average, so a 432 GB part has to be offset by a 144–216 GB part elsewhere.</p>
<ul><li><strong>2027 (~270 GB).</strong> Rubin, TPU 8i and the 288 GB MI450 sit at the top of the affordable range. The 432 GB MI455X and the 384–512 GB MTIA 500 fit only if Trainium 3 (144 GB), TPU 8t (216 GB) and Maia 200 (216 GB) keep the average down.</li><li><strong>2028 (~320 GB).</strong> Rubin Ultra at 192–256 GB on two dies fits. The announced four-die, 1 TB version would absorb about a fifth of 2028 supply on about 15% of units.</li><li><strong>2029–30 (~380–430 GB).</strong> Room returns for Feynman-class parts at 400–600 GB, as long as custom ASICs stay near 300–420 GB.</li></ul>
<p>Per compute die, that means about 100–130 GB on Rubin Ultra (Rubin: 144 GB) and roughly 200 GB per die by 2030.</p>
<p><strong>Workloads can live with it.</strong> MLPerf Inference v6.1 compares GB300 (278 GB) with GB200 (186 GB) at the same 8 TB/s. A 671B model and small models that can’t be capacity-bound gained the same ~1.29×, so the gain from capacity itself was about zero. Our modelling of a one-third cut, 288 GB to 192 GB through 8-Hi stacks at unchanged bandwidth:</p>
<ul><li><strong>0–10% throughput loss</strong> for today’s dominant pattern: 0.7–2T-parameter MoE models on 72 or more GPUs with wide expert parallelism, 32K–400K context. Weights take about 20–45 GB per GPU at that width, depending on precision and replication; the rest is KV cache.</li><li><strong>15–30% loss</strong> for 10T-class models, sparse-attention long-context agents, or idle sessions parked in HBM. About 45% in the worst combination.</li><li><strong>0–12%</strong> for training.</li><li><strong>Concurrency falls more than throughput.</strong> Sessions per GPU drop 36–41%, because weights are a fixed charge, but per-user decode speeds up, so tokens per GPU fall only 5–11%. Token-priced services barely notice; session-priced agent hosting does, unless KV moves to another tier.</li></ul>
<p>The hard floor is about 155 GB per GPU, below which a 10T-parameter model at FP8 no longer fits in a 72-GPU domain (about 90 GB at FP4). These figures assume FP4 weights, FP8-or-smaller KV cache and an off-HBM KV tier, all shipping on Blackwell and Rubin.</p>
<p><strong>The economics push the same way.</strong> At 2027 HBM4 prices of $32–40/GB, 288 GB costs about $9–12K per package and 1 TB about $33–41K. Morgan Stanley puts memory at 25–30% of a Vera Rubin rack’s cost, up from 5–10% in earlier racks. A 12-Hi to 8-Hi switch cuts bits per GPU by a third; with 8-Hi’s 10–30% per-Gb premium, HBM spend per GPU falls 13–27%.</p>
<p><strong>The technology is not the limit; wafers are.</strong> Per-stack bandwidth depends on interface width and pin speed, not height, so a shorter stack keeps bandwidth: B200 to B300 proved the inverse, 192 GB to 288 GB on the same eight stacks at 8 TB/s. Packaging allows far more than the market can feed: 12 stacks × 48 GB = 576 GB in 2027, and 20 × 64 GB ≈ 1.3 TB by 2028–29 on TSMC’s roadmap.</p>
<h2>Units nearly double from 2026 to 26.5M in 2030; custom ASICs are about 60% of them from 2027</h2>
<figure><a href="https://06.ai/packs/ai-memory-balance#units"><img src="https://06.ai/newsletter/ai-memory-balance/fig-05.png" alt="Units nearly double from 2026 to 26.5M in 2030; custom ASICs are about 60% of them from 2027" width="694" height="402"></a><figcaption>AI accelerator packages shipped a year, millions, base case. Whiskers: total units in the low case (a power- and capex-limited build) and the high case (the vendors’ deal books at face value). Row below: the custom ASICs’ share.</figcaption></figure>
<h2>Demand: units, memory per unit, and each generation’s appetite</h2>
<p>Accelerator shipments roughly double from about 14M packages in 2026 to 26.5M in 2030 in our base case, and custom ASICs (TPU, Trainium, MTIA, OpenAI’s chip) make up about 60% of units from 2027. At announced specs, the HBM inside each year’s shipments would grow sixfold, from 2.9 EB in 2026 to about 17.5 EB in 2030; at the specs now shipping or reported, about fourfold, to 11.1 EB.</p>
<p><strong>Units.</strong> Our 2026–27 paths follow vendor-level evidence: Nvidia’s guide for about 70% revenue growth in its fiscal 2028 (February 2027 to January 2028) at a much higher price per package (a Vera Rubin rack costs roughly twice a GB300 rack), Morgan Stanley’s 2027 CoWoS demand (2.7M wafers, Nvidia about 45%), TPU forecasts of 5–8.8M in 2027, and the AMD, Broadcom and Anthropic deal books. After 2027 units grow 12% in 2028 and about 8% a year after. A capex- and power-constrained top-down view gives far fewer, about 15–17M packages a year through 2030; it is our low case. The <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack shows why it matters: see “How this squares with the <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack” below.</p>
<h3>Nvidia generations: memory per package, per rack, and over each generation’s life</h3>
<ul><li><strong>Hopper H100 / H200</strong> — Volume years: 2023–25 · HBM per package: 80 / 141 GB · Rack fast memory (HBM + CPU LPDDR): 0.64–1.1 TB per 8-GPU HGX · Lifetime HBM, our estimate: ~0.5 EB (2024–26)</li><li><strong>Blackwell B200 / GB200</strong> — Volume years: 2025 · HBM per package: 186–192 GB · Rack fast memory (HBM + CPU LPDDR): 30.4 TB per NVL72 (13.4 + 17) · Lifetime HBM, our estimate: ~0.6 EB</li><li><strong>Blackwell Ultra B300 / GB300</strong> — Volume years: 2H25–27 · HBM per package: 288 GB · Rack fast memory (HBM + CPU LPDDR): 37 TB per NVL72 (20 + 17) · Lifetime HBM, our estimate: ~1.8 EB</li><li><strong>Rubin VR200</strong> — Volume years: 2H26–28 · HBM per package: 288 GB · Rack fast memory (HBM + CPU LPDDR): 48–75 TB per NVL72 (20.7 + 28–54) · Lifetime HBM, our estimate: ~2.6 EB of HBM plus 3.4–6.8 EB of LPDDR</li><li><strong>Rubin Ultra</strong> — Volume years: 2H27–29 · HBM per package: 1 TB on 4 dies (announced); ~192–256 GB on 2 dies (reported) · Rack fast memory (HBM + CPU LPDDR): 147 TB of HBM per Kyber rack (announced) · Lifetime HBM, our estimate: ~2.9 EB at announced spec vs ~1.1–1.5 EB reported</li><li><strong>Feynman</strong> — Volume years: 2028– · HBM per package: “Custom HBM”, capacity undisclosed</li></ul>
<p>Lifetime totals use our unit mix (Hopper 5.2M, Blackwell 3.3M, Blackwell Ultra 6.4M, Rubin 8.9M and Rubin Ultra 5.7M packages) and are rounded. Rubin Ultra counts as two-die equivalents.</p>
<p>The Rubin row is the one to notice. Its LPDDR5X attach, even at the reported halved level, matches or exceeds its HBM in bytes, which is why the Vera cut matters for commodity DRAM.</p>
<h3>Everyone else’s current parts</h3>
<ul><li><strong>AMD</strong> — Now shipping: MI355X, 288 GB; MI455X, 432 GB HBM4 (since late Q3 2026) · Next: MI500 (2027); memory not yet disclosed · A 288 GB MI450 reportedly built for Meta</li><li><strong>Google</strong> — Now shipping: TPU v7 Ironwood, 192 GB; TPU 8i, 288 GB HBM3E (since Sep 2026) · Next: TPU 8t, 216 GB HBM3E · Anthropic: 1 GW in 2026, 5 GW of 8i in 2027</li><li><strong>AWS</strong> — Now shipping: Trainium 3, 144 GB · Next: Trainium 4, ~288 GB (HBM4-class) · Anthropic up to 5 GW; OpenAI 2 GW from 2027</li><li><strong>Meta</strong> — Now shipping: MTIA 300, 216 GB · Next: MTIA 400/450, 288 GB; MTIA 500, 384–512 GB · The largest among announced 2027 custom ASICs</li><li><strong>Microsoft</strong> — Now shipping: Maia 200, 216 GB · Next: Maia 300 in design</li><li><strong>Huawei</strong> — Now shipping: Ascend 950PR / 950DT, 128 / 144 GB · Next: Ascend 960DT, 288 GB (Q1 2027) · Domestic HBM; see China below</li></ul>
<p>By HBM bits, the 2027 split is about 37% Nvidia, 31% Google, 13% AWS, 9% AMD and 9% other ASICs in our base case, close to Morgan Stanley’s 37/36/12% for Nvidia, Google and AMD.</p>
<h2>After M15X and P4, new memory fabs add wafers from mid-2027; Terafab’s DRAM points to about 2030</h2>
<figure><a href="https://06.ai/packs/ai-memory-balance#fabs"><img src="https://06.ai/newsletter/ai-memory-balance/fig-06.png" alt="After M15X and P4, new memory fabs add wafers from mid-2027; Terafab’s DRAM points to about 2030" width="694" height="462"></a><figcaption>New DRAM and HBM capacity by first output, as reported by October 2026. Bars: ramps; diamonds: first output. HBM stacks follow wafers by about six months.</figcaption></figure>
<h2>Supply: where the HBM bits come from</h2>
<p>HBM output roughly doubles in two years, from about 3.9 EB in 2026 to 6.0 EB in 2027 and 8.0 EB in 2028 in our base case, but only by taking about 30% of the big three’s DRAM wafers. Apart from SK hynix’s M15X and Samsung’s P4 phase 2, both producing since the first half of 2026, no new fab adds volume before mid-2027.</p>
<p><strong>HBM eats wafers more than twice as fast as it makes bits.</strong> HBM takes 18%, 22% (vendor capacity figures imply about 25%) and 30% of the big three’s DRAM wafer starts in 2025, 2026 and 2027, but yields only 8%, 9% and 13% of DRAM bits (TrendForce). Micron puts HBM3E at about 3× the wafer area per bit of DDR5 and says the ratio rises each generation. We estimate 650–850 good GB per HBM wafer start in 2026, about twenty 36 GB stacks. The consequence: non-HBM wafer starts at Samsung, SK hynix and Micron stay roughly flat at 1.26–1.33M a month through 2027. Nearly every new wafer goes to HBM.</p>
<h3>Capacity by vendor, thousand HBM wafer starts a month</h3>
<figure><a href="https://06.ai/packs/ai-memory-balance"><img src="https://06.ai/newsletter/ai-memory-balance/fig-07.png" alt="Samsung — End-2025: ~170 · 2026: ~180 average · 2027: ~250 average · HBM4 status, Oct 2026: Shipping since Feb 2026; yield ~80%; 1c core dies on an in-house foundry base die; SK hynix — End-2025: 160–170 · 2026: 150–200 · 2027: ~230–260 (our estimate) · HBM4 status, Oct 2026: Volume since Q2 2026; anchor Rubin supplier, ~55–70%; Micron — End-2025: 40–55 · 2026: ~100 by year-end · 2027: ~120–150 (our estimate) · HBM4 status, Oct 2026: Ships above 11 Gbps; reportedly marginal on flagship Rubin; custom HBM4E next; Industry, ex-China — End-2025: ~370–390 · 2026: ~450 average · 2027: ~550–680 · HBM4 status, Oct 2026: HBM4E ramps in 2H 2027 at all three; CXMT (China only) — End-2025: ~10 · 2026: ~20–30 · 2027: ~55 · HBM4 status, Oct 2026: HBM3 at ~25% yield; small-scale HBM3E since Sep 2026" width="712" height="438"></a></figure>
<p>Q2 2026 HBM revenue share: SK hynix 50%, Samsung 33%, Micron 18% (Counterpoint).</p>
<p><strong>From wafers to bits.</strong> Our base case runs average HBM wafer input from about 450k a month in 2026 to 590k in 2027, 710k in 2028 and 975k in 2030, with good output per wafer rising from 0.72 TB to 1.05 TB as the industry moves to 1c/1d nodes and 32 Gb dies. That lands close to the published anchors, 1.5 EB in 2024 and about 3.0 EB in 2025 (TrendForce), about 4 EB in 2026, and TrendForce’s +50–60% for 2027: we get 1.5, 2.8 and 3.9 EB and +54%.</p>
<p>Beyond 2027 no vendor publishes HBM capacity. Our 2028–30 path assumes HBM keeps about a third of a big-three DRAM base growing toward about 3M wafer starts a month by 2030 (Citrini puts Samsung and SK hynix alone at 2.3–2.6M). The low and high cases sit about 19% below and 23% above the base in 2028, and 28% below and 33% above in 2030.</p>
<p><strong>Price is what forces the shift.</strong> 2026 was an HBM pricing pause: HBM3E sold near $1.50/Gb (about $12/GB) while conventional contract prices compounded about sixfold from 3Q25 to 4Q26, to roughly $2/Gb. By Q1 2026 a wafer of 64 GB server DIMMs earned more than a wafer of HBM. At a 3× wafer ratio, a $2/Gb commodity bit implies about $6/Gb for an HBM bit to break even per wafer. That is why 2027 HBM4 quotes sit at $4–5/Gb (about $32–40/GB, or $1,150–1,450 per 36 GB stack) and blended 2027 forecasts run from +54% (J.P. Morgan) to +121% (TrendForce). The HBM price is now hostage to the commodity price.</p>
<p><strong>Most of it is already sold.</strong> Micron has $32B of customer commitments and has contracted the “vast majority” of its 2027 HBM. Samsung has signed five-year agreements with its top five data-center customers and plans to cover 60–70% of capacity; SK hynix has long-term deals with about ten customers. A buyer without a contract in 2027 has very little to buy.</p>
<h2>At 128K tokens, 2026’s flagship models need 5–50× less KV cache than Llama 3.1 405B</h2>
<figure><a href="https://06.ai/packs/ai-memory-balance#kv"><img src="https://06.ai/newsletter/ai-memory-balance/fig-08.png" alt="At 128K tokens, 2026’s flagship models need 5–50× less KV cache than Llama 3.1 405B" width="694" height="434"></a><figcaption>GB of KV cache per 128K-token sequence at FP8, the serving default; hybrids include their fixed recurrent state. Right column: how many such sequences fit in the ~200 GB KV pool a 288 GB Rubin GPU has after weights and runtime.</figcaption></figure>
<h2>KV cache: the demand driver and the levers</h2>
<p>KV cache is what now fills HBM, and it is the most movable part of memory demand. In a typical 2026 serving setup KV takes about 60% of a 288 GB GPU and weights about 15% (LMSYS). Attention design changes KV per token by more than 50× and precision by up to 3.5×, and warm context can be parked in LPDDR, CXL memory or flash. Net: KV growth raises total memory demand but pushes the marginal byte off HBM.</p>
<p><strong>Sizing.</strong> KV per token is 2 × layers × KV heads × head size × bytes for standard attention; latent, compressed and linear-attention designs cut it further. At FP8, a 128K-token context ranges from 34 GB on Llama 3.1 405B to 0.7 GB on DeepSeek-V4-Pro, a model four times larger. FP4 KV fits 1.78× more than FP8 but is still experimental, costing 1.6 points on SWE-bench Verified in one test.</p>
<p><strong>Why it keeps growing.</strong> Google processed more than 3.2 quadrillion tokens a month in May 2026, against 480 trillion a year earlier. Agents make prompts long and repetitive: 94–98% of coding-agent prompt tokens are reused prefixes, and inputs outnumber outputs 131 to 1. DeepSeek-V4-Pro agent inputs run at a median of 88K tokens and 675K at the 99th percentile; Nvidia sizes Rubin for 128K–400K cached tokens per user.</p>
<p><strong>Where it can live.</strong> The tier ladder runs from HBM (the active batch) to CPU LPDDR, optical and CXL pools, flash and network storage (table below). Tiering is now standard in vLLM, SGLang, TensorRT-LLM and Nvidia’s Dynamo. On coding-agent traces, a shared KV store lifted throughput 3.8× and cut time-to-first-token 46× by raising cache hits from 2% to 92%.</p>
<ul><li><strong>CPU LPDDR.</strong> Vera carries 768 GB–1.5 TB per two GPUs over a 1.8 TB/s link. This is Nvidia’s main answer, and why the reported LPDDR cut matters.</li><li><strong>CXL pools.</strong> Samsung’s CMM-D pool ran KV offload at about 92% of local-DRAM throughput at TP=8; Alibaba’s CXL pool cut time-to-first-token about 90% against an RDMA store.</li><li><strong>Flash.</strong> Nvidia’s BlueField-4 context-memory tier is due in 2H 2026 with “petabytes” per pod and a claimed 5× tokens/s, still unmeasured in public. Citi estimates about 16 TB of NAND per Rubin GPU, about 115 EB in 2027 or 9% of global NAND.</li><li><strong>High Bandwidth Flash.</strong> A 512 GB-per-stack design, samples in 2027 and volume in 2028 per analysts, for read-mostly weights, not active KV.</li></ul>
<p><strong>Shrinking it.</strong> DeepSeek-V4 stores 8.7× less KV than V3.2 at 1M tokens, Kimi K3 and Qwen3.8 cut per-token KV 2–3× against their predecessors, and Nvidia credits part of GB300’s 1.6× software gain in MLPerf to lower KV precision. Hardware moves the same way: Groq 3 LPX racks run MoE decode from SRAM (500 MB per chip, 128 GB per rack, no HBM) while Rubin GPUs keep attention and KV. The GDDR7-based Rubin CPX no longer appears on Nvidia’s Vera Rubin page.</p>
<p><strong>What it does to the balance.</strong> HBM capacity sets concurrency: GB300’s 1.5× HBM over GB200 gave 1.6× the decode batch, and a third less HBM removes 36–41% of resident sequences because weights are a fixed charge. Whether that costs tokens depends on reads. With dense attention, per-user decode speeds up and tokens per GPU fall only 5–11%; with sparse attention, or agent sessions parked between tool calls, the loss approaches the full 40%. Hence the design now shipping: size HBM for the active batch and stage warm context one tier down during tool-call pauses, which last about 5 seconds at the median.</p>
<p><strong>Which tier depends on attention design.</strong> At 57 agents per GPU (Artificial Analysis’s measured rate for DeepSeek-V4-Pro on GB300) and 90th-percentile agentic context, an MLA model spills about 25 TB of warm KV per Rubin rack, which fits Vera’s LPDDR. A dense 405B-class model spills 80–280 TB, which needs flash, while DeepSeek-V4-class models fit in HBM (our estimates). So KV growth lands mostly in LPDDR, tightening commodity DRAM, and in NAND: enterprise SSD is now about 37% of NAND demand (CFM), and Citi sees a 6.1% NAND shortfall in 2027.</p>
<p>Our trimmed-spec case assumes that tiering works. If agent hosting is priced per session and insists on HBM-resident context, buyers will pay for taller stacks again, and demand moves toward the announced-roadmap case.</p>
<h2>Marvell’s Photonic Fabric and pooled memory</h2>
<p>Optical pooling slows the growth of HBM per GPU from 2028; it does not cut it before then. On an accelerator designed around a pool, it could replace 10–20% of HBM capacity in 2028 and 25–35% by 2030. Across the whole fleet that is about 2% in 2028 and 3–8% in 2030 (our estimates).</p>
<p><strong>What Marvell bought.</strong> Marvell closed its $3.25B purchase of Celestial AI on February 2, with up to $2.25B more tied to revenue. Photonic Fabric links chips over light at about 2.4–3.1 pJ/bit and adds roughly 200–300 ns of latency; on-package HBM is under 100 ns. The memory module fronts 2 TB of DDR5 with two HBM3E stacks (72 GB) acting as a cache. A 2U appliance of 8–16 modules holds about 33 TB, shared by up to 16 servers as far as 50 m away.</p>
<p><strong>Where it stands.</strong> The memory module taped out in 2026, is in bring-up, and samples to “multiple customers” in 2027. Every disclosed win so far is optical interconnect, not pooled memory: a Tier 1 hyperscaler’s XPU scale-up network and co-packaged optics added to the AWS agreement. Marvell’s revenue targets, a $500M run-rate by November 2027–January 2028 and $1B by November 2028–January 2029, are interconnect too. Amazon holds a warrant for 1,045,171 Marvell shares at $87.00 that vests with its Photonic Fabric purchases through 2030, the clearest signal of who adopts first.</p>
<p><strong>It replaces capacity, not bandwidth.</strong> The appliance switch moves about 115 Tbps (about 14 TB/s), roughly one Rubin GPU’s HBM4 bandwidth. Shared across 64–128 accelerators, that is 0.1–0.2 TB/s each, about 1% of Rubin’s 19–22 TB/s, while offering 250–500 GB of capacity each. So the pool can hold only bytes touched rarely: warm or parked KV cache, cold MoE experts and adapters, optimizer state, checkpoints. KV for sequences in the active decode batch, and hot weights, are read every token step and stay in HBM.</p>
<p><strong>The lever it unlocks is stack height.</strong> HBM capacity comes bundled with bandwidth: drop a stack and you lose both. Shortening stacks keeps bandwidth (12-Hi to 8-Hi cuts GB by a third, 16-Hi to 12-Hi by a quarter), and a pooled tier is what lets a designer take that cut. That bounds displacement near 25–35% per accelerator.</p>
<ul><li><strong>On-package HBM</strong> — Example: Rubin, 288 GB of HBM4 · Added latency: under 100 ns · Bandwidth per accelerator: 19.2–22 TB/s · Status, Oct 2026: shipping 2026</li><li><strong>CPU-attached LPDDR</strong> — Example: Vera, 768 GB–1.5 TB of LPDDR5X per 2 GPUs · Added latency: local DRAM · Bandwidth per accelerator: ~0.6 TB/s (1.2 TB/s per Vera) · Status, Oct 2026: ships with Vera Rubin</li><li><strong>Optical memory pool</strong> — Example: Marvell Photonic Fabric appliance · Added latency: ~200–300 ns · Bandwidth per accelerator: 0.1–0.2 TB/s shared; 1.8 TB/s per dedicated chiplet · Status, Oct 2026: samples 2027</li><li><strong>CXL switch pool</strong> — Example: Marvell Structera S 30260 (48 TB), Astera Leo, Samsung CMM-D · Added latency: ~460–750 ns · Bandwidth per accelerator: ~26–36 GB/s per device path · Status, Oct 2026: expanders shipping; switches sampling</li><li><strong>RDMA / flash context tier</strong> — Example: Nvidia ICMS (BlueField-4), Enfabrica EMFASYS · Added latency: microseconds · Bandwidth per accelerator: ~0.1 TB/s (800 Gb/s) · Status, Oct 2026: ICMS due 2H 2026</li></ul>
<p><strong>Who adopts, and why the effect is muted.</strong> Nvidia, the largest HBM buyer, is building its own non-optical tiers (Vera LPDDR5X, ICMS, the Enfabrica team it paid over $900M for) while its announced Rubin Ultra still lists 1 TB of HBM per package (reportedly cut to 192–256 GB). That leaves custom accelerators (AWS, Google, Meta, Microsoft) and UALink systems as the early market; optical NVLink for Feynman in 2028 is reported but unconfirmed. Vendors sell pooling as a 2–5× throughput gain, mostly from simulation, not as HBM savings, and cheaper tokens can raise total HBM demand, so the industry-level effect is smaller than the per-accelerator one and could be zero. The tell that this is changing would be a named memory-appliance customer or purchase order; none has been disclosed.</p>
<h2>China: CXMT, YMTC, Huawei and export controls</h2>
<p>China narrows the global commodity DRAM shortfall but barely touches the HBM balance. Hanwha estimates CXMT shrinks the 2026 global DRAM deficit from 15.5% to 9.4%, and 2027’s from 12.0% to 5.6%. Almost none of that reaches HBM, and most of it stays inside China.</p>
<p><strong>CXMT is big in wafers, smaller in bits, and not cheap.</strong> It runs about 300–320k wafer starts a month across two Hefei fabs and one in Beijing, heading to about 420k in 2027 and 500–600k in 2028. That is about 17% of the top five makers’ wafer starts but only 6.7–9% of bits, because its nodes lag; it took 9.5% of DRAM revenue in Q2 2026, fourth globally. It prices at parity with Samsung, earned a net margin of about 52% in the first half of 2026 (RMB77.6bn on RMB150.3bn of revenue), and is booked through 2027. Its July STAR Market IPO raised RMB57.9bn ($8.6B). So it relieves volume, not price.</p>
<p><strong>It mostly displaces imports.</strong> Goldman puts CXMT at 41% of China’s DRAM demand in 2026 and about 50% by 2028. The bits that frees for Korean and US vendors elsewhere are small next to industry bit growth of 22–24% a year, and Korean HBM conversion is driven by HBM demand regardless.</p>
<p><strong>China’s HBM is a closed, starved loop.</strong> CXMT makes HBM3 8-high at about 25% overall yield (SemiAnalysis, June) and began small-scale HBM3E in September; it has no HBM4. Huawei’s pre-control stockpile of about 13M stacks (11.4M from Samsung) runs out in 2026. Epoch AI’s model has about 1.5M Ascend chips in 2026, but only about 240k with domestic HBM, about 30–35M GB or 0.03 EB, while about 750k use non-HBM memory. Ascend prices rose 20–50% in two months; the 950DT now lists above RMB250k. DeepSeek’s order for 160k 950DTs alone would take about 70% of 2026’s domestic HBM.</p>
<p><strong>Export controls cap China’s demand on the Korean and US balance.</strong> The December 2024 rule bars HBM above 2 GB/s/mm² of bandwidth density; equipment controls cover every CXMT node. Nvidia’s H200 is licensed, with 25% to the US Treasury and at most 75k units per buyer, but Beijing’s own gatekeeping held deliveries to about 20k by August against more than 2M ordered. Even the full licensed ceiling, about 750k H200s at 141 GB, is about 0.1 EB. China’s draw on Korean and US HBM is policy-gated, small, and could swing either way.</p>
<p><strong>The Korean fabs in China are frozen at their nodes.</strong> Samsung’s and SK hynix’s China fabs lost fast-track (validated end-user) status on December 31, 2025 and run on annual licences that bar upgrades. Wuxi is about half of SK hynix’s DRAM capacity, so its HBM growth has to come from Korea and the US while Wuxi drifts toward commodity output that competes with CXMT.</p>
<p><strong>YMTC matters more for flash than DRAM.</strong> It is now third in NAND by shipments, with 14–16.5%. Omdia has it adding about 486k NAND wafers in 2027 against about 75k each for Samsung and SK hynix, useful for the SSD tier that holds offloaded KV cache. Its DRAM entry, about 50k wafers, is immaterial before 2028.</p>
<p><strong>Oversupply risk: low through 2027, rising after.</strong> China’s DRAM capacity could reach about 1.4M wafer starts a month by 2030, and domestic DUV scanners arrive in 2027–28 (Citrini). An AI air pocket would hit DDR5 and LPDDR5X first, CXMT’s core products. Citrini still models a global DRAM deficit of about 25% in 2030.</p>
<p><strong>Dates to watch.</strong> The US affiliates rule returns on November 10 unless extended; the HBM temporary licence expires on December 31; the Korean fabs in China need 2027 licences; and CXMT’s Entity List designation is approved but unpublished.</p>
<h2>Terafab and other new capacity</h2>
<p>Terafab adds essentially no memory before 2030; through this forecast it matters as a buyer, not a supplier. Our base case puts its DRAM output at about 10,000 wafer starts a month in 2030, roughly 0.1% of global DRAM bits, and no HBM.</p>
<p><strong>What is actually committed.</strong> Musk floated a “Tesla TeraFab” in November 2025, described it in January 2026 as “logic, memory and packaging”, and launched it on March 21 with talk of 100,000 wafer starts a month initially and 1,000,000 eventually. Intel joined in April, and the first full-scale phase is to run Intel’s 14A logic process. Two things are firm. A research fab at Giga Texas of “a few thousand” wafers a month, about $3B, starts operating in the first half of 2027; its first test chip is SRAM, due in May–June 2027. And a $16.8B Phase 1 at Grimes County runs from December 1, 2026 to the end of 2028, within up to $119B of phases through 2036. On October 20 Musk targeted volume logic production for Q3–Q4 2028, “with big error bars”. No DRAM capacity, node, process licensor or memory partner has been disclosed; the memory evidence is job postings since August for sub-20nm DRAM process integration and HBM/LPDDR interface design.</p>
<p><strong>Why memory comes late.</strong> Incumbents with their own process take about 3.7 years from groundbreaking to first DRAM wafers: Micron’s Idaho ID1 broke ground in October 2023 and outputs first wafers in mid-2027, with meaningful output in 2028. CXMT, the last new entrant, took about 3.5 years to first low-volume output and 8–10 years to a mid-single-digit share. Phase 1’s $16.8B buys roughly one memory fab ($15–20B) or half a leading-edge logic fab, and it is going to logic. Without a licensed DRAM process, first product wafers point to about 2030; HBM, which needs best-in-class DRAM yields plus stacking, comes after that.</p>
<p><strong>Our scenarios.</strong> Base (35%): about 2,000 DRAM wafer starts a month in 2029 and about 10,000 in 2030, about 0.1% of 2030 DRAM bits. High (10%), with a licensor signed and tools ordered by mid-2027: about 20,000 and 50,000, about 1% of bits and under 1% of HBM. Low (55%): engineering lots only. For scale, CXMT alone adds about 100,000 wafer starts a month in 2027, twice the high case for 2030.</p>
<p><strong>Net effect: neutral to tighter.</strong> Whatever Terafab makes is captive, so it displaces Tesla and SpaceX purchases rather than adding merchant supply. Meanwhile Musk’s companies plan about 13 GW of compute by end-2027, including a 440,000-GPU Vera Rubin cluster by mid-2027, roughly 0.13 EB of HBM4 on its own. Musk himself calls memory “the biggest constraint”. The one real effect before 2030 is on bargaining: a credible in-house threat can weigh on 2028–30 contract pricing before any bits exist.</p>
<p><strong>Other new capacity is incumbents, financed by customers.</strong> Outside China there is no new DRAM producer before 2030. SoftBank and Intel’s Saimemory plans Z-Angle Memory prototypes by March 2028 and commercialization in its fiscal 2029, with no capacity disclosed. Buyer money instead funds incumbents’ cleanrooms. Micron has 26 strategic customer agreements covering more than 35% of revenue through 2030, and $32B of customer commitments, mostly prepayments. SK hynix is moving to 3–5-year contracts with 10–30% upfront.</p>
<h2>Unit volumes, supply and memory per package decide the cycle</h2>
<p>Supply vs demand (supply ÷ demand − 1) in each scenario. “Low” units are the capex- and power-limited view, about 15–17M packages a year; “high” takes the vendors’ deal books at face value, about 25M in 2027 and 39M by 2030.</p>
<ul><li><strong>Base — Units: base · Specs: trimmed · HBM supply: base · 2027: −2% · 2028: +3% · 2030: −2%</strong></li><li><strong>Roadmaps hold</strong> — Units: base · Specs: announced · HBM supply: base · 2027: −18% · 2028: −29% · 2030: −38%</li><li><strong>Deal books delivered</strong> — Units: high · Specs: trimmed · HBM supply: base · 2027: −22% · 2028: −22% · 2030: −33%</li><li><strong>Supply disappoints (HBM4 yields, cleanroom slips)</strong> — Units: base · Specs: trimmed · HBM supply: low · 2027: −16% · 2028: −17% · 2030: −29%</li><li><strong>Supply surprises (Samsung, new fabs on time)</strong> — Units: base · Specs: trimmed · HBM supply: high · 2027: +12% · 2028: +27% · 2030: +30%</li><li><strong>Power- and capex-limited build</strong> — Units: low · Specs: trimmed · HBM supply: base · 2027: +37% · 2028: +52% · 2030: +52%</li><li><strong>Power-limited build, roadmaps hold</strong> — Units: low · Specs: announced · HBM supply: base · 2027: +15% · 2028: +4% · 2030: −6%</li></ul>
<h3>One input at a time, 2028</h3>
<p>2028 supply vs demand at trimmed specs when one input changes and the rest stay at base. Labels: the input’s setting and the result. Whole unit cases swing it further, −22% to +52%.</p>
<figure><a href="https://06.ai/packs/ai-memory-balance#scenarios"><img src="https://06.ai/newsletter/ai-memory-balance/fig-09.png" alt="Unit volumes, supply and memory per package decide the cycle" width="694" height="330"></a></figure>
<h2>Reading the scenarios</h2>
<p><strong>The base case sits on a knife-edge.</strong> Moving to the low or high supply case (about −19% or +23%), or ±15% on memory per package, swings 2028 anywhere from 10–17% short to 21–27% long. Three variables decide the cycle: total unit volumes, which power limits; good bits per HBM wafer (HBM4/4E yields, Samsung’s ramp); and whether 8-Hi stacks stick.</p>
<p><strong>Reading the camps.</strong> The “oversupply by 2028” view (Bloomberg Intelligence, DS Investment, Morgan Stanley’s Micron model with fiscal 2029 EPS down about 40%) needs either the power-limited build or the supply upside. The “short through 2030” view (SK hynix, Micron, Citrini’s 25% DRAM deficit in 2030) needs the announced roadmaps or the deal books. Our base is neither: within ±3% every year, and only because memory per package stops compounding at its old rate.</p>
<p><strong>How this squares with </strong><strong>the </strong><a href="https://06.ai/packs/ai-compute-balance"><strong>compute-balance</strong></a><strong> pack</strong><strong>.</strong> <a href="https://06.ai/packs/ai-compute-balance">The </a><a href="https://06.ai/packs/ai-compute-balance">compute-balance</a><a href="https://06.ai/packs/ai-compute-balance"> pack</a> found that from 2027 power and money, not chips, limit what gets switched on: about 38 GW of all-in capacity in 2027, rising to 51 GW in 2030, while the chipmakers could deliver chips for 47–80 GW. On the <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack’s basis (a data center draws about twice its chips’ rated power) and our estimate of 1.4–1.7 kW of chip power per package, our base units need about 55 GW in 2027 and 68–93 GW a year in 2028–30, 7–17% more than the <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack’s chip path. Its switched-on path sits below even our low unit case (41–61 GW). In that low case HBM runs 37–52% long at trimmed specs in 2027–30, and the industry could afford the announced roadmaps instead: supply would sit within −6% to +15% of demand. If chip purchases fall to the <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack’s switched-on path, the surplus is larger still.</p>
<p><strong>Asymmetry.</strong> Our base needs more new AI capacity a year after 2027 than the <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack expects to be switched on, so the unit risk leans down. The downside case for memory makers, a power-limited build with trimmed specs (+52% in 2028), arrives just as Yongin, P5, ID2 and Hiroshima add wafers. The upside needs the announced roadmaps or deal-book volumes, either of which leaves 2028 22–29% short.</p>
<h2>What to watch</h2>
<p>The next six months settle more of this than the last six: 2027 HBM4 contract prices, whether 8-Hi sticks on Rubin Ultra and the 2027 ASICs, and how many gigawatts actually get switched on. 2027 memory earnings are largely contracted; the open question is 2028.</p>
<ul><li><strong>Oct 29</strong> — SK hynix and Samsung Q3 results · 2027 capex, HBM wafer adds, HBM4 share at Nvidia, long-term-agreement coverage</li><li><strong>November</strong> — Nvidia fiscal Q3 2027 results · Rubin ramp, gross margin path, supply commitments; any confirmation of Rubin Ultra’s 192/256 GB configuration or Vera’s 768 GB SKU</li><li><strong>Nov 10 and Dec 31</strong> — US affiliates rule returns; HBM temporary licence expires · China’s access to HBM and tools; 2027 licences for Korean fabs in China</li><li><strong>4Q 2026</strong> — 2027 HBM4 contract settlements · HBM4 near $4–5/Gb validates the top of the +54–121% range; HBM4 well below $4/Gb, or blended pricing nearer +54%, means buyers had more leverage</li><li><strong>1Q 2027</strong> — First 2027 conventional DRAM contract print · A rise under 5% a quarter favours the balance-by-late-2027 camp</li><li><strong>March 2027</strong> — Nvidia GTC · Feynman’s memory spec and Rubin Ultra’s final configuration</li><li><strong>Mid-2027</strong> — M15X at full rate; Yongin fab 1, Micron ID1 and Tongluo first output · Whether 2028 supply arrives on time</li><li><strong>2027</strong> — Photonic Fabric memory samples; HBF samples; first named pooling customer · Whether capacity moves off HBM after 2028</li><li><strong>Rolling</strong> — Gigawatts switched on against SemiAnalysis’s ~51 GW for 2027; hyperscalers’ 2027 capex guides · Which unit path, base, power-limited or deal-book, is real</li></ul>
<p><strong>HBM makers (SK hynix, Samsung, Micron).</strong> Pricing power peaks in 2027, when HBM must reprice toward commodity-DRAM parity at about 3× the wafer cost per bit. Micron’s $32B of customer commitments and Samsung’s five-year agreements, planned to cover 60–70% of capacity, make 2027 visible; the equities already discount a 2028 turn (SK hynix about 57% off its June peak, at about 2.7× 2027 earnings per BofA). Our base case says the 2028 risk comes from the demand side, trimmed specs plus a power-limited build, more than from new fabs.</p>
<p><strong>Nvidia.</strong> Memory is the main gross-margin headwind (75% to 71–72%) and the reason for server price increases of more than 15%. Trimming memory per GPU protects unit volume; per-die HBM falls on Rubin Ultra.</p>
<p><strong>Custom-ASIC chains (Broadcom, MediaTek, Alchip, Marvell).</strong> They take most of 2027’s unit growth and are still mostly on HBM3E, which keeps HBM3E tight through 2027.</p>
<p><strong>Capacity tiers.</strong> LPDDR/SOCAMM suppliers, enterprise SSD and NAND, and CXL silicon (Astera Labs, Marvell, Montage) are where KV-cache growth shows up first. Optical pooling (Marvell) and High Bandwidth Flash (SanDisk, SK hynix) come in 2028 and later.</p>
<p><strong>China and Terafab.</strong> CXMT relieves volume, not price, and stays mostly domestic; China’s demand for Korean and US HBM is set by policy, not need. Terafab is a buyer through 2030, with bargaining value before it has any bits.</p>
<h2>What this is anchored on</h2>
<p>Supply, demand, memory per package, the balance and the scenarios are our estimates, built from the sources below as of October 25, 2026.</p>
<ul><li><strong>Nvidia</strong> — Rubin: 288 GB of HBM4 per GPU, listed bandwidth 19.2 TB/s (22 TB/s at CES); Vera “up to 1.5 TB” of LPDDR5X; sized for 128K–400K cached tokens per user · <a href="https://www.nvidia.com/en-us/data-center/vera-rubin-nvl72/">Nvidia Vera Rubin NVL72 page</a></li><li><strong>Nvidia</strong> — GB300 NVL72: 20 TB of HBM (about 278 GB per GPU) and 17 TB of LPDDR5X per rack · <a href="https://www.nvidia.com/en-us/data-center/gb300-nvl72/">Nvidia GB300 NVL72 page</a></li><li><strong>Nvidia</strong> — Rubin Ultra announced with 1 TB of HBM4E on four compute dies; Kyber NVL144 · <a href="https://technews.tw/2026/03/18/nvidia-gtc-2026-chips/">TechNews, GTC 2026, Mar 18</a></li><li><strong>Nvidia</strong> — Q2 gross margin 75.0%; Q3 guide 74% ±50 bp; inventory $31.6B · <a href="https://www.sec.gov/Archives/edgar/data/0001045810/000104581026000073/q2fy27pr.htm">Nvidia Q2 FY27 8-K</a></li><li><strong>Nvidia</strong> — CFO Colette Kress on “extreme pricing conditions in memory”: gross margin troughs at 71–72% in the quarter to January 2027; supply commitments from $119B to $279B · <a href="https://www.nasdaq.com/articles/memory-costs-rise-can-nvidia-protect-its-70-gross-margin">Nasdaq / Zacks, Sep 3</a></li><li><strong>Nvidia</strong> — Supply and capacity purchase commitments, mostly memory, from $119B to $279B in one quarter; Morgan Stanley’s 2027 HBM split of 37/36/12% for Nvidia, Google and AMD · <a href="https://xenospectrum.com/en/nvidia-hbm-demand-supply-commitments/">XenoSpectrum</a></li><li><strong>Rubin Ultra</strong> — Moves to 8-Hi stacks: not enough HBM wafers for 12-Hi, HBM cost, and a 576-GPU domain of 192 GB parts (~110 TB) · <a href="https://newsletter.semianalysis.com/p/long-live-the-short-king-why-4-hi">SemiAnalysis, Sep 13</a></li><li><strong>Rubin Ultra</strong> — Configurations tested with as little as 192 GB, and a step back to HBM4 · <a href="https://www.tomshardware.com/pc-components/gpus/nvidia-reportedly-testing-lower-memory-configs-of-rubin-ultra-as-memory-shortage-bites-back-designs-tested-include-as-little-as-192-gb-and-step-back-to-hbm4">The Information, via Tom’s Hardware</a></li><li><strong>Rubin</strong> — Most Rubin stays on 12-Hi HBM4 · <a href="https://www.sammyfans.com/2026/10/08/nvidia-rubin-ai-chips-to-retain-12-layer-hbm4-from-samsung-and-sk-hynix/">Counterpoint, via Sammy Fans, Oct 8</a></li><li><strong>Vera</strong> — LPDDR5X per Vera CPU cut from 1.5 TB to 768 GB in 2027 supply plans, “lowering memory per module while increasing total module shipments” · <a href="https://www.trendforce.com/presscenter/news/20260610-13090.html">TrendForce, Jun 10</a></li><li><strong>Vera Rubin cost</strong> — Without the Vera cut, memory would be ~29% of a ~$2.1M VR200 system’s bill of materials, against Nvidia’s preferred ~20% · <a href="https://www.trendforce.com/news/?p=61614">GF Securities, via TrendForce, Jul 28</a></li><li><strong>Vera Rubin cost</strong> — Memory up from ~5–10% to 25–30% of a rack’s bill of materials; server prices up more than 15% · <a href="https://www.vktr.com/ai-market/nvidia-tells-microsoft-google-oracle-that-ai-server-prices-are-going-up-more-than-15/">Morgan Stanley and Bloomberg, via VKTR</a></li><li><strong>GeForce</strong> — RTX 5070 Ti and 5060 Ti 16 GB supply cut 30–40% in 1H26 against 1H25 (Board Channels, Benchlife) · <a href="https://tweaktown.com/news/109394/nvidia-to-cut-supply-of-best-value-geforce-rtx-50-series-gpus-in-half-over-memory-shortages/index.html">TweakTown, Dec 17, 2025</a></li><li><strong>GeForce</strong> — Nvidia: “memory supply is constrained”; all GeForce SKUs still shipping · <a href="https://www.tomsguide.com/computing/gpus/yes-the-entire-series-effectively-nvidia-rtx-50-series-production-reportedly-on-hold-and-its-all-because-of-ai-demand">Tom’s Guide, Jan 22</a></li><li><strong>HBM per device</strong> — GPU and ASIC makers “considering reducing HBM capacity per device”, evaluating 8-Hi in 2027; 8-Hi at a 10–20% per-Gb premium; blended 2027 HBM price +121% · <a href="https://www.trendforce.com/presscenter/news/20260929-13255.html">TrendForce, Sep 29</a></li><li><strong>HBM price</strong> — HBM4 12-Hi about $2/Gb in 2026 and $4–5/Gb in 2027; 8-Hi at a 20–30% premium · <a href="https://stockhub.kr/en/insights/citi-samsung-005930-q3-2026-hbm4-20261008">Citi, via StockHub, Oct 8</a></li><li><strong>HBM price</strong> — HBM3E near $1.50/Gb under 2026 contracts · <a href="https://www.koreaherald.com/article/10895833">Korea Herald</a></li><li><strong>HBM balance</strong> — HBM sufficiency −16% across 2026–28; HBM price +54% in 2027 · <a href="https://www.webull.com/news/15626418510496768">J.P. Morgan, via Zhitong / Webull, Sep</a></li><li><strong>HBM balance</strong> — HBM sufficiency −5.4%, −6.0% and −4.3% in 2026–28; DRAM −5.0%, −5.9%, −3.9% · <a href="https://www.itiger.com/news/1117469753">Goldman Sachs, via Tiger, Jun</a></li><li><strong>HBM balance</strong> — SemiAnalysis’s HBM balance; Samsung P5 HBM output in 2028 · <a href="https://www.useluminix.com/reports/industry-analysis/dram-cycle-position-analysis-peak-timing-indicators">Luminix</a></li><li><strong>DRAM balance</strong> — DRAM sufficiency −5.0%, −1.9% and +0.5% in 2026–28 · <a href="https://file.alphasquare.co.kr/media/pdfs/market-report/%EB%B0%98%EB%8F%84%EC%B2%B4%EA%B3%B5%EA%B8%8920260720DS%ED%88%AC%EC%9E%90%EC%A6%9D%EA%B6%8C.pdf">DS Investment &amp; Securities, Jul 20 (PDF)</a></li><li><strong>HBM supply</strong> — HBM 18%, 22% and 30% of the big three’s DRAM wafer starts in 2025–27, and 8%, 9% and 13% of bits · <a href="https://iconnect007.com/article/150239/tight-dram-supply-boosts-pricing-power-hbm-contract-prices-set-to-surge-in-2027/150236/pcb">TrendForce, via I-Connect007</a></li><li><strong>HBM supply</strong> — HBM3E takes about 3× DDR5’s wafer area per bit, and the ratio rises each generation · <a href="https://xenospectrum.com/en/micron-hbm-ddr-silicon-gap/">Micron, via XenoSpectrum</a></li><li><strong>HBM supply</strong> — Samsung HBM wafer input ~180k a month on average in 2026 and ~250k in 2027 · <a href="https://www.trendforce.com/news/?p=64643">TrendForce, Sep 29</a></li><li><strong>HBM supply</strong> — Micron adds 60k HBM wafers a month, reaching ~100k by year-end · <a href="https://www.trendforce.com/news/2026/09/04/news-micron-reportedly-to-add-60k-hbm-wafersm-reaching-100k-by-year-end-to-narrow-gap-with-samsung-sk-hynix/">TrendForce, Sep 4</a></li><li><strong>HBM supply</strong> — DRAM and TSV (HBM) wafer capacity by vendor, 2025–26 · <a href="https://files.futurememorystorage.com/proceedings/2025/20250805_BMKT-101-1_Avril-Wu.pdf">TrendForce, FMS 2025</a></li><li><strong>HBM supply</strong> — HBM bit shipments: 1.5 EB in 2024, about 3.0 EB in 2025 · <a href="https://files.futurememorystorage.com/proceedings/2025/20250805_BMKT-102-1_Ellie-Wang.pdf">TrendForce, FMS 2025</a></li><li><strong>HBM supply</strong> — Q2 2026 HBM revenue share: SK hynix 50%, Samsung 33%, Micron 18% · <a href="https://www.mt.co.kr/en/industry/2026/10/19/2026101913371799572">Counterpoint, via MT, Oct 19</a></li><li><strong>DRAM capacity</strong> — 2030 capacity: Samsung 1.14–1.45M and SK hynix 1.18M wafer starts a month; China ~1.4M; domestic DUV in 2027–28 · <a href="https://www.tomshardware.com/pc-components/dram/cxmt-close-to-matching-microns-memory-capacity-in-2026-research-claims-would-put-china-on-track-to-become-worlds-second-largest-dram-producer">Citrini, via Tom’s Hardware, Jul 15</a></li><li><strong>DRAM price</strong> — Conventional contract prices up about sixfold from 3Q25 to 4Q26; 4Q26 +10–15% · <a href="https://www.trendforce.com/presscenter/news/20260930-13258.html">TrendForce, Sep 30</a></li><li><strong>Contracts</strong> — Micron: 26 strategic customer agreements covering more than 35% of revenue through 2030, $32B of customer commitments; ID1 and Tongluo output mid-2027, ID2 and Japan late 2028, New York 2030 · <a href="https://www.benzinga.com/node/62095451">Micron Q4 FY26 call, via Benzinga, Sep 30</a></li><li><strong>Contracts</strong> — SK hynix moves to 3–5-year agreements with about 10–30% upfront; Samsung requires agreements of at least three years · <a href="https://www.trendforce.com/news/2026/04/09/news-from-annual-deals-to-3-5-year-ltas-samsung-and-sk-hynix-reportedly-reset-big-tech-memory-contracts/">TrendForce, Apr 9</a></li><li><strong>New fabs</strong> — SK hynix: M15X mass production accelerated; Yongin phase-1 cleanroom opens early 2027 · <a href="https://en.edaily.co.kr/news/eda202607295226/">Edaily, Jul 29</a></li><li><strong>New fabs</strong> — SK hynix Yongin fab 2: groundbreaking Jul 2027, first cleanroom Jun 2029 · <a href="https://www.fool.com/investing/2026/08/15/sk-hynix-approved-38-billion-of-new-memory-fabs-th/">The Motley Fool, Aug 15</a></li><li><strong>New fabs</strong> — SK hynix’s Yongin fab 1 at ~150k wafer starts a month by end-2028 · <a href="https://www.csis.org/analysis/beyond-memory-cycle-ai-hbm-and-new-semiconductor-shortage">CSIS</a></li><li><strong>New fabs</strong> — Samsung P4 adds about 60k wafer starts a month through Q2 2026; P5 operating in 2028 · <a href="https://www.koreajoongangdaily.com/business/samsung-sk-hynix-dramatically-scaling-up-hbm-production-to-meet-rising-demand-recent-nvidia-deals/12391367">KB Securities, via JoongAng Daily, Jan 4</a></li><li><strong>Units</strong> — Anthropic: 1 GW of Ironwood TPUs in 2026 and 5 GW of TPU 8i in 2027; TPU 8i production shipments started · <a href="https://www.webull.com/news/15513120997254144">Broadcom fiscal Q3 call, via Webull, Sep 3</a></li><li><strong>Units</strong> — OpenAI: 2 GW of Trainium from 2027 · <a href="https://www.247wallst.com/investing/2026/07/21/the-3-ways-amazons-trainium-chips-erode-nvidias-dominance-into-early-2027/">247 Wall St., Jul 21</a></li><li><strong>Units</strong> — 2027 CoWoS demand of about 2.7M wafers, Nvidia ~45% · <a href="https://www.kucoin.com/news/flash/morgan-stanley-report-cowos-demand-to-double-by-2027-amd-and-asics-drive-ai-chip-growth">Morgan Stanley, via KuCoin</a></li><li><strong>Power</strong> — New data-center IT capacity outside China ~25 GW in 2026 and ~51 GW in 2027 · <a href="https://superpowerdaily.com/posts/semianalysis-forecasts-51-gw-of-new-data-center-capacity-outside-china-in-2027">SemiAnalysis, via Superpower Daily</a></li><li><strong>Power</strong> — From 2027 power and money cap what is switched on: about 38 GW all-in in 2027 rising to 51 GW in 2030 · <a href="https://06.ai/packs/ai-compute-balance">06.ai </a><a href="https://06.ai/packs/ai-compute-balance">compute-balance</a><a href="https://06.ai/packs/ai-compute-balance"> pack</a></li><li><strong>Other chips</strong> — MTIA 300, 216 GB; MTIA 400/450, 288 GB; MTIA 500, 384–512 GB · <a href="https://www.tomshardware.com/tech-industry/semiconductors/meta-reveals-four-new-mtia-chips-built-for-ai-inference">Tom’s Hardware</a></li><li><strong>Other chips</strong> — TPU 8t, 216 GB of HBM3E; TPU 8i, 288 GB · <a href="https://www.storagereview.com/news/google-announces-tpu-8t-sunfish-and-tpu-8i-zebrafish">StorageReview</a></li><li><strong>Other chips</strong> — MI455X with 432 GB of HBM4 in the Helios rack · <a href="https://rocm.blogs.amd.com/ecosystems-and-partners/cdna5-helios/README.html">AMD ROCm blog</a></li><li><strong>Other chips</strong> — Maia 200, 216 GB · <a href="https://hothardware.com/news/microsoft-unveils-maia-200-ai-chips">HotHardware</a></li><li><strong>Other chips</strong> — Trainium 3, 144 GB of HBM3E · <a href="https://www.electronicspecifier.com/?p=180729">Electronic Specifier</a></li><li><strong>Other chips</strong> — Trainium 4 doubles Trainium 3’s memory and quadruples its bandwidth · <a href="https://www.nextplatform.com/2025/12/03/with-trainium4-aws-will-crank-up-everything-but-the-clocks/">The Next Platform</a></li><li><strong>Workloads</strong> — MLPerf Inference v6.1: GB300 and GB200 gain the same ~1.29× on models that can and can’t be capacity-bound · <a href="https://developer.nvidia.com/deep-learning-performance-training-inference/ai-inference">Nvidia MLPerf results</a></li><li><strong>Packaging</strong> — TSMC: 9.5-reticle CoWoS in volume in 2027 with 12 or more HBM stacks · <a href="https://www.trendforce.com/news/?p=38440">TrendForce, Apr 24, 2025</a></li><li><strong>Packaging</strong> — TSMC: CoWoS with 20 HBM stacks in 2028 and up to 24 in 2029 · <a href="https://www.trendforce.com/news/2026/05/14/news-tsmc-sees-ai-wafer-demand-rising-11x-from-2022-2026-targets-cowos-with-24-hbm-stacks-in-2029/">TrendForce, May 14</a></li><li><strong>KV cache</strong> — GB300 serving DeepSeek-R1: KV pool ~61% of HBM, weights ~14%; 1.5× the HBM gave 1.6× the decode batch · <a href="https://github.com/lm-sys/lm-sys.github.io/blob/main/blog/2026-02-19-gb300-longctx.md">LMSYS, Feb 19</a></li><li><strong>KV cache</strong> — FP4 KV holds 1.78× more than FP8; −1.6 points on SWE-bench Verified in one test · <a href="https://github.com/lm-sys/lm-sys.github.io/blob/main/blog/2026-09-16-nvfp4-kv-cache.md">LMSYS, Sep 16</a></li><li><strong>KV cache</strong> — DeepSeek-V4 stores 8.7× less KV than V3.2 at 1M tokens · <a href="https://github.com/vllm-project/vllm-project.github.io/blob/main/_posts/2026-04-24-deepseek-v4.md">vLLM, Apr 24</a></li><li><strong>KV cache</strong> — Coding-agent traces: 94% prefix-cache hits, 131:1 input to output, 5.2 s median pause; a shared KV store lifted throughput 3.8× and cut time-to-first-token 46× · <a href="https://github.com/vllm-project/vllm-project.github.io/blob/main/_posts/2026-05-06-mooncake-store.md">vLLM × Mooncake, May 6</a></li><li><strong>KV cache</strong> — Agent calls hit 85–97% cache after the first; agent teams 97.2% · <a href="https://github.com/ai-dynamo/dynamo/blob/main/docs/fern/pages/blog/2026/agentic-inference-optimizations.mdx">Nvidia Dynamo blog</a></li><li><strong>KV cache</strong> — DeepSeek-V4-Pro agent inputs: median 88K tokens, 675K at the 99th percentile · <a href="https://newsletter.semianalysis.com/p/agentx-inferencexv3-does-cuda-moat">SemiAnalysis AgentX, Aug 24</a></li><li><strong>KV cache</strong> — 57.5 concurrent agents per GPU for DeepSeek-V4-Pro on GB300 (Artificial Analysis AgentPerf) · <a href="https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/tech_blog/blog26_DeepSeek_V4_on_NVIDIA_Blackwell_Model_Specific_and_Agentic_Workload_Optimizations_in_TensorRT-LLM.md">TensorRT-LLM tech blog 26</a></li><li><strong>KV cache</strong> — Model configs: Llama 3.1 layers and KV heads · <a href="https://raw.githubusercontent.com/meta-llama/llama-models/main/models/sku_list.py">Meta llama-models</a></li><li><strong>KV cache</strong> — Kimi K3: ~27 KB of MLA KV per token, ~434 MB of recurrent state per request · <a href="https://github.com/lm-sys/lm-sys.github.io/blob/main/blog/2026-07-27-kimi-k3-day0-support.md">LMSYS, Jul 27</a></li><li><strong>KV cache</strong> — Qwen3.8: 23 grouped-query layers with 4 KV heads of 256, plus linear-attention state · <a href="https://github.com/sgl-project/sglang/blob/main/docs/cookbook/autoregressive/Qwen/Qwen3.8.mdx">SGLang cookbook</a></li><li><strong>KV cache</strong> — GLM-5.2: a measured FP8 KV page of 2.95 MiB per 64 tokens · <a href="https://github.com/NVIDIA/TensorRT-LLM/blob/main/docs/source/blogs/tech_blog/blog30_KV_Cache_Compression_in_TensorRT-LLM.md">TensorRT-LLM tech blog 30</a></li><li><strong>KV cache</strong> — Google: more than 3.2 quadrillion tokens a month in May 2026, against 480 trillion a year earlier · <a href="https://www.shacknews.com/article/149205/google-3-2-quadrillion-monthly-ai-tokens">Shacknews</a></li><li><strong>Lower precision</strong> — Part of GB300’s 1.6× software gain credited to lower KV-cache precision · <a href="https://blogs.nvidia.com/blog/vera-rubin-nvl72-mlperf-inference">Nvidia blog</a></li><li><strong>Groq 3 LPX</strong> — SRAM decode racks: 500 MB per chip, 128 GB per rack, paired with Rubin GPUs · <a href="https://developer.nvidia.com/blog/inside-nvidia-groq-3-lpx-the-low-latency-inference-accelerator-for-the-nvidia-vera-rubin-platform">Nvidia technical blog</a></li><li><strong>Tiers</strong> — KV offload to a CXL pool at ~92% of local-DRAM throughput · <a href="https://download.semiconductor.samsung.com/resources/white-paper/Optimizing_KV_Cache_Offloading_to_CMM-D_in_a_CXL_Switch-based_Memory_Pool.pdf">Samsung CMM-D white paper</a></li><li><strong>Tiers</strong> — Alibaba’s CXL pool cut time-to-first-token ~90% against an RDMA store · <a href="https://arxiv.org/html/2511.20172v2">arXiv</a></li><li><strong>Tiers</strong> — BlueField-4 context-memory storage, 2H 2026, “up to 5×” tokens/s · <a href="https://nand-research.com/research-note-improving-inference-nvidias-inference-context-memory-storage-platform/">NAND Research</a></li><li><strong>Tiers</strong> — ~16 TB of NAND per Rubin GPU; ~115 EB in 2027, ~9% of global NAND · <a href="https://wccftech.com/nvidia-next-generation-of-ai-systems-could-gobble-up-millions-of-terabytes-of-nand-ssd/amp/">Citi, via Wccftech</a></li><li><strong>Tiers</strong> — High Bandwidth Flash: samples 2027, production 2028 · <a href="https://www.trendforce.com/news/2026/08/14/news-sandisk-reportedly-tapes-out-first-hbf-product-targets-2027-samples-and-2028-production/">TrendForce, Aug 14</a></li><li><strong>Tiers</strong> — Enterprise SSD 37% of 2026 NAND demand · <a href="https://cdn.technews.tw/2026/04/07/cfm-kv-cache/">CFM, via TechNews, Apr 7</a></li><li><strong>Tiers</strong> — NAND shortfall of 6.1% in 2027 · <a href="https://wallstreetcn.com/articles/3782525">Citi, via Wallstreetcn, Sep 21</a></li><li><strong>Tiers</strong> — Structera: 48 TB behind one CXL switch · <a href="https://futurumgroup.com/insights/marvell-scales-ai-memory-to-48tb-behind-a-single-cxl-switch-at-fms-2026/">Futurum</a></li><li><strong>Marvell</strong> — Celestial AI acquisition closed Feb 2: $3.25B plus up to $2.25B tied to revenue · <a href="https://www.marvell.com/company/newsroom/marvell-completes-acquisition-of-celestial-ai.html">Marvell</a></li><li><strong>Marvell</strong> — Photonic Fabric memory module: 2 TB of DDR5 behind 72 GB of HBM3E; a 2U appliance of ~33 TB for up to 16 servers · <a href="https://hoti.org/assets/slides/2025_08_21_day2_Afternoon_CelestialAI_sponsor_talk.pdf">Celestial AI, HOTI 2025</a></li><li><strong>Marvell</strong> — Memory module samples to “multiple customers” in 2027; interconnect revenue targets · <a href="https://stockanalysis.com/stocks/mrvl/transcripts/724088-investor-day-2026/">Marvell Investor Day transcript</a></li><li><strong>Marvell</strong> — Amazon warrant for 1,045,171 shares at $87.00, vesting with Photonic Fabric purchases through 2030 · <a href="https://www.sec.gov/Archives/edgar/data/1835632/000119312525305271/d81371d8k.htm">Marvell 8-K</a></li><li><strong>Marvell</strong> — Photonic Fabric link energy and latency · <a href="https://www.hc2025.hotchips.org/assets/program/conference/day2/76-Hotchips_25_Celestial_AI_v4.pdf">Celestial AI, Hot Chips 2025</a></li><li><strong>China</strong> — CXMT cuts the global DRAM deficit from 15.5% to 9.4% in 2026 and from 12.0% to 5.6% in 2027 · <a href="https://xenospectrum.com/en/cxmt-dram-supply-growth-2027/">Hanwha, via XenoSpectrum</a></li><li><strong>China</strong> — CXMT capacity and output · <a href="https://www.trendforce.com/news/?p=64555">TrendForce</a></li><li><strong>China</strong> — CXMT to double DRAM output · <a href="https://www.digitaltoday.co.kr/en/view/116690/china-cxmt-to-double-dram-output-but-easing-memory-shortage-seen-unlikely">DigitalToday</a></li><li><strong>China</strong> — CXMT begins HBM3E production · <a href="https://www.koreajoongangdaily.com/business/chinas-cxmt-begins-hbm3e-production-as-chip-battle-with-korean-powerhouses-widens/12854260">JoongAng Daily</a></li><li><strong>China</strong> — CXMT capacity sold out through 2027 · <a href="https://www.guru3d.com/story/cxmt-dram-capacity-reportedly-sold-out-through-2027-as-major-oems-fight-for-supply/">Guru3D</a></li><li><strong>China</strong> — CXMT 41% of China’s DRAM demand in 2026, ~50% by 2028 (Goldman) · <a href="https://www.digitaltoday.co.kr/en/view/96664/cxmt-hits-production-ceiling-dimming-hopes-of-easing-dram-shortage">DigitalToday</a></li><li><strong>China</strong> — ~1.5M Ascend chips in 2026, ~240k with domestic HBM · <a href="https://epoch.ai/publications/huaweis-roadmap-to-2031">Epoch AI</a></li><li><strong>China</strong> — Ascend prices up 20–50%; 950DT above RMB250k · <a href="https://www.trendforce.com/news/?p=63912">TrendForce</a></li><li><strong>China</strong> — Huawei’s pre-control stockpile of ~13M HBM stacks · <a href="https://the-decoder.com/huaweis-ai-chip-production-boom-reportedly-faces-a-critical-shortage-of-high-bandwidth-memory/">The Decoder</a></li><li><strong>China</strong> — H200 licence terms: 25% to the US Treasury, at most 75k units per buyer · <a href="https://introl.com/de/blog/bis-export-policy-h200-mi325x-china-case-by-case-2026">Introl</a></li><li><strong>China</strong> — Chinese firms ordered more than 2M H200s (Reuters) · <a href="https://fintool.com/news/china-blocks-nvidia-h200-customs">Fintool, Jan 18</a></li><li><strong>China</strong> — About 20k H200s delivered, to ByteDance and Tencent, by August · <a href="https://www.spheron.network/blog/nvidia-h200-china-shipment-2026/">Spheron</a></li><li><strong>China</strong> — Samsung and SK hynix China fabs lose validated end-user status on Dec 31, 2025 · <a href="https://www.govinfo.gov/content/pkg/FR-2025-09-02/html/2025-16735.htm">Federal Register</a></li><li><strong>China</strong> — YMTC adds ~486k NAND wafers in 2027 (Omdia) · <a href="https://en.fnnews.com/news/202608301656577940">FNNews</a></li><li><strong>Terafab</strong> — Launched Mar 21 with talk of 100,000 wafer starts a month initially, 1,000,000 eventually; Texas filings put Phase 1 construction from Dec 1, 2026 to end-2028 · <a href="https://en.wikipedia.org/wiki/Terafab">Wikipedia, citing filings and the Austin American-Statesman</a></li><li><strong>Terafab</strong> — $16.8B first phase at Grimes County, to run Intel’s 14A process · <a href="https://www.tomshardware.com/tech-industry/semiconductors/terafab-starts-to-take-shape-100-million-square-feet-of-manufacturing-space-and-usd16-8b-initial-capital-investment">Tom’s Hardware, Aug 7</a></li><li><strong>Terafab</strong> — Volume logic production targeted for Q3–Q4 2028, “with big error bars” · <a href="https://www.thestar.com.my/tech/tech-news/2026/10/21/spacex-and-tesla039s-terafab-targets-2028-for-volume-chip-production-musk-says">Reuters, via The Star, Oct 21</a></li><li><strong>Terafab</strong> — Hiring a memory design interface architect with HBM and LPDDR experience; research fab to start operating in 1H 2027 · <a href="https://en.sedaily.com/international/2026/10/23/musks-hiring-spree-maps-out-teslas-ai-and-chip-ambitions">Seoul Economic Daily, Oct 23</a></li><li><strong>Terafab</strong> — Hiring for sub-20nm DRAM process integration · <a href="https://www.trendforce.com/news/2026/08/07/news-teslas-terafab-takes-shape-in-texas-with-16-8b-first-phase-memory-engineering-hiring-signals-dram-push/">TrendForce, Aug 7</a></li><li><strong>Terafab</strong> — CXMT adds about 100,000 wafer starts a month in 2027 · <a href="https://www.trendforce.com/news/2026/09/24/news-cxmt-ymtc-ramp-memory-capacity-but-chinas-ai-cloud-boom-could-soak-up-new-supply-through-2027/">TrendForce, Sep 24</a></li><li><strong>Terafab</strong> — About 13 GW of compute by end-2027, including a 440,000-GPU Vera Rubin cluster · <a href="https://www.diariobitcoin.com/tecnologia/musk-acelera-terafab-con-entregas-anticipadas-de-asml-y-apunta-a-producir-chips-en-2028/">DiarioBitcoin</a></li><li><strong>Terafab</strong> — Musk calls memory “the biggest constraint” · <a href="https://en.sedaily.com/technology/2026/08/08/musk-says-memory-is-biggest-constraint-as-terafab-advances">Seoul Economic Daily, Aug 8</a></li><li><strong>New entrants</strong> — Saimemory: Z-Angle Memory prototypes by Mar 2028, commercialization in FY2029 · <a href="https://www.softbank.jp/en/corp/news/press/sbkk/2026/20260203_01/">SoftBank</a></li><li><strong>Markets</strong> — SK hynix down ~57% from its June peak at ~2.7× 2027 earnings · <a href="https://www.itiger.com/news/1158341353">BofA, via Tiger, Oct 16</a></li><li><strong>Markets</strong> — Micron EPS of $225 in fiscal 2028 and $134 in fiscal 2029 · <a href="https://www.itiger.com/news/1129623218">Morgan Stanley, via Tiger, Oct 2</a></li><li><strong>Markets</strong> — IDC expects 2026 PC shipments to fall 11.3% · <a href="https://www.idc.com/resource-center/press-releases/idc-cuts-2026-pc-outlook-to-11-3-as-memory-shortages-and-supply-chain-disruptions-persist-into-2027/">IDC, Mar 12</a></li></ul>
<h2>Method</h2>
<p><strong>The balance.</strong> A calendar-year model of HBM from SK hynix, Samsung and Micron against the HBM inside the accelerators that use it. Supply = average HBM wafer starts a month × 12 × good TB per wafer start. Demand = K × [(1 − L) × C(y) + L × C(y + 1)], where C(y) is the HBM inside the year’s shipments (units × GB per package, summed over families), L = 0.35 is the share of a package’s HBM bought in the calendar year before it ships (stacks move through CoWoS, boards and buffers a quarter or more ahead), and K = 1.06 covers assembly losses and physical capacity above the usable figure. Supply vs demand = supply ÷ demand − 1. Supportable GB per package = supply ÷ (K × [(1 − L) × U(y) + L × U(y + 1)]), with U the packages shipped; the announced and trimmed averages use the same weights. China’s domestic HBM and accelerators sit outside the balance; licensed H200s are inside Nvidia’s units. LPDDR, GDDR and flash effects are discussed, not modelled.</p>
<ul><li><strong>HBM wafer starts, thousand a month</strong> — 2026: 450 (420–480) · 2027: 590 (540–640) · 2028: 710 (620–820) · 2029: 840 (700–1,000) · 2030: 975 (780–1,180)</li><li><strong>Good TB per wafer start</strong> — 2026: 0.72 (0.70–0.78) · 2027: 0.85 (0.80–0.90) · 2028: 0.94 (0.87–1.00) · 2029: 1.00 (0.91–1.08) · 2030: 1.05 (0.95–1.15)</li></ul>
<p><strong>Supply inputs.</strong> Vendor wafer figures run to 2027 (TrendForce, ETNews); after that HBM keeps about a third of a big-three DRAM base growing toward ~3M wafer starts a month by 2030. Good TB per wafer is calibrated to TrendForce’s bit totals, then rises 5–10% a year with 1c/1d nodes and 32 Gb dies, less than node gains alone because HBM4E and HBM5 dies are larger.</p>
<p><strong>Units.</strong> 2026–27 bottom-up from Nvidia’s fiscal 2028 guide, Morgan Stanley’s 2027 CoWoS demand, TPU forecasts and the AMD, Broadcom and Anthropic deal books; then about 12% in 2028 and 8% a year after. Low is the capex- and power-limited top-down view; high takes the deal books at face value. We count packages; Rubin Ultra counts in two-die equivalents so units compare across generations (Nvidia’s GTC 2025 names counted dies as GPUs; its current names, like ours, count packages).</p>
<p><strong>Memory per package.</strong> “Announced” uses vendor specs where they exist (Rubin Ultra 1 TB on four dies, MI455X 432 GB, MTIA 500 up to 512 GB) and extends their trend where they don’t, putting Feynman-class parts at about 0.8–0.9 TB per two-die package in 2029–30. “Trimmed” uses shipping or reported configurations: Rubin 288 GB, Rubin Ultra 192–256 GB on two dies, a 288 GB MI450, 8-Hi stacks on the 2027 ASICs, and Feynman near 400–460 GB. Per-family values are in the data under the memory-per-package chart.</p>
<p><strong>KV cache.</strong> Bytes per token from each model’s configuration at FP8 (2 × layers × KV heads × head size for standard attention; 576 bytes per layer for latent attention), times 131,072 tokens, plus the fixed recurrent state of linear-attention hybrids. GLM-5.2 uses a measured FP8 page; DeepSeek-V4-Pro is as deployed (FP8 attention, FP4 indexer, vLLM’s formula). The throughput, concurrency and spill figures are our estimates from published serving configurations.</p>
<p><strong>The </strong><a href="https://06.ai/packs/ai-compute-balance"><strong>compute-balance</strong></a><strong> pack</strong><strong> cross-check.</strong> Chip power per package is our estimate by family and year (Nvidia 1.4 kW in 2026 rising to 2.6 kW by 2030; TPUs, Trainium and other ASICs about 0.8–1.3 kW; AMD 1.4–2.2 kW), times units, times two for the whole facility, as in the <a href="https://06.ai/packs/ai-compute-balance">compute-balance</a> pack.</p>
<p><strong>Known limits.</strong> Supply after 2027 is our estimate: no vendor publishes HBM capacity that far out, and the low and high cases are the honest range. HBM4 and HBM4E bits per wafer are undisclosed; a 10% miss in good TB per wafer moves the balance about 10 points. Units after 2027 are set by power, not chips. 2025 doesn’t reconcile: supply of about 2.8 EB exceeds the 2.0 EB our lead implies was bought; we read the gap as inventory across the chain, and some may be units we undercount. Units and specs don’t respond to price in the model; in practice price clears the market, so a shortfall here is pressure on price and specs, not a shortage that will occur.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Can ads alone pay for the AI capex?</title>
  <link>https://06.ai/packs/ai-capex-payback</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-capex-payback</guid>
  <pubDate>Sun, 25 Oct 2026 12:11:00 GMT</pubDate>
  <description>Meta’s revenue is up 26% on a year ago and Alphabet’s 24%, faster than before the AI buildout. How much of that is AI, and what Meta’s and Alphabet’s AI capex earns if superintelligence, Waymo and every other moonshot never return a cent.</description>
  <category>AI returns</category>
  <enclosure url="https://06.ai/newsletter/ai-capex-payback/cover.png" length="59095" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-capex-payback/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-capex-payback"><img src="https://06.ai/newsletter/ai-capex-payback/thumb.png" alt="Can ads alone pay for the AI capex?" width="421" height="433"></a><figcaption><a href="https://06.ai/packs/ai-capex-payback">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>Before the AI buildout Meta’s revenue grew about 17% a year and Google’s ads about 15%; in 2022–23 both averaged single digits. Meta now grows <strong>26%</strong> on more than three times its 2019 revenue. We estimate AI accounts for about <strong>15 of Meta’s 27 points</strong> of ad growth this year, about <strong>$55B</strong>, and about 5 of Google’s 14. Count only those gains, charge every dollar of AI capex, superintelligence labs included, and Meta’s spending through 2026 earns about <strong>35% a year</strong>: core ads pay for the moonshot’s capex. The 2027 step-up is the bet. If it earns nothing new, Meta’s return falls to about <strong>18%</strong>, or 12% once spending outside capex is counted. Alphabet’s, with only Cloud’s backlog to show for 2027, falls to about <strong>13%</strong>. These are the middle of our ranges.</p>
<ul><li><strong>15 of 27 pts</strong> — AI’s share of Meta’s 2026 ad growth about $55B of revenue, 22% of the year’s ads, against a no-AI trend of 11% a year</li><li><strong>35%</strong> — Meta’s return on AI capex through 2026 a year, from ads alone with every moonshot at zero. Paid back in 2029; the ad gains could carry 2.5× that capex at a 10% hurdle</li><li><strong>18%</strong> — Add 2027’s ~$235B, no extra payoff. 12% counting cloud leases, AI talent and the moonshot fleet’s running costs; 8% if about $250B more goes into 2028</li><li><strong>13%</strong> — Alphabet, ads and Cloud, through 2027 ads alone 11%, Cloud alone 15%; 23% on capex through 2026</li></ul>
<h2>Meta grows half again as fast as before the buildout; Google’s ads are back to their old pace</h2>
<figure><a href="https://06.ai/packs/ai-capex-payback#growth"><img src="https://06.ai/newsletter/ai-capex-payback/fig-01.png" alt="Meta grows half again as fast as before the buildout; Google’s ads are back to their old pace" width="694" height="320"></a><figcaption>Revenue growth a year. 2019–23: compound growth through the pandemic boom, Apple’s tracking change and the 2022 slump, before AI capex took off. 2022–23: the average of those two years. Latest: the most recent quarter against a year earlier (Meta Q3 2026, Alphabet Q2 2026; Alphabet reports its third quarter on October 28).</figcaption></figure>
<h2>What changed</h2>
<p><strong>Meta.</strong> Revenue grew 17.5% a year from 2019 to 2023 and averaged about 7% in 2022–23. It grew 22% in 2025 and 26% in the third quarter of 2026, on more than three times its 2019 revenue. In constant currency, growth peaked at 29% in the first quarter.</p>
<p><strong>Alphabet.</strong> Outside Cloud it grows about 15%, its 2019–23 pace and twice its 2022–23 rate. Search accelerated from 10% in early 2025 to 19% in the first quarter of 2026 and 17% in the second; about 3 points of the first quarter’s company-wide growth was currency, against 1 in the second. YouTube ads grow about 13%, well below their 2019–23 pace. Cloud is the outlier: 28% growth in early 2025, 82% now, with a $514B backlog.</p>
<h2>Capex went from a fifth of Meta’s revenue to over half</h2>
<figure><a href="https://06.ai/packs/ai-capex-payback#capex"><img src="https://06.ai/newsletter/ai-capex-payback/fig-02.png" alt="Capex went from a fifth of Meta’s revenue to over half" width="694" height="302"></a><figcaption>Capex, including principal payments on finance leases for Meta, as a share of revenue. 2026: the midpoints of capex guidance ($135–145B and $195–205B) against Meta’s guided and Alphabet’s estimated revenue (third quarter at consensus).</figcaption></figure>
<h2>Google Cloud is still accelerating; Meta peaked in the first quarter</h2>
<figure><a href="https://06.ai/packs/ai-capex-payback#quarters"><img src="https://06.ai/newsletter/ai-capex-payback/fig-03.png" alt="Google Cloud is still accelerating; Meta peaked in the first quarter" width="694" height="658"></a><figcaption>Revenue growth against the same quarter a year earlier. Meta in constant currency; its fourth quarter is the midpoint of guidance with about 1 point of currency headwind added back (open dot). Alphabet as reported.</figcaption></figure>
<h2>Is growth accelerating?</h2>
<p><strong>Meta: no, it has leveled off high.</strong> Constant-currency growth rose from 19% in early 2025 to 29% in the first quarter of 2026 and has eased by about a point a quarter since; the fourth-quarter guidance midpoint is about 25%. Against two years earlier Meta is steady at 24–26% a year, so most of the slowdown is tougher comparisons.</p>
<p><strong>Alphabet: only Cloud.</strong> Its ad businesses accelerated through 2025 and have leveled off at about 15% outside Cloud. Cloud has accelerated every quarter, from 28% to 82%. The Street expects Alphabet’s total growth to ease to about 22% in the third quarter, on consensus revenue of $124.6B.</p>
<h2>At Meta, price is doing the work</h2>
<figure><a href="https://06.ai/packs/ai-capex-payback#price"><img src="https://06.ai/newsletter/ai-capex-payback/fig-04.png" alt="At Meta, price is doing the work" width="694" height="322"></a><figcaption>Growth in ad impressions and in the average price per ad, Meta’s Family of Apps, against a year earlier.</figcaption></figure>
<p>Impressions grew 19% in the first quarter of 2026 and 10% in the third, as daily users grew 3%. The average price per ad went the other way, from 6% in the fourth quarter of 2025 to 14%, with no currency effect in the third quarter. Higher prices on slowing volume are consistent with better targeting and conversion, though tighter ad supply would push prices up too. Meta credits ad performance, along with macro conditions and currency, and said on its second-quarter call that ranking advances lifted Facebook ad clicks 8.3% and conversions 15.7%. Volume is the risk: WPP Media expects social ad growth to slow from 2027 as engagement plateaus and chatbots compete for time.</p>
<h2>By our estimate AI adds about $55B to Meta’s ads this year, $30B to Google’s and $38B to Cloud</h2>
<p>Meta ads, 2026: $250B of revenue, $55B of it (22%) from AI at a 11% no-AI trend. AI adds about 15 of this year’s 27 points of growth.</p>
<figure><a href="https://06.ai/packs/ai-capex-payback#uplift"><img src="https://06.ai/newsletter/ai-capex-payback/fig-05.png" alt="By our estimate AI adds about $55B to Meta’s ads this year, $30B to Google’s and $38B to Cloud" width="694" height="362"></a><figcaption>Revenue against a no-AI trend that starts from 2023, the last year before the buildout. The gap is above-trend revenue; we credit AI with 80% of it at Meta, 75% at Google’s ads and 90% at Cloud. 2026 and 2027 are estimates (dashed). Choose the business and the no-AI trend.</figcaption></figure>
<h3>By business</h3>
<figure><a href="https://06.ai/packs/ai-capex-payback#uplift"><img src="https://06.ai/newsletter/ai-capex-payback/fig-06.png" alt="By our estimate AI adds about $55B to Meta’s ads this year, $30B to Google’s and $38B to Cloud — Google ads" width="694" height="393"></a><figcaption><strong>Google ads</strong>, 2026: $335B of revenue, $30B of it (9%) from AI at a 7.5% no-AI trend. AI adds about 5 of this year’s 14 points of growth.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-capex-payback#uplift"><img src="https://06.ai/newsletter/ai-capex-payback/fig-07.png" alt="By our estimate AI adds about $55B to Meta’s ads this year, $30B to Google’s and $38B to Cloud — Google Cloud" width="694" height="393"></a><figcaption><strong>Google Cloud</strong>, 2026: $102B of revenue, $38B of it (37%) from AI at a 22% no-AI trend. AI adds about 50 of this year’s 74 points of growth.</figcaption></figure>
<h2>How we split AI from trend</h2>
<p>No business has a clean control group, so the trend is a judgment. <strong>Meta, 11% a year:</strong> user growth of 3–5%, more ad load and new surfaces such as WhatsApp and Threads, and ad prices rising with the market. WPP Media puts global ad growth at 8.9% this year excluding US political advertising, and the US at 11.9%. Meta’s own 2019–23 pace, 17.5%, includes a pandemic boom on half today’s base. <strong>Google’s ads, 7.5%:</strong> their 2022–23 pace was 6.6%, Search’s 8.4%. Without AI, Search would arguably have lost queries to chatbots, so this may understate what AI is worth to Google. <strong>Cloud, 22%:</strong> it grew 26% in 2023 and was slowing with scale. The rest of each gap we leave to macro, currency and products that aren’t AI.</p>
<p>At these settings AI adds about 9 and 10 points to Meta’s growth in 2024 and 2025 and 15 in 2026, 22% of this year’s ad revenue; about 3–5 points a year to Google’s ads, 9% of this year’s; and 37% of Cloud’s revenue. For 2027 we assume Meta’s ads grow 18%, Google’s 11% and Cloud 55%. AI’s points are the growth in AI’s revenue over last year’s revenue, so they and the rest add up to the year’s growth.</p>
<h2>Ads alone pay for Meta’s AI capex through 2027, even if superintelligence earns nothing</h2>
<p>At a 11% no-AI trend with 80% of the gap credited to AI: 35% on capex through 2026, 18% adding 2027 and 8% adding 2028; all-in 27%, 12% and 3%.</p>
<figure><a href="https://06.ai/packs/ai-capex-payback#meta-irr"><img src="https://06.ai/newsletter/ai-capex-payback/fig-08.png" alt="Ads alone pay for Meta’s AI capex through 2027, even if superintelligence earns nothing" width="694" height="306"></a><figcaption>Internal rate of return on Meta’s AI capex from 2022, counting only AI’s share of above-trend ad revenue. Every dollar of capex above 17% of no-AI ad revenue is charged, Meta Superintelligence Labs included. All-in adds AI spending outside capex, $15B a year in 2026–31 and $7B after (cloud contracts, data-center joint ventures, AI talent), and running costs for the moonshot share of the fleet, 3% of its capex a year: our assumptions. The line is a 10% hurdle.</figcaption></figure>
<h2>How the return is counted</h2>
<p><strong>Returns.</strong> AI’s share of above-trend ad revenue at a 75% cash margin, after the cost of serving ads and before depreciation, taxed at 15%. Capex earns from the year after it’s spent, so 2027’s ad gains count against capex through 2026. After 2027 the gain is held as a share of the business, since a better ad system multiplies whatever advertisers spend, and fades 1.5% a year: no further share gains from AI.</p>
<p><strong>Costs.</strong> All capex above 17% of no-AI ad revenue: $187B over 2022–26, and $201B more if 2027 comes in at $235B. Meta hasn’t guided 2027; in July the buy-side expected $225–250B. The 17% baseline is close to Meta’s 2021 capex (16% of revenue) and below its 2019–23 average (about 21%), so it charges more to AI than a higher baseline would; at 21% the return through 2026 would be 46%. We put servers at 60% of capex, Alphabet’s split. They are replaced every six years at 75% of their cost for half the fleet, the part the ad gains need; the rest belongs to the moonshots and earns nothing. Servers are expensed at once for tax, data centers over 20 years. Nothing is counted after 2040.</p>
<p><strong>Results.</strong> Through 2026: 35%, paid back in 2029. At a 10% hurdle the ad gains could carry 2.5× that capex. With 2027 at $235B and nothing extra to show: 18%, paid back in 2032; each further $10B in 2027 takes about 0.6 points off. With another $250B in 2028: 8%, paid back in 2036. All-in: 27%, 12% and 3%. In our base case another year of moonshot spending, 2028, is what takes the return below 10%; all-in, 2027 alone brings it close. At the low end of our ranges 2027 can do it on its own, as the grid above and the simulation below show.</p>
<h2>Spend through 2026 pays back in 2029; each further year of moonshot capex pushes payback out three to four years</h2>
<figure><a href="https://06.ai/packs/ai-capex-payback#jcurve"><img src="https://06.ai/newsletter/ai-capex-payback/fig-09.png" alt="Spend through 2026 pays back in 2029; each further year of moonshot capex pushes payback out three to four years" width="694" height="362"></a><figcaption>Cumulative after-tax cash flow of Meta’s AI program, $B: AI’s share of above-trend ad profit, less incremental capex, server replacements and tax. Base case, no off-capex spending. The dots mark payback.</figcaption></figure>
<h2>At Alphabet, Cloud carries the 2027 build; the ad case turns on what Search would have done without AI</h2>
<p>At a 7.5% no-AI trend for Google’s ads and a 50% Cloud margin: ads and Cloud together return 23% on capex through 2026 and 13% through 2027; ads alone 11% and Cloud alone 15% through 2027.</p>
<figure><a href="https://06.ai/packs/ai-capex-payback#goog-irr"><img src="https://06.ai/newsletter/ai-capex-payback/fig-10.png" alt="At Alphabet, Cloud carries the 2027 build; the ad case turns on what Search would have done without AI" width="694" height="264"></a><figcaption>Internal rate of return on Alphabet’s AI capex with every moonshot at zero, for capex through 2026 and through 2027 (about $300B in 2027, on analysts’ projections). Ads and Cloud each carry half of the incremental capex, as about half of 2026’s ML compute goes to Cloud; together they carry all of it. Cloud’s revenue is capacity-bound: with capex through 2026 it stays at its end-2026 run-rate ($122B a year); with 2027’s build it converts backlog in 2028; after that its AI revenue is held in dollars and fades.</figcaption></figure>
<h2>Alphabet’s two legs</h2>
<p><strong>Ads.</strong> Charged half the capex, Google’s AI ad gains return 33% on spend through 2026 and 11% through 2027. That rests on something nobody can observe: at a 9.5% no-AI trend the 2027 case returns −1%, at 5.5% 21%. At a 10% hurdle the ad gains alone could carry 105% of all Alphabet’s incremental capex through 2026, but only 53% through 2027.</p>
<p><strong>Cloud.</strong> Revenue grew 82% to $24.8B in the second quarter, with an operating margin of 35.6%. We use a 50% cash margin on its AI revenue, before depreciation; Cloud’s figures include Gemini’s API, compute rented to AI labs and TPU sales. Charged the other half of the capex, Cloud returns 11% through 2026, when its revenue stops at the end-2026 run-rate, and 15% through 2027, as the 2027 build converts backlog: compute-rental economics, steady but not spectacular. Alphabet says renting third-party capacity as a bridge while it builds its own will weigh on Cloud’s margins.</p>
<p><strong>Together</strong> 23% through 2026 and 13% through 2027, paid back in 2034. The 2027 build pays well only if Cloud keeps compounding beyond its backlog or the models earn money of their own.</p>
<h2>Spend through 2026 very likely pays; the 2027 build is likely at Meta, closer to a coin flip at Alphabet</h2>
<figure><a href="https://06.ai/packs/ai-capex-payback#odds"><img src="https://06.ai/newsletter/ai-capex-payback/fig-11.png" alt="Spend through 2026 very likely pays; the 2027 build is likely at Meta, closer to a coin flip at Alphabet" width="694" height="288"></a><figcaption>Internal rate of return across 8,000 draws, each assumption uniform across its range, centered on the base case: the no-AI trend (Meta 9–13%, Google’s ads 5.5–9.5%, Cloud 18–26%), AI’s share of the gap (Meta 65–95%, Google’s ads 55–95%, Cloud 80–100%), cash margins (Meta 65–85%, Google’s ads 60–80%, Cloud 35–65%), 2027 growth, the gain fading 0–3% a year (Cloud 0–5%), the capex baseline (Meta 15–19%, Alphabet 10–12%), 2027 capex ($205–265B Meta, $260–340B Alphabet), the share of the fleet replaced (35–65%), server life (5–7 years), replacement cost (60–90%), Alphabet’s split between Cloud and the rest (40–60%) and, all-in, $5–25B a year of AI spending outside capex in 2026–31 ($3–11B after) and running costs of 2–4% a year. Fixed: tax rates, the horizon, 2026 capex and the server share of capex. Bars run from the 10th to the 90th percentile; the dot is the median.</figcaption></figure>
<h2>When does the cash come back?</h2>
<p>Spend through 2026 clears a 10% return in all of our 8,000 draws for Meta and 93% for Alphabet. Add 2027 with nothing extra from the moonshots and it clears in 93% of draws for Meta, 61% all-in, and 66% for Alphabet. The medians, 34%, 17% and 11% for Meta and 22% and 13% for Alphabet, sit within a point of the base case.</p>
<p>A vintage that earns its cost of capital still doesn’t reach shareholders while the race is on. Meta bought back $26.2B of stock in the first nine months of 2025 and none so far in 2026; its free cash flow was −$2.1B in the third quarter, and it is creating a non-voting Class C share, partly to raise capital. Alphabet bought back no stock in the first half of 2026 and raised about $106B: $56B of debt, $30B of common stock and $19B of preferred. Cash comes back when capex plateaus, and that runs against success: Zuckerberg’s stated fallback if superintelligence takes longer is to put the compute into the core business and, at worst, slow new building for a while. In our judgment, buybacks back at 2025’s pace by the end of 2028 are about a 30% chance at each company, likelier if the moonshots disappoint than if they work.</p>
<h2>What to watch</h2>
<p><strong>Alphabet’s third quarter, October 28.</strong> Search against 17% and Cloud against 82%. A Cloud slowdown with capex still rising is the case where the 2027 build doesn’t pay.</p>
<p><strong>Meta’s 2027 capex.</strong> Meta hasn’t guided yet. Each $10B above $235B with nothing extra to show costs about 0.6 points of return on the program.</p>
<p><strong>Price against volume at Meta.</strong> Price per ad growing faster than impressions is the ranking gains showing up. Both slowing together would mean the gains are fading.</p>
<p><strong>Legal costs.</strong> Meta’s settlement with 52 state attorneys general provides for payments of up to about $18.6B, and more youth-related trials are scheduled. None of this is in the model.</p>
<h2>What this is anchored on</h2>
<p>No-AI trends, AI’s share of above-trend revenue, margins, 2026–27 estimates beyond guidance, capex baselines, replacement, off-capex spending and the returns are our estimates, built from the sources below.</p>
<ul><li><strong>Meta Q3 2026</strong> — Revenue $64.60B, up 26% reported and in constant currency; ad impressions +10%, average price per ad +14%; daily users 3.64B, +3%; capex $34.91B; free cash flow −$2.12B; no buybacks in 2026; Q4 guidance $73–76B with about 1 point of currency headwind; 2026 capex $135–145B; a new non-voting Class C share, partly for raising capital · <a href="https://www.sec.gov/Archives/edgar/data/0001326801/000162828026066700/meta-09302026xexhibit991.htm">Meta Q3 2026 results (8-K), Oct 21</a></li><li><strong>Meta Q3 2026</strong> — AI investments already deliver substantial incremental ad revenue; MSL investments will take longer to return than the core business; buybacks of $26.2B in the first nine months of 2025 · <a href="https://www.sec.gov/Archives/edgar/data/0001326801/000162828026066700/meta-09302026xexhibit991.htm">Meta Q3 2026 results (8-K), Oct 21</a></li><li><strong>Meta legal</strong> — An agreement with 52 state attorneys general providing for payments of up to about $18.59B; youth-related trials scheduled in the coming months · <a href="https://www.sec.gov/Archives/edgar/data/0001326801/000162828026066700/meta-09302026xexhibit991.htm">Meta Q3 2026 results (8-K), Oct 21</a></li><li><strong>Meta Q2 2026</strong> — Revenue $60.80B, +28% (+27% in constant currency); impressions +14%, price per ad +12%; capex $31.08B · <a href="https://www.sec.gov/Archives/edgar/data/0001326801/000162828026050596/meta-06302026xexhibit991.htm">Meta Q2 2026 results (8-K), Jul 29</a></li><li><strong>Meta Q2 2026 call</strong> — Price per ad up on ad performance, better macro conditions and currency; ranking advances lifted Facebook ad clicks 8.3% and conversions 15.7% (no period given) · <a href="https://www.marketbeat.com/instant-alerts/meta-platforms-q2-earnings-call-highlights-2026-07-29/">MarketBeat, Jul 29</a></li><li><strong>Meta Q1 2026</strong> — Revenue $56.31B, +33% (+29% in constant currency); impressions +19%, price per ad +12%; ad revenue $55.02B; capex outlook raised to $125–145B · <a href="https://app.edgar.tools/filing/1326801/0001628280-26-028364/meta-03312026xexhibit991.htm">Meta Q1 2026 results (8-K), Apr 29</a></li><li><strong>Meta 2025</strong> — Q4 revenue $59.89B, +24% (+23% in constant currency); ad impressions +18%, price per ad +6% in Q4; 2025 revenue $200.97B; 2025 capex $72.22B · <a href="https://s21.q4cdn.com/399680738/files/doc_financials/2025/q4/Meta-12-31-2025-Exhibit-99-1-FINAL.pdf">Meta Q4 2025 results, Jan 28</a></li><li><strong>Meta 2025</strong> — Q3 revenue $51.24B, +26% (+25% in constant currency); impressions +14%, price per ad +10% · <a href="https://www.sec.gov/Archives/edgar/data/1326801/000162828025047114/meta-09302025xexhibit991.htm">Meta Q3 2025 results (8-K)</a></li><li><strong>Meta 2025</strong> — Q2 revenue $47.52B, +22% reported and in constant currency; impressions +11%, price per ad +9% · <a href="https://sec.gov/Archives/edgar/data/1326801/000162828025036719/meta-06302025xexhibit991.htm">Meta Q2 2025 results (8-K)</a></li><li><strong>Meta 2025</strong> — Q1 revenue $42.31B, +16% (+19% in constant currency); impressions +5%, price per ad +10% · <a href="https://www.sec.gov/Archives/edgar/data/1326801/000132680125000050/meta-03312025xexhibit991.htm">Meta Q1 2025 results (8-K)</a></li><li><strong>Meta 2027 capex</strong> — No 2027 guidance; the buy-side expected $225–250B · <a href="https://longportapp.cn/topics/43054018">Dolphin Research, Jul 29</a></li><li><strong>Meta off-capex</strong> — Most of 2026’s expense growth from infrastructure, including third-party cloud spend · <a href="https://datacenterdynamics.com/en/news/meta-estimates-2026-capex-to-be-between-115-135bn/">DCD, Jan 29</a></li><li><strong>Meta off-capex</strong> — Meta funds its 20% share of Hyperion’s remaining construction as an investment, not capex · <a href="https://www.datacenterdynamics.com/en/news/meta-plans-notably-larger-capex-spend-on-ai-data-centers-in-2026-compute-expectations-already-higher-than-last-quarter-prediction/">DCD, Oct 30, 2025</a></li><li><strong>Meta strategy</strong> — If superintelligence takes longer, the extra compute goes to the core business; at worst Meta slows new building for a while · <a href="https://thefinancialexpress.com.bd/trade/meta-forecasts-bigger-capital-costs-in-2026">Reuters, via The Financial Express</a></li><li><strong>Alphabet Q2 2026</strong> — Revenue $119.8B, +24% (+23% in constant currency); Search &amp; other $63.27B, +17%; YouTube ads $11.06B, +13%; Network $7.30B; Cloud $24.77B, +82%, operating income $8.81B; capex $44.9B; no buybacks in the first half; first-half proceeds of $56.2B of debt, $30.5B of common stock and $19.1B of mandatory convertible preferred · <a href="https://www.sec.gov/Archives/edgar/data/0001652044/000165204426000066/googexhibit991q22026.htm">Alphabet Q2 2026 results (8-K), Jul 22</a></li><li><strong>Alphabet Q2 2026</strong> — Cloud backlog $514B · <a href="https://www.cnhinews.com/news/article_e3220c1b-dca0-5369-ae1d-54f65c6ea076.html">Zacks, via CNHI</a></li><li><strong>Alphabet capex</strong> — 2026 capex guidance raised to $195–205B; Q2 capex $44.9B, about 60% of technical infrastructure in servers · <a href="https://w.media/ai-infrastructure-demand-pushes-alphabets-2026-capex-guidance-to-us-205-billion/">W.Media, Jul 23</a></li><li><strong>Alphabet capex</strong> — Another meaningful step-up in capex in 2027 · <a href="https://www.nasdaq.com/articles/alphabet-heavy-etfs-consider-capex-woes-offset-cloud-strength">Zacks, via Nasdaq</a></li><li><strong>Alphabet capex</strong> — Analysts’ 2027 capex projections above $300B · <a href="https://pepperstone.com/en-ae/insights/market-analysis/equities/alphabet-q2-earnings-preview-cloud-and-capex-take-center-stage">Pepperstone, Jul 21</a></li><li><strong>Alphabet compute</strong> — About half, or just over half, of 2026’s ML compute goes to Cloud · <a href="https://abc.xyz/investor/events/event-details/2026/Anat-Ashkenazi-SVP-and-CFO-of-Alphabet-and-Google-at-the-Morgan-Stanley-Technology-Media-and-Telecom-Conference-on-March-3-2026-2026-r9dUUoVl6o/default.aspx">Alphabet CFO, Morgan Stanley TMT conference, Mar 3</a></li><li><strong>Alphabet Q1 2026</strong> — Revenue $109.9B, +22% (+19% in constant currency); Search $60.40B, +19%; YouTube ads $9.88B, +11%; Network $6.97B; Cloud $20.03B, +63% · <a href="https://www.sec.gov/Archives/edgar/data/0001652044/000165204426000043/googexhibit991q12026.htm">Alphabet Q1 2026 results (8-K), Apr 29</a></li><li><strong>Alphabet 2025</strong> — Q4: Search $63.07B, +17%; YouTube ads $11.38B, +9%; Cloud $17.66B, +48%. Full year: revenue $402.8B; capex $91.4B · <a href="https://www.sec.gov/Archives/edgar/data/1652044/000165204426000012/googexhibit991q42025.htm">Alphabet Q4 2025 results (8-K), Feb 4</a></li><li><strong>Alphabet Q3</strong> — Reports October 28; consensus revenue $124.6B · <a href="https://finviz.com/news/405729/2-magnificent-7-stocks-in-focus-ahead-of-earnings">Finviz, Oct 21</a></li><li><strong>Alphabet Cloud</strong> — Alphabet plans to rent more third-party capacity in Q3 as a bridge while it builds its own, and says the cost will weigh on Cloud’s operating margin · <a href="https://elnuevodiario.com.do/tecnologica-alphabet-eleva-su-prevision-de-gastos-de-capital-en-ia-hasta-205-000-millones/">EFE, via El Nuevo Diario, Jul 22</a></li><li><strong>Ad market</strong> — Global ad revenue +8.9% in 2026 excluding US political advertising, US +11.9%; social media growth slowing from 2027 as engagement plateaus and AI chatbots compete · <a href="https://www.exchange4media.com/advertising-news/global-ad-revenue-to-grow-89-by-end-of-2026-wpp-media-155474.html">WPP Media, via exchange4media, Jun 16</a></li><li><strong>History</strong> — Annual revenue by segment, capex and quarterly revenue, 2017–2025 · <a href="https://investor.atmeta.com/">Meta and Alphabet annual reports (10-K) and earnings releases</a></li><li><strong>History</strong> — Alphabet segment revenue and capex, 2017–2025 · <a href="https://abc.xyz/investor/">Alphabet investor relations</a></li></ul>
<h2>Method</h2>
<p><strong>Clock.</strong> Reported through Meta’s third quarter of 2026 and Alphabet’s second. Meta’s 2026 is nine months reported plus the midpoint of its fourth-quarter guidance, $74.5B, of which about $72.3B ads. Alphabet’s second half is our estimate: Search up 15% and 14%, YouTube ads 12% and 11%, Network down 2%, Cloud $27.0B and $30.5B. 2027: Meta ads +18%, Google ads +11%, Cloud +55% and +30% in 2028 as the backlog converts, both only when 2027’s capex is charged; otherwise Cloud stays at its end-2026 run-rate, $122B. Capex earns from the year after it’s spent.</p>
<p><strong>AI’s share.</strong> Each business against a trend from 2023: Meta’s ads 11% a year, Google’s ads (Search, YouTube, Network) 7.5%, Cloud 22%, held through 2027 and fading to 4% (Cloud 6%) by 2035. AI is credited with 80%, 75% and 90% of the gap. AI points of growth are the growth in AI’s revenue over the year before’s revenue. After 2027 the ad gains are held as a share of the business and fade 1.5% a year; Cloud’s are held in dollars from its last estimated year (2028 with 2027’s build, 2027 without) and fade 2.5% a year. Holding Meta’s gain flat in dollars instead would cut the return through 2026 to 29%.</p>
<p><strong>Returns.</strong> Cash flows from 2022 to 2040, no terminal value. In: AI’s share of above-trend revenue times a cash margin before depreciation (Meta ads 75%, Google ads 70% after traffic acquisition and YouTube content costs, a judgment, Cloud 50%). Out: capex above a pre-buildout intensity (17% of Meta’s no-AI ad revenue; 11% of Alphabet’s no-AI revenue), counted through 2026 or 2027 (2028 in one Meta case); servers, 60% of capex, replaced every 6 years at 75% of their cost for the share of the fleet the gains need (half of Meta’s, half of Alphabet’s outside Cloud, all of Cloud’s); cash tax at 15% (Alphabet 16%) with servers expensed at once and data centers over 20 years, losses offsetting other income. Alphabet’s incremental capex is split half to Cloud. All-in Meta cases add $15B a year of AI spending outside capex in 2026–31 and $7B after, plus running costs for the moonshot share of the fleet at 3% of its capex a year while its servers last. The base case is the middle of every range in the simulation.</p>
<p><strong>What’s left out.</strong> Any revenue from the moonshots: Meta AI and business agents, Meta selling compute, frontier models beyond what Cloud sells, Gemini subscriptions, Waymo. The value of what AI defended rather than added, likely large for Search. Running costs of Alphabet’s non-Cloud moonshot compute, spending on AI researchers beyond Meta’s all-in cases, legal costs, and currency beyond what reported growth shows. The returns are on the AI program alone, not the companies. Monte Carlo: 8,000 draws per case with a fixed seed; the ranges are in the chart’s note. Model and data: scripts/packs/ai_payback.py in the site’s repository.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Will AI compute run short or long through 2030?</title>
  <link>https://06.ai/packs/ai-compute-balance</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-compute-balance</guid>
  <pubDate>Tue, 20 Oct 2026 12:10:00 GMT</pubDate>
  <description>The compute-demand pack sized the compute AI demand needs to the end of 2027. Here we add the supply side, the chips, power and money to switch on new capacity, carry demand to 2030 and compare the two at the end of each year.</description>
  <category>AI compute</category>
  <enclosure url="https://06.ai/newsletter/ai-compute-balance/cover.png" length="68817" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-compute-balance/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-compute-balance"><img src="https://06.ai/newsletter/ai-compute-balance/thumb.png" alt="Will AI compute run short or long through 2030?" width="421" height="433"></a><figcaption><a href="https://06.ai/packs/ai-compute-balance">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>The <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack sized the compute AI demand needs to the end of 2027. Here we add the supply side, carry demand to 2030 and compare the two at the end of each year. In our base case the shortage all but closes during 2027, when about <strong>38 GW</strong> of new capacity comes online, if power keeps pace with capex. From 2028 demand pulls ahead again: what customers and labs plan to spend on compute grows faster than the power and money for new capacity, and the market ends 2030 <strong>21% short</strong>. Power and money, not chips, limit what is switched on from 2027; training budgets and capex decide whether, and how far, the market runs short.</p>
<ul><li><strong>+38 GW</strong> — Switched on in 2027 of AI data-center capacity, all-in, limited by power and money. The chips the industry could deliver would fill about 47 GW</li><li><strong>−1%</strong> — End of 2027 supply about level with demand, from 19% short at the end of 2026, if power keeps pace with capex (15% short at our power research’s high case)</li><li><strong>−21%</strong> — End of 2030 short again. Demand grows 1.9–2.4× a year in 2028–30, supply 1.8–2.2×, in compute terms</li><li><strong>−69% to +43%</strong> — Biggest swing, 2030 if training and research grow at our high or low path instead of the base</li></ul>
<h2>Short in 2026, about even at the end of 2027, short again by the end of 2028</h2>
<p>Base demand, base supply, demand 20% above supply today: 1% short at the end of 2027 and 21% short at the end of 2030.</p>
<figure><a href="https://06.ai/packs/ai-compute-balance#balance"><img src="https://06.ai/newsletter/ai-compute-balance/fig-01.png" alt="Short in 2026, about even at the end of 2027, short again by the end of 2028" width="694" height="702"></a><figcaption>Compute installed at the end of each year against compute demanded, as a share of demand. Both are counted in gigawatts of today’s hardware, so a gigawatt installed later counts for more: it does more work. The first bar covers October to December 2026. Choose the demand and supply cases and how far demand runs above supply today: 20% above means supply meets 83% of demand, 17% short.</figcaption></figure>
<p>Needed: gigawatts of that year’s hardware it would take, on top of everything installed before, for supply to meet demand at year-end. A surplus or shortfall carries into the next year.</p>
<h2>What the base case says</h2>
<p><strong>Short through 2026.</strong> Today’s market is short. One-year H100 rental contracts rose about 40% between October and March and the B200 rental index is up about 28% this year. Every large cloud says demand exceeds what it can supply, and NVIDIA says its supply supports about 70% revenue growth in its year to January 2028, against demand growth nearer 100%. We assume demand at today’s prices runs 20% above what is being served. The fourth quarter adds about 7 GW, mostly Blackwell racks and new TPUs, while inference demand grows about 56% in the quarter, so the year ends 19% short.</p>
<p><strong>2027 brings supply about level with demand.</strong> About 38 GW comes online, 60% more than the 24 GW switched on in 2026. Most of it is Vera Rubin racks and Google’s eighth-generation TPUs, plus Blackwell racks delivered late in 2026. Each gigawatt does about 4.6× the inference work of today’s average and 2.2× the training work. Supply grows about 3.1× during the year in compute terms and demand about 2.6×, so by December supply is about level with demand (−1%): 37.9 GW switched on against 38.3 GW needed. Month by month, with last year’s late deliveries switched on first, the market comes within 3 points of balance in September 2027 and stays there until August 2028. That fits Goldman’s view that supply and demand rebalance in the second half of 2027 at the earliest and more likely in the first half of 2028; Amazon expects to be short through 2027. It needs about 38 GW of power in 2027, above the top of our power research’s range: its high case is 30 GW in 2027 and 40 GW in 2028. At that high case, 2027 ends 15% short.</p>
<p><strong>Then demand pulls ahead.</strong> In compute terms supply grows 2.2×, 1.9× and 1.8× in 2028–30, and demand 2.4×, 2.1× and 1.9×. Capacity switched on rises only from 43 GW to 51 GW a year, because AI capex grows 11–18% a year on street estimates. Meanwhile what customers spend on inference grows 35–70% a year in our base case, and training budgets keep growing. The market ends 2028 9% short and 2030 21% short. By 2030, 86 GW of new capacity would be needed against 51 GW switched on, because each year’s shortfall carries into the next. Either capex keeps rising faster than analysts expect, or prices rise until demand fits. The demand and supply cases move this a long way; see the controls above and “What tips the balance” below.</p>
<h2>From 2027 the chips could outrun power and money</h2>
<figure><a href="https://06.ai/packs/ai-compute-balance#ceilings"><img src="https://06.ai/newsletter/ai-compute-balance/fig-02.png" alt="From 2027 the chips could outrun power and money" width="694" height="352"></a><figcaption>New AI data-center capacity each year that chips, power and money could each support, GW all-in. Chips: what the chipmakers could deliver from the fourth quarter of the year before through the third quarter, at twice their rated power, Epoch AI’s rule for a data center’s total draw. Power: capacity that can be switched on. Money: AI capex divided by the all-in cost of a gigawatt, chips included. The lowest bar is what comes online. Our estimates from the sources below.</figcaption></figure>
<h2>Supply: chips, power and money</h2>
<p><strong>The chips keep coming.</strong> Epoch AI counts 11.3M H100-equivalents delivered in the first half of 2026. We estimate 33M for the year, above the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack’s 24–27M, which extended the first half’s pace: NVIDIA’s guidance implies a much larger second half, with Vera Rubin, rated at 8.8 H100-equivalents a chip, shipping from the fourth quarter. In 2027 the chipmakers could deliver about 100M as Rubin ramps, Google ships its eighth-generation TPUs and AMD its MI455X racks; NVIDIA would be about 56% of that and Google 27%. NVIDIA says supply limits its revenue at least through January 2028, Broadcom expects its AI revenue to double to about $115B in fiscal 2027 and again in 2028, and TSMC says AI demand still exceeds what it can make. Rated at about 26 GW, 2027’s chips need about 52 GW to run; allowing a quarter to install them, about 47 GW could be switched on during 2027. After 2027 we let accelerator spending rise from about $1T to $1.25T a year and each generation’s gains do the rest: 170M H100-equivalents in 2028 and 350M in 2030.</p>
<p><strong>Power doesn’t keep up.</strong> About 24 GW came online for AI in 2026, by our estimate from chip deliveries; we assume power for about 27 GW was ready. For 2027 Morgan Stanley expects hyperscalers and neoclouds, 60–95% of new capacity, to add 32 GW. Goldman counts 2.7 times as much US capacity scheduled for 2027 as for 2026 but expects only half to 60% of it on time. Neither says whether it counts IT power or the whole facility. Trackers found most US projects due in 2027 not yet under construction in April, new gas turbines are being booked for delivery as late as 2031 and large transformers take more than three years. We expect about 38 GW of all-in capacity to come online in 2027, rising to 58 GW by 2030. That is within the range those forecasts imply once they are put on an all-in, worldwide basis, and above the top of our own power research’s range through 2029. Its central estimate, which applies project trackers’ delay rates, is about 23 GW in 2027 rising to 35 GW in 2030, with a high case rising from 30 GW in 2027 to 60 GW in 2030. It starts from a lower 2026, about 16 GW, partly because it takes Epoch’s end-2025 installed base at 2.5× chip power where we use 2×. Our path leaves chips for about 9 GW more than can be switched on in 2027; a consensus estimate cited by Elon Musk in August put that at about 15 GW.</p>
<p><strong>Money binds first.</strong> AI capex is about $1T in 2026 (Goldman’s estimate). On street estimates for the hyperscalers, Oracle, SpaceX and the neoclouds, plus China and other buyers, it reaches about $1.4T in 2027 and $2.05T by 2030, growing 11–18% a year after 2027. All-in, a gigawatt of IT power costs about $45B to build today (Epoch puts a GB200 site at $38B, NVIDIA says $50–60B), rising to about $52B by 2030 as chips carry more value per watt. That pays for about 38 GW in 2027 and 51 GW in 2030, at or below our power path, so money is the limit in the base case from 2027. Both sit well below what the chipmakers could ship. The money includes the chips, so when it binds, fewer chips get bought than could be made, or chips wait for power. If these estimates are right, from 2027 new AI capacity is limited less by the fabs than by power and the money to build.</p>
<h2>A gigawatt switched on in 2030 could do 19× the inference work of today’s average</h2>
<figure><a href="https://06.ai/packs/ai-compute-balance#per-gw"><img src="https://06.ai/newsletter/ai-compute-balance/fig-03.png" alt="A gigawatt switched on in 2030 could do 19× the inference work of today’s average" width="694" height="332"></a><figcaption>Work per GW of the capacity switched on each year, as a multiple of the fleet operating today. Inference: tokens per MW on SemiAnalysis’s AgentX benchmark (DeepSeek V4 Pro, 100 tokens/s per user) for each year’s mix of hardware, our estimate from measured results and roadmaps. Training: peak 8-bit FLOP/s per GW, from the chips’ rated power per H100-equivalent. Capacity switched on in a year mixes the previous year’s fourth-quarter deliveries with its own first three quarters; 2026 is the fourth quarter’s.</figcaption></figure>
<h2>Why gigawatt totals mislead</h2>
<p>Today’s fleet is still about a fifth Hopper. On agentic inference a GB300 rack does about 12.6× an H200’s work per MW, and Vera Rubin about 2.1× a GB300’s (SemiAnalysis, measured on pre-release software). So the capacity switched on in 2027 does about 4.6× today’s average per gigawatt at inference, and 2030’s about 19× if Rubin Ultra and Feynman deliver what their roadmaps suggest. Training gains ride on FLOPs per watt, which improve about 30% a year: 2.2× today’s average for 2027’s capacity and 5.0× for 2030’s. These are peak 8-bit FLOPs, the way Epoch counts them. The training throughput our efficiency research expects newer chips to achieve is lower for capacity switched on through 2029; counted that way, 2027 would end 11% short and 2030 25% short. That research labels its tables by install year. We read them as each year’s deliveries, because its 2026 mix includes Rubin, which only ships from the fourth quarter; read as install years, 2027 would end 3% long and 2030 17% short.</p>
<p>Cheaper inference also raises demand. Capacity switched on in 2028 does about 58% more inference work per dollar than 2027’s, and about 60% and 52% more again in 2029 and 2030. If prices follow costs, each dollar customers spend buys that much more, so after 2027 inference demand rises with hardware gains just as supply does. Faster hardware therefore moves the balance mainly through training, which we count in FLOPs, and through the years to 2027, when demand follows usage.</p>
<p>Who gets the new hardware matters too. We split each year’s hardware between inference and training in the same proportion. Newer hardware’s edge is larger at inference (4.6× today’s average in 2027, against 2.2× at training). If it went to inference first and older chips did the training, the market would serve about 6–7 points more of demand each year. If the newest went to training first, as frontier labs train on their newest clusters, it would serve about 8–12 points less.</p>
<h2>After 2027 demand grows faster than supply</h2>
<figure><a href="https://06.ai/packs/ai-compute-balance#growth"><img src="https://06.ai/newsletter/ai-compute-balance/fig-04.png" alt="After 2027 demand grows faster than supply" width="694" height="322"></a><figcaption>Growth during each year in the base case, in compute terms. Supply: the compute installed, measured at that year’s mix of inference and training demand. Demand: inference plus training and research.</figcaption></figure>
<h2>Demand to 2030</h2>
<p><strong>Inference to 2027</strong> is the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack’s: OpenRouter’s compute on the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s three paths. To scale it to the whole market we compared OpenRouter’s growth with six disclosed token counts over the same windows. The market grew at 0.32–0.86 of OpenRouter’s pace, measured in doublings, with a median of 0.63; we use 0.6. We apply it to OpenRouter’s compute rather than its tokens, because OpenRouter’s mix is probably moving to small, cheap models faster than the market’s; applied to tokens, demand at the end of 2027 would be about 28% lower. That puts the market’s inference demand at 4.3× today’s by the end of 2027, about 2.8× during 2027 alone. The <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack’s headline, about 47 GW of new GB300 racks by December 2027, assumed the whole market grew at OpenRouter’s full pace. At 0.6 of it, measured as the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack does from October’s average to December’s, inference needs about 15 GW of GB300s, or about 10 GW of the capacity switched on in 2027, before counting today’s shortage.</p>
<p><strong>After 2027, spending decides.</strong> The <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s paths have OpenRouter’s growth halving every three, six or twelve months. Carried past 2027, the base path has OpenRouter’s compute growing 65% in 2028, 14% in 2029 and 3% in 2030, which describes one marketplace maturing rather than the market. Instead we let inference demand follow what customers spend on it: 1.7× in 2028, 1.5× in 2029 and 1.35× in 2030 in the base case. That is slower than the leading labs plan to grow. OpenAI’s plan takes revenue from $36B in 2026 to $350B in 2030, about 1.8× a year, and Anthropic’s internal forecast of $190–200B in 2028 implies about 1.9× a year from an estimated $55B in 2026. Each dollar buys as much more inference as the capacity switched on that year delivers per dollar, 1.5–1.6× more each year. So inference demand grows about 2.7× in 2028, 2.4× in 2029 and 2.1× in 2030, reaching 57× today’s level by 2030.</p>
<p><strong>Training and research</strong> use about 60% of today’s chips, and the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack didn’t project them. We let them grow 2.4× in 2027, slowing to 1.6× in 2030, measured in 8-bit FLOPs: 19× today’s by 2030. The anchors: OpenAI’s compute roughly quadrupled in each of 2024 and 2025 (Epoch AI); it ended 2025 with 1.9 GW and targets 30 GW by 2030. Anthropic, at about 2 GW early in 2026, has placed about 5 GW of demand with Broadcom for 2027 and 10 GW for 2028 and could pass 30 GW by 2030 (22V Research). The power behind frontier training runs grows 2.2–2.9× a year (Epoch AI). We assume market-wide training grows more slowly than these labs’ plans: they use less than half of the world’s AI compute.</p>
<h2>The market grows at about 0.6 of OpenRouter’s pace</h2>
<figure><a href="https://06.ai/packs/ai-compute-balance#pace"><img src="https://06.ai/newsletter/ai-compute-balance/fig-05.png" alt="The market grows at about 0.6 of OpenRouter’s pace" width="694" height="266"></a><figcaption>Growth of each disclosed token count, in doublings, divided by OpenRouter’s over the same window (its average for the 30 days before each date). 1 would be OpenRouter’s pace. Disclosures use different definitions, so they compare within a series, not with each other. Two rows are Google’s all-products total over overlapping windows; dropping either moves the median to 0.57 or 0.69.</figcaption></figure>
<h2>What tips the balance</h2>
<figure><a href="https://06.ai/packs/ai-compute-balance#tips"><img src="https://06.ai/newsletter/ai-compute-balance/fig-06.png" alt="What tips the balance" width="694" height="380"></a><figcaption>Supply against demand at the end of the year with one input at its low or high setting and everything else at the base case (demand 20% above supply today). The dot is the base case. Shown: 2030.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-compute-balance#tips"><img src="https://06.ai/newsletter/ai-compute-balance/fig-07.png" alt="What tips the balance — 2027" width="694" height="411"></a><figcaption><strong>2027.</strong></figcaption></figure>
<h2>What would change the numbers</h2>
<p><strong>Training and research budgets.</strong> The biggest lever. If they grow only 4.5× by 2030, supply ends 2030 43% ahead of demand, a glut. If they grow 66×, the market is 69% short. Much of this is spent by a few labs that are still raising the money.</p>
<p><strong>Power and money.</strong> If capacity added stays near 30 GW a year, 2030 is 43% short. At our power research’s central estimate it is 47% short, and at its high case 24% short. If power follows SemiAnalysis’s path, about 90 GW a year by 2029, with capex to match, supply runs 25% ahead by 2030. Chips aren’t what holds supply back in our base case: if power and money kept up with every chip the industry could deliver, supply would run 17% ahead by 2030.</p>
<p><strong>Inference spending.</strong> If what customers spend on inference grows only 1.2×, 1.1× and 1.0× in 2028–30, the market stays near balance (+5% in 2030). If it grows 2.35×, 2.0× and 1.7×, faster than even OpenAI’s plan, 2030 is 49% short.</p>
<p><strong>Hardware.</strong> If Rubin Ultra slips (SemiAnalysis reported in July that its 144-GPU rack moves to 2028), Feynman disappoints and the 2026–27 mix underdelivers too, 2030 is 43% short. If they beat their roadmaps, it is 11% long. Because cheaper inference also raises demand, hardware moves the balance mostly through training and the years to 2027. Software gains on existing chips help a little: the efficiency research’s central case, software gains of 30% a year against workloads 20% heavier, would leave 2030 18% short instead of 21%.</p>
<p><strong>Who gets the new hardware.</strong> If the newest hardware went to inference first, where its edge is largest, 2030 would be 14% short; if it went to training first, 30% short.</p>
<p><strong>Today’s shortage.</strong> With no shortage today, supply leads by 19% at the end of 2027 and 2030 ends 6% short. If demand runs 30% above supply today, 2027 ends 8% short.</p>
<p><strong>Inference to 2027.</strong> The pace against OpenRouter and inference’s share of today’s chips move 2027 between 12 points up and 13 points down. Letting OpenRouter’s growth fade, as the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s base path does if carried to 2030, would leave 22% more compute than demand by 2030.</p>
<h2>What to watch</h2>
<p><strong>Gigawatts switched on in 2027.</strong> Our base case has about 38 GW. Hyperscalers report capacity added each quarter, and turbine and transformer deliveries lead them. At our power research’s high case, 30 GW, the market ends 2027 15% short.</p>
<p><strong>Capex plans for 2028–30.</strong> Street estimates have AI capex growing about 18% in 2028 and 11% by 2030. If lab revenue grows as planned, that is too little; capex rising faster than that is how the gap would close.</p>
<p><strong>Lab revenue against plan.</strong> OpenAI’s and Anthropic’s revenue, funding rounds and IPOs decide both what customers spend on inference and what labs spend on training, the two largest demand inputs after 2027.</p>
<p><strong>Rubin in the field.</strong> SemiAnalysis measured Rubin at about 2× GB300 per MW on pre-release software. Production results, and when Rubin Ultra ships, set how much each 2027–28 gigawatt is worth.</p>
<p><strong>Rents.</strong> In September the B200 rental curve priced the 12-month forward about 12% below spot: the market expects some easing within a year, consistent with supply catching up during 2027.</p>
<h2>What this is anchored on</h2>
<p>Supply, power, capex and demand paths, efficiency by year, the shortage today and the balance are our estimates, built from the sources below. OpenRouter data is licensed under CC BY 4.0.</p>
<ul><li><strong>Today’s fleet and demand</strong> — AI chips operating, their power, the inference share, AgentX throughput by system and OpenRouter’s compute paths to December 2027 · <a href="https://06.ai/packs/ai-compute-demand">06.ai </a><a href="https://06.ai/packs/ai-compute-demand">compute-demand</a><a href="https://06.ai/packs/ai-compute-demand"> pack</a></li><li><strong>OpenRouter paths</strong> — Tokens and spend to December 2027, with growth halving every 3, 6 or 12 months · <a href="https://06.ai/packs/ai-demand">06.ai </a><a href="https://06.ai/packs/ai-demand">AI-demand</a><a href="https://06.ai/packs/ai-demand"> pack</a></li><li><strong>OpenRouter tokens</strong> — Daily tokens by model, January 2025 to October 2026, for the pace comparison · <a href="https://openrouter.ai/rankings">OpenRouter rankings dataset (CC BY 4.0)</a></li><li><strong>Chips delivered</strong> — 20.3M H100-equivalents delivered by end-2025; 4.98M and 6.33M in the first two quarters of 2026, rated at 2.7 and 3.2 GW · <a href="https://epoch.ai/data/ai-chip-sales">Epoch AI chip-sales data (via </a><a href="https://epoch.ai/data/ai-chip-sales">the </a><a href="https://epoch.ai/data/ai-chip-sales">compute-demand</a><a href="https://epoch.ai/data/ai-chip-sales"> pack</a><a href="https://epoch.ai/data/ai-chip-sales">)</a></li><li><strong>Chips by designer</strong> — Q2 2026 share of compute sold: NVIDIA 63%, Google 25%, Amazon 5%, AMD 4%, Huawei 3% · <a href="https://epoch.ai/graphs/ai-chip-market-share-by-designer">Epoch AI, updated Oct 19</a></li><li><strong>Chip ratings</strong> — Vera Rubin 8.84 H100-equivalents per chip; TPU v8i 5.1; B300 2.53 · <a href="https://epoch.ai/data/ai_chip_sales_chip_types.csv">Epoch AI chip-types data, Oct 14</a></li><li><strong>Facility power</strong> — A data center draws about twice its AI chips’ rated power · <a href="https://epoch.ai/data/ai-chip-sales?tab=power">Epoch AI chip-sales data</a></li><li><strong>NVIDIA</strong> — A supply-constrained outlook of about 70% revenue growth in the year to January 2028; supply the bottleneck at least through then · <a href="https://www.cfodive.com/news/nvidia-cfo-predicts-70-percent-revenue-jump-fiscal-2028-ai/828989/">CFO Dive, Aug 27</a></li><li><strong>NVIDIA</strong> — At least $1T of Blackwell and Rubin demand and orders through 2027 · <a href="https://www.datacenterdynamics.com/en/news/nvidia-ceo-jensen-huang-says-company-has-one-trillion-dollars-in-orders-through-2027">DCD, GTC, Mar 16</a></li><li><strong>NVIDIA</strong> — A GW costs about $50–60B; NVIDIA’s content per GW about $18B for Hopper, $25B for Blackwell, $40B for Vera Rubin; supply supports about 70% revenue growth in fiscal 2028, against demand growth nearer 100%; top-5 hyperscaler capex near $800B in 2026 and $1.3T in 2027 · <a href="https://www.webull.com/news/15497781742806016">NVIDIA Q2 FY27 call, Aug 26</a></li><li><strong>Broadcom</strong> — AI revenue outlook about $115B in fiscal 2027 and $230B in fiscal 2028 · <a href="https://www.thestar.com.my/business/business-news/2026/09/04/broadcom-forecasts-explosive-ai-chip-growth">Bloomberg, via The Star, Sep 4</a></li><li><strong>TSMC</strong> — AI demand still exceeds what TSMC can supply · <a href="https://letsdatascience.com/news/tsmc-says-ai-demand-still-exceeds-its-supply-capability-as-q-2fed75bf">TSMC Q3 call, via AP, Oct 15</a></li><li><strong>Packaging</strong> — TSMC CoWoS capacity about 130K wafers a month at end-2026, doubling by 2028 · <a href="https://www.trendforce.com/news/2026/09/14/news-tsmc-reportedly-targets-22-2nm-16-3nm-capacity-boost-by-mid-2027-cowos-to-double-by-2028/">TrendForce, Sep 14</a></li><li><strong>Memory</strong> — HBM bit shipments up 50–60% in 2027, still short of demand · <a href="https://trendforce.com/presscenter/news/20260804-13166.html">TrendForce, Aug 4</a></li><li><strong>Google TPUs</strong> — TPU shipments estimated at 4.5M in 2026 and 8.8M in 2027 · <a href="https://247wallst.com/investing/2026/08/25/google-tpu-volume-could-triple-to-8-8-million-by-2027/">GF Securities, via 24/7 Wall St, Aug 25</a></li><li><strong>AMD</strong> — Helios racks shipping from late Q3 2026; 6 GW for OpenAI, 6 GW for Meta and up to 2 GW for Anthropic · <a href="https://convergedigest.com/?p=113861">Converge Digest, Jul 24</a></li><li><strong>Power</strong> — Hyperscalers and neoclouds add 32 GW in 2027 and 39 GW in 2028, 60–95% of new capacity worldwide · <a href="https://www.webull.com/news/15695876726391808">Morgan Stanley, via Zhitong, Oct 5</a></li><li><strong>Power</strong> — US data-center capacity scheduled for 2026 13.6 GW and 2027 36.3 GW; only 50–60% assumed on time · <a href="https://oilprice.com/Energy/Energy-General/The-Gas-Turbine-Shortage-Just-Became-AIs-Biggest-Constraint.amp.html">Goldman Sachs, via OilPrice, Aug 22</a></li><li><strong>Power</strong> — About 30 GW of AI compute added in 2026, 50 GW in 2027, 70 GW in 2028 and 90–100 GW in 2029 · <a href="https://www.theneuron.ai/news/ais-11t-bet-the-bull-and-bear-case-for-the-compute-boom/">Dylan Patel (SemiAnalysis), via The Neuron, Aug 31</a></li><li><strong>Power</strong> — A consensus estimate that about 15 GW of AI compute made in 2027 can’t be switched on in 2027 · <a href="https://247wallst.com/cards/xpost-01m17pydcft8z890gj36hmt3t9">Elon Musk, via 24/7 Wall St, Aug 29</a></li><li><strong>Power</strong> — At least 16 GW of large projects slated for 2026 worldwide, about 5 GW under construction in February; 30–50% unlikely to finish on time · <a href="https://www.latitudemedia.com/news/up-to-half-of-the-worlds-data-centers-may-be-delayed-this-year/">Sightline Climate, via Latitude Media, Feb 24</a></li><li><strong>Power</strong> — More than 60% of US projects due in 2027 not under construction in April · <a href="https://longbridge.com/news/283103823">SynMax, via the FT (Longbridge), Apr 17</a></li><li><strong>Equipment</strong> — A heavy-duty GE Vernova gas turbine ordered now arrives in 2031; Mitsubishi Heavy’s new orders deliver in 2028–30 · <a href="https://oilprice.com/Energy/Energy-General/The-Gas-Turbine-Shortage-Just-Became-AIs-Biggest-Constraint.amp.html">OilPrice, Aug 22</a></li><li><strong>Equipment</strong> — Generator step-up transformers take more than 160 weeks; one utility is buying about five years ahead · <a href="https://www.kitco.com/news/off-the-wire/2026-07-09/us-power-companies-scramble-secure-equipment-surging-data-center">Wood Mackenzie, via Reuters, Jul 9</a></li><li><strong>Capex</strong> — Global AI investment about $1T in 2026 · <a href="https://www.goldmansachs.com/insights/articles/global-investment-is-forecast-to-exceed-1-trillion-in-2026">Goldman Sachs, Aug 7</a></li><li><strong>Capex</strong> — Alphabet, Microsoft, Amazon, Meta, Oracle and SpaceX: about $800B in 2026, $1.2T in 2027 and $1.4T in 2028 · <a href="https://cryptobriefing.com/goldman-sachs-hyperscaler-capex-ai-revenue/">Goldman Sachs, via Crypto Briefing, Sep 25</a></li><li><strong>Capex</strong> — Hyperscaler, Oracle, SpaceX and neocloud capex to 2030 · <a href="https://06.ai/packs/ai-funding-scale">06.ai </a><a href="https://06.ai/packs/ai-funding-scale">hyperscaler</a><a href="https://06.ai/packs/ai-funding-scale">, </a><a href="https://06.ai/packs/ai-funding-scale">neocloud</a><a href="https://06.ai/packs/ai-funding-scale"> and </a><a href="https://06.ai/packs/ai-funding-scale">leveraged-middle</a><a href="https://06.ai/packs/ai-funding-scale"> packs</a></li><li><strong>Cost per GW</strong> — $38B per GW of IT power for a GB200 NVL72 site · <a href="https://epoch.ai/data-insights/ai-datacenter-cost-breakdown">Epoch AI, May 14</a></li><li><strong>Cost per GW</strong> — $34.6–39.5B per GW by architecture, from OpenAI’s custom chip to Vera Rubin · <a href="https://phemex.com/news/article/bernstein-estimates-ai-data-center-costs-at-346b395b-per-gigawatt-99408">Bernstein, via Phemex, Oct 10</a></li><li><strong>Inference per MW</strong> — Vera Rubin NVL72 59.4M tokens/s per MW on AgentX at 100 tokens/s per user, 2.09× GB300 NVL72 (pre-release software) · <a href="https://inferencex.semianalysis.com/blog/vera-rubin-nvl72-agentic-inference">SemiAnalysis InferenceX, Sep 14</a></li><li><strong>Inference per MW</strong> — Vera Rubin about 2× GB300 per MW up to 100 tokens/s per user on DeepSeek-R1 · <a href="https://newsletter.semianalysis.com/p/vera-rubin-nvl72-vs-gb200-nvl72-inference">SemiAnalysis, Jul 23</a></li><li><strong>Rubin</strong> — 35 PF dense NVFP4 and 17.5 PF dense FP8 per GPU · <a href="https://www.nvidia.com/en-us/data-center/vera-rubin-nvl72/">NVIDIA Vera Rubin NVL72 page</a></li><li><strong>Rubin Ultra</strong> — Kyber NVL144 rack reported slipping more than a year, to 2028 · <a href="https://mlq.ai/news/nvidias-kyber-nvl144-rack-system-delayed-over-12-months-to-2028-on-pcb-manufacturing-snags/">SemiAnalysis, via MLQ, Jul 6</a></li><li><strong>Hardware trends</strong> — Chip performance per dollar up about 49% a year since 2023 · <a href="https://epoch.ai/data-insights/chip-performance-per-dollar">Epoch AI, Aug 13</a></li><li><strong>Hardware trends</strong> — Peak FLOP/s per watt of ML GPUs up about 1.28× a year · <a href="https://epoch.ai/publications/can-ai-scaling-continue-through-2030">Epoch AI, Aug 2024</a></li><li><strong>Tokens</strong> — Google: 480T tokens a month in May 2025, more than 3.2 quadrillion in May 2026 · <a href="https://blog.google/innovation-and-ai/sundar-pichai-io-2026/">Google I/O, May 19</a></li><li><strong>Tokens</strong> — Google: about 1.3 quadrillion tokens a month in October 2025 · <a href="https://robonomics.substack.com/p/token-tracker-and-implications">Google, via Robonomics</a></li><li><strong>Tokens</strong> — Google’s models: 7B tokens a minute via direct API use in October 2025 · <a href="https://s206.q4cdn.com/479360582/files/doc_events/2025/Oct/29/2025_Q3_Earnings_Transcript.pdf">Alphabet Q3 2025 call, Oct 29, 2025</a></li><li><strong>Tokens</strong> — Google’s model APIs: about 22B tokens a minute in July 2026 · <a href="https://www.marketbeat.com/instant-alerts/alphabet-q2-earnings-call-highlights-2026-07-22/">Alphabet Q2 call, via MarketBeat, Jul 22</a></li><li><strong>Tokens</strong> — OpenAI’s API: 6B tokens a minute in October 2025 · <a href="https://techcrunch.com/2025/10/06/sam-altman-says-chatgpt-has-hit-800m-weekly-active-users">TechCrunch, Oct 6, 2025</a></li><li><strong>Tokens</strong> — OpenAI’s APIs: more than 15B tokens a minute as of March 31 · <a href="https://finance.yahoo.com/markets/stocks/articles/openai-closes-122-billion-funding-010940572.html">Quartz, via Yahoo Finance, Mar 31</a></li><li><strong>Tokens</strong> — Doubao: more than 30T tokens a day in September 2025 · <a href="https://kr-asia.com/pulses/157843">Volcano Engine, via KrASIA, Oct 21, 2025</a></li><li><strong>Tokens</strong> — Doubao: more than 180T tokens a day in June 2026 · <a href="https://www.diariobitcoin.com/china/volcano-engine-lanzara-seedance-2-5-en-julio-y-presume-liderazgo-en-maas-en-china/">Volcano Engine, via Diario Bitcoin, Jun 23</a></li><li><strong>Tokens</strong> — China: about 100T tokens a day at end-2025, more than 140T in March 2026 · <a href="https://www.chinadaily.com.cn/a/202603/25/WS69c2bcd9a310d6866eb3fa66.html">National Data Administration, via China Daily, Mar 25</a></li><li><strong>Lab revenue</strong> — OpenAI plans revenue of $36B in 2026 rising to $350B in 2030, and about $856B on compute and infrastructure · <a href="https://kfgo.com/2026/09/18/openai-expects-to-burn-through-almost-280-billion-by-2030-ft-reports/">FT, via Reuters, Sep 18</a></li><li><strong>Lab revenue</strong> — Anthropic’s internal forecast of about $190–200B of revenue in 2028 · <a href="https://thenextweb.com/news/anthropic-ipo-190-200bn-2028-revenue-forecast">Reuters, via The Next Web, Aug 17</a></li><li><strong>Lab compute</strong> — OpenAI ended 2025 with about 1.9 GW of compute, more than triple a year earlier · <a href="https://datacenterdynamics.com/en/news/openai-cfo-says-company-ended-2025-with-19gw-of-compute-scaled-revenue-at-same-speed/">DCD, Jan 21</a></li><li><strong>Lab compute</strong> — OpenAI targets 30 GW by 2030 · <a href="https://yourstory.com/ai-story/openai-30gw-ai-compute-plan-2030">YourStory, Apr 23</a></li><li><strong>Lab compute</strong> — Anthropic at about 2 GW early in 2026; about 5 GW of demand placed with Broadcom for 2027 and 10 GW for 2028; over 30 GW by 2030 · <a href="https://22vresearch.com/2026/09/04/anthropic-leadership-and-scale-thoughts-ahead-of-the-s-1-and-ipo/">22V Research, Sep 4</a></li><li><strong>Lab compute</strong> — OpenAI’s compute about 0.39M H100-equivalents in 2024 and 1.74M in 2025 · <a href="https://epoch.ai/latest/introducing-the-ai-chip-users-explorer">Epoch AI, Sep 9</a></li><li><strong>Training</strong> — The power drawn by frontier training runs grows 2.2–2.9× a year; the largest could draw 4–16 GW by 2030 · <a href="https://epoch.ai/publications/power-demands-of-frontier-ai-training">Epoch AI and EPRI, Aug 2025</a></li><li><strong>Shortage</strong> — H100 one-year rental contracts from about $1.70 an hour in October 2025 to $2.35 in March 2026 · <a href="https://newsletter.semianalysis.com/p/the-great-gpu-shortage-rental-capacity">SemiAnalysis, Apr 2</a></li><li><strong>Shortage</strong> — B200 rental index up about 28% this year to September 1; 12-month forward about 12% below spot in September · <a href="https://www.silicondata.com/blog/b200-rental-price-august-2026-update">Silicon Data</a></li><li><strong>Shortage</strong> — Not enough capacity to meet demand in 2026, likely the same in 2027 · <a href="https://www.fool.com/earnings/call-transcripts/2026/08/07/amazon-amzn-q2-2026-earnings-call-transcript/">Amazon Q2 call, via The Motley Fool, Jul 30</a></li><li><strong>Shortage</strong> — Supply and demand rebalance in the second half of 2027 at the earliest, the first half of 2028 more likely · <a href="https://www.kucoin.com/blog/th-ai-infrastructure-shortage-may-last-until-2028-as-hyperscaler-capex-keeps-rising">Goldman Sachs, via KuCoin, Sep 15</a></li></ul>
<h2>Method</h2>
<p><strong>Units and clock.</strong> Supply and demand are both counted in gigawatts of today’s hardware: the work one gigawatt of the fleet operating in September 2026 does, for inference (AgentX tokens, the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack’s measure) or for training (peak 8-bit FLOP/s, Epoch AI’s H100-equivalents). Today’s fleet is 31.6M H100-equivalents, about 40 GW all-in, 40% of it serving inference. A gigawatt installed later counts for its multiple of today’s average. Today is October 1, 2026: the fleet is the chips delivered to June 2026, demand is measured from October 1 (OpenRouter’s October figure covers October 1–18), and every balance is at December 31. The balance is the largest share of both demands the installed capacity can serve at once, with every year’s hardware split between inference and training in the same proportion. All power figures are all-in, at the facility, about 1.3× IT power; several forecasts we cite don’t say which they count.</p>
<p><strong>Chips.</strong> Our estimate of what the designers Epoch tracks could deliver: 33, 100, 170, 250, 350M H100-equivalents in 2026–30 (range 185–550M in 2030), rated at 15, 26, 34, 38, 41 GW. 2026 builds on Epoch’s first half and NVIDIA’s guided second half; 2027 on NVIDIA’s guidance, Broadcom’s outlook, TPU and AMD unit estimates and CoWoS and HBM capacity; 2028–30 on accelerator spending of $1T, $1.15T, $1.25T and about 30% more H100-equivalents per dollar each year. Chips switch on a quarter after delivery, at twice their rated power: 30% of a year’s deliveries come in its fourth quarter and switch on the next year. We split 2026’s second half between the third and fourth quarters 9:13, as for its H100-equivalents; the fourth quarter’s heavier Rubin mix would put a little more power in the third.</p>
<p><strong>Power and money.</strong> Power: 38, 46, 52, 58 GW in 2027–30, our estimate from analysts’ forecasts put on an all-in, worldwide basis (Morgan Stanley, Goldman). Our power research’s own synthesis is lower: 23, 28, 31, 35 GW, high case 30, 40, 50, 60 (sensitivities). Low 30, 33, 35, 37; high 50, 70, 95, 105 (SemiAnalysis to 2029; 2030 ours). Money: AI capex of $1T, $1.4T, $1.65T, $1.85T, $2.05T in 2026–30, from the street capex in the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> and <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> packs plus China’s largest platforms, sovereigns and others (86–88% AI), divided by $45, 48, 50, 51, 52B per GW of IT power and multiplied by 1.3 for facility power. The money includes the chips. What comes online each year is the lowest of chips, power and money; chips beyond that aren’t counted.</p>
<p><strong>Each year’s hardware.</strong> Inference: AgentX tokens per MW for each year’s deliveries, 0.8, 1.7, 2.7, 4.5, 6.9× a GB300 NVL72 rack in 2026–30, our estimate anchored on SemiAnalysis’s measurements (Vera Rubin 2.09×) and roadmaps; low 0.55, 1.2, 1.8, 2.7, 3.8; high 1, 2.5, 4.4, 7.8, 13. Divided by today’s fleet average, 0.33× GB300. Training: H100-equivalents per GW from the chips’ rated power, against today’s 625 W per H100-equivalent; low and high from our range for training gains per MW. Capacity switched on in a year blends the previous year’s fourth-quarter deliveries with its own first three quarters, by power. Our efficiency research labels its tables by install year; we read them as deliveries (a sensitivity). Software stays at today’s level: we assume its gains offset heavier models and longer contexts (the efficiency research’s central case nets about 8% a year; a sensitivity).</p>
<p><strong>Demand.</strong> Inference to December 2027: the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack’s OpenRouter compute paths raised to the power 0.6, the market’s pace (calibrated above; 0.45–0.75 as a sensitivity), read at December 31. After 2027: what customers spend on inference grows 1.7, 1.5, 1.35× a year in the base case (1.2, 1.1, 1 low; 2.35, 2, 1.7 high), times the gain in inference work per dollar of the capacity switched on that year (1.58, 1.60, 1.52× in the base case, from the same hardware and supply cases). Training and research: 2.7, 2.4, 2.1, 1.8, 1.6× a year in 2026–30 (2.2, 1.7, 1.4, 1.3, 1.2 low; 3.2, 3.2, 2.8, 2.5, 2.2 high), the first applied to October–December only. Today’s shortage, demand 20% above supply (0–30%), scales demand in every year.</p>
<p><strong>Needed GW</strong> is the capacity of that year’s hardware that, added to everything installed before, makes supply equal demand at year-end. Utilization stays at 60% throughout, as in the <a href="https://06.ai/packs/ai-compute-demand">compute-demand</a> pack; the table gives the utilization at which supply would just meet demand. We keep today’s chips in service and don’t model refreshes: replacing Hopper inside existing buildings would add supply without new power, though not without money. Disclosed token counts use different definitions; each is compared only with itself over time.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>How much compute does AI demand need by 2027?</title>
  <link>https://06.ai/packs/ai-compute-demand</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-compute-demand</guid>
  <pubDate>Mon, 19 Oct 2026 12:09:00 GMT</pubDate>
  <description>The AI-demand pack projects OpenRouter’s tokens to the end of 2027. We turn them into GPUs and gigawatts with benchmarks for each chip and model, then scale the answer up to the whole market.</description>
  <category>AI compute</category>
  <enclosure url="https://06.ai/newsletter/ai-compute-demand/cover.png" length="71078" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-compute-demand/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-compute-demand"><img src="https://06.ai/newsletter/ai-compute-demand/thumb.png" alt="How much compute does AI demand need by 2027?" width="421" height="432"></a><figcaption><a href="https://06.ai/packs/ai-compute-demand">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>OpenRouter’s 23.8T tokens a day would need about <strong>60 MW</strong> of today’s hardware at benchmark throughput. In <a href="https://06.ai/packs/ai-demand">the </a><a href="https://06.ai/packs/ai-demand">AI-demand</a><a href="https://06.ai/packs/ai-demand"> pack</a>’s base case its tokens grow 22× by December 2027, but at today’s prices the compute they need grows only about <strong>10×</strong>, because cheap models keep taking share. If the whole market’s inference demand grew at that pace, about 7.2× a year, it would need about <strong>47 GW of new GB300-class capacity</strong> by the end of 2027, or 22 GW if it were all Vera Rubin. The AI chips sold in all of 2026 add roughly 10–11 GW for inference.</p>
<ul><li><strong>60 MW</strong> — OpenRouter today all-in, on today’s mix of hardware at benchmark throughput. On GB300 racks: 20 MW, about 9,300 GPUs</li><li><strong>10×</strong> — OpenRouter’s compute, Dec 2027 today’s, for 22× the tokens and 4.2× the dollars in the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s base case. About 195 MW of GB300s</li><li><strong>+47 GW</strong> — The market at OpenRouter’s pace of new GB300-class inference capacity by Dec 2027, about 22 million GPUs, 43 GW of it during 2027. +11 GW at half the pace</li><li><strong>10–11 GW</strong> — 2026’s new chips, for inference of 25–28 GW added in all, on mixed hardware: 24–27M H100-equivalents, more than the 20.3M delivered in all years through 2025 (our estimate from Epoch AI data)</li></ul>
<h2>A token isn’t a token</h2>
<figure><a href="https://06.ai/packs/ai-compute-demand#tokens"><img src="https://06.ai/newsletter/ai-compute-demand/fig-01.png" alt="A token isn’t a token" width="694" height="610"></a><figcaption>Left: tokens a day from one megawatt of all-in power for each system serving DeepSeek V4 Pro on SemiAnalysis’s AgentX benchmark, which replays real coding-agent sessions, at 100 tokens/s per user. As on OpenRouter, most of the tokens are cached input. Values at 100 tokens/s are SemiAnalysis’s interpolations between measured points. GB200 is our estimate. B300 ran vLLM, Vera Rubin pre-release TensorRT-LLM and the others SGLang. Right: tokens a day from one B200 by model, with 8K-token prompts and 1K-token answers at about 50 tokens/s per user.</figcaption></figure>
<h2>Four things set what a token costs</h2>
<p><strong>The model.</strong> Compute per token rises with the parameters a model uses for each token more than with its total size, though total size and the length of the conversation matter too. On one B200, gpt-oss-120b, which uses 5.1B parameters per token, makes 3.8B tokens a day. DeepSeek-R1, at 37B, makes 0.40B. MiniMax-M2.5 uses a quarter of GLM-5’s active parameters and makes 3.9× its tokens. The rule is rough: Llama 3.3 70B, which uses all 70B of its parameters for every token, makes more than DeepSeek-R1. We size every model by its active parameters.</p>
<p><strong>The hardware.</strong> Serving DeepSeek V4 Pro to coding agents at 100 tokens/s per user, a megawatt of GB300 NVL72 racks serves 13× the tokens of a megawatt of H200s running at 8-bit precision, and 4.1× those of B200s. Vera Rubin, now shipping, doubles GB300 again. Racks of 72 GPUs win on large models because they spread the model’s experts and its memory of the conversation across many chips. At full load, a gigawatt of GB300s would get through about 100 days of OpenRouter’s October volume each day, if every token were a DeepSeek V4 Pro agent token.</p>
<p><strong>The kind of token.</strong> Output is 2.4% of OpenRouter’s tokens but about 34% of the GPU time behind them. New input is 19% of the tokens and 55% of the time. Cached input, the context agents send again at every step, is 79% of the tokens and about 11% of the time. These weights follow the labs’ own pricing: output costs about five times new input, and a cache read a tenth to a twentieth of it; we use a twentieth.</p>
<p><strong>Speed and memory.</strong> Serving each user faster means smaller batches. DeepSeek-R1 on a B200 makes 6,799 tokens/s per GPU at 30 tokens/s per user and 2,685 at 100. A model that doesn’t fit on one server is worse: at 50 tokens/s per user, DeepSeek-R1’s best H100 setup made 74 tokens/s per GPU, against 4,610 on a B200.</p>
<h2>On OpenRouter, 12% of the tokens use about half the compute</h2>
<figure><a href="https://06.ai/packs/ai-compute-demand#mix"><img src="https://06.ai/newsletter/ai-compute-demand/fig-02.png" alt="On OpenRouter, 12% of the tokens use about half the compute" width="694" height="208"></a><figcaption>Share of OpenRouter’s tokens, of the compute they need (our estimate) and of spend (the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s estimate), October 1–18. Models are grouped by whether their weights are published and by parameters used per token. Closed models’ sizes are our estimates from their prices; see Method. Free versions count in tokens and compute but not in dollars.</figcaption></figure>
<h2>OpenRouter in GPUs</h2>
<p>At SemiAnalysis’s measured throughput and 60% utilization, October’s 23.8T tokens a day would need about 20 MW of GB300 racks, about 9,300 GPUs. On H200s they would need 250 MW. On a mix of hardware like the industry’s installed base today, part Hopper, part Blackwell, part TPU and other chips, they would need about 60 MW. Every megawatt here is all-in: chips, servers, networking and cooling. Real deployments run older software than a tuned benchmark, which pushes the need up; how closely the benchmark’s traffic matches OpenRouter’s moves it either way (see Method).</p>
<p>The compute isn’t where the tokens are. Open models that use 20B parameters or fewer per token, led by DeepSeek V4.1 Flash with 21% of all tokens, are 50% of the tokens, 17% of the compute and 4% of the dollars. Closed models above that size, among them Claude Opus 5.5 and Sonnet 5.5, GPT-6 Sol and Astra and Gemini 3.8 Flash, are 12% of the tokens, 64% of the dollars and, by our price-based estimate, 49% of the compute. Opus 5.5 alone is 3% of the tokens and about 18% of the compute. Those compute shares rest on what we assume about the labs’ margins: at gross margins of 45–75% instead of 60%, the larger closed models are 38–56% of the compute.</p>
<h2>Tokens 22×, compute 10×, dollars 4.2×</h2>
<figure><a href="https://06.ai/packs/ai-compute-demand#path"><img src="https://06.ai/newsletter/ai-compute-demand/fig-03.png" alt="Tokens 22×, compute 10×, dollars 4.2×" width="694" height="402"></a><figcaption>OpenRouter by month, October 2026 = 1, log scale. Tokens and dollars are the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s paths; growth halves every 3, 6 or 12 months. Compute is our estimate at today’s efficiency, holding each model’s price fixed: the model mix that reproduces the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s tokens and dollars each month, times each model’s compute per token. Shown: Base.</figcaption></figure>
<h2>OpenRouter in 2027</h2>
<p>In the base case OpenRouter handles 513T tokens a day by December 2027, 22× October’s, while spend grows only 4.2×, so the average price of a token falls 5.1×. Holding each model’s price fixed, as we do, that requires cheaper models to keep taking share: in the mix that reproduces the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s numbers, DeepSeek V4.1 Flash’s tokens grow 48× and Claude Opus 5.5’s 1.5×. Because the cheap tokens need little compute each, compute grows 10×, from 20 MW of GB300s to 195 MW, about 84,000 more GPUs. On today’s mix of hardware it would be 600 MW. If prices fall model by model instead, as GPT-5.6 Luna’s did when OpenAI cut them 80% this summer, compute grows closer to tokens.</p>
<p>The low path needs 4.1× today’s compute (80 MW of GB300s) and the high path 23× (460 MW). Even the high case is under half a gigawatt of GB300s. OpenRouter on its own is a rounding error in a year that adds tens of gigawatts. What matters is what it says about everyone else.</p>
<h2>If the whole market grew at OpenRouter’s pace</h2>
<p>New inference capacity the whole market needs, cumulative from October 2026, in GW of all-in power, if its inference demand grows at a share of OpenRouter’s projected compute growth in the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s base case. It starts from about 16 GW of chips doing inference today and assumes the new capacity is all GB300 or all Vera Rubin. The band is our estimate of the inference share of the chips added in 2026, a mix of hardware that serves fewer tokens per MW than GB300 racks.</p>
<p><em>At the default setting (Market grows at of OpenRouter’s projected monthly rate 100%), from the </em><a href="https://06.ai/packs/ai-compute-demand#market"><em>interactive version</em></a><em>:</em></p>
<ul><li>New capacity by Dec 2027: <strong>+47 GW</strong></li><li>GPUs: <strong>22 million</strong></li><li>In 2027 alone: <strong>+43 GW</strong></li><li>Market inference demand vs today: <strong>10×</strong></li></ul>
<figure><a href="https://06.ai/packs/ai-compute-demand#market"><img src="https://06.ai/newsletter/ai-compute-demand/fig-04.png" alt="If the whole market grew at OpenRouter’s pace" width="694" height="402"></a><figcaption>Shown: GB300.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-compute-demand#market"><img src="https://06.ai/newsletter/ai-compute-demand/fig-05.png" alt="If the whole market grew at OpenRouter’s pace — Vera Rubin" width="694" height="433"></a><figcaption><strong>Vera Rubin.</strong></figcaption></figure>
<h2>From OpenRouter to the market</h2>
<p>OpenRouter is a small slice. On matching dates its tokens were about 3% of Google’s across all its products, 1.3% of a national total for China that TechNode reported for June without a source or method, and 0.6–2.2% of published estimates for the whole world. Its share of the compute is smaller still, about 0.4% of the chips doing inference by our estimate. Partly that is because its tokens are cheap: half come from small open models that coding agents call over and over. Partly it is because benchmarks flatter real deployments: at benchmark throughput, today’s inference chips could serve about 6.2 quadrillion OpenRouter-like tokens a day, 6.3× the highest estimate for the world.</p>
<p>So we scale up from the hardware, not the tokens, and use the benchmarks only to compare one kind of hardware with another. Epoch AI estimates 31.6M H100-equivalents of AI chips operating by September: chips delivered through June, allowing about three months to install. At about 1.25 kW each all-in, that is 39.5 GW. If 40% of it serves inference, that is 16 GW. If the market’s inference demand grows the way OpenRouter’s compute does in the base case, 10× by December 2027, it needs about 160 GW of hardware like today’s. Built as GB300s, which serve about 3.1× as many tokens per MW as today’s average, the increase is about <strong>47 GW, or 22 million GPUs</strong>. Built as Vera Rubin, it is about 22 GW. Almost all of it falls in 2027: 43 GW of GB300s between December 2026 and December 2027.</p>
<p>That takes the premise at face value, and the premise is aggressive. At full pace the market’s inference compute grows about 7.2× a year, roughly what Google’s tokens did in the year to May; over the same year OpenRouter’s tokens grew 12.5×. The installed base of AI chips grew 3.0× in 2025. At half OpenRouter’s growth rate, about 2.7× a year, close to the chip stock’s growth, market demand rises 3.2× by December 2027 and needs 11 GW of new GB300s. Whether the answer is closer to 11 GW or 47 GW depends on whether the rest of the market speeds up toward OpenRouter’s pace.</p>
<p>Three inputs we can’t pin down move the 47 GW: the share of today’s chips doing inference (30–50% gives 35–58 GW), how efficient today’s fleet is (0.75–1.3× our estimate gives 35–60 GW) and how many chips are installed (Epoch’s range, roughly 1.5× either way, gives 31–70 GW). Moving all three together gives 17–113 GW.</p>
<h2>2026 is on track to add more AI compute than all earlier years combined</h2>
<figure><a href="https://06.ai/packs/ai-compute-demand#added"><img src="https://06.ai/newsletter/ai-compute-demand/fig-06.png" alt="2026 is on track to add more AI compute than all earlier years combined" width="694" height="342"></a><figcaption>AI chips sold, millions of H100-equivalents (Epoch AI’s unit, scaled by 8-bit compute). The second half of 2026 is our range: 10–40% above the first half. Epoch counts chips when they are delivered; installing them takes longer.</figcaption></figure>
<h2>What 2026 added</h2>
<p>Epoch AI’s chip-sales data counts 11.3M H100-equivalents sold in the first half of 2026, against 13.6M in all of 2025. If the second half runs 10–40% above the first, 2026 adds 24–27M, more than the 20.3M delivered in all the years through 2025. Those chips are rated at 12–14 GW. By Epoch’s rule of thumb a data center needs about twice its chips’ rated power once servers, networking and cooling are counted, so 2026’s chips need 25–28 GW all-in. NVIDIA’s data-center revenue was $164B in the first half of its fiscal 2027, against $194B in all of fiscal 2026, and Vera Rubin began production shipments in August. NVIDIA expects supply to stay the bottleneck at least through January 2028.</p>
<p>Not all of it serves inference. At 40%, 2026 gives inference about 10–11 GW, on a mix of hardware that serves fewer tokens per MW than GB300 racks. Demand at OpenRouter’s pace would need about 4.1× that in 2027 alone if it is built as GB300s, or 1.9× as Vera Rubin. At half the pace, 9.7 GW of GB300s in 2027 is about the inference share of a 2026-sized year, and more if built from 2026’s mix of chips. This pack is about demand; a later one will look at how much capacity 2027 can actually deliver.</p>
<h2>What would change the numbers</h2>
<p><strong>The pace.</strong> It is the biggest lever. From a quarter of OpenRouter’s growth rate to all of it, the need by December 2027 runs from 4.0 GW to 47 GW of GB300s.</p>
<p><strong>The mix.</strong> Our compute grows less than tokens because, at fixed prices, cheap models keep taking share. If instead the mix froze and every model’s price fell, compute would grow with tokens, 22×, and the market would need about 106 GW. Two other choices matter less. If the larger closed models’ tokens grew 3.5×, as fast as OpenAI’s and Anthropic’s revenue run-rates in <a href="https://06.ai/packs/ai-lab-revenue">the </a><a href="https://06.ai/packs/ai-lab-revenue">lab-revenue</a><a href="https://06.ai/packs/ai-lab-revenue"> pack</a>, the market would need 45 GW. If free tokens stayed flat instead of growing with the rest, 42 GW.</p>
<p><strong>How big the closed models are.</strong> Nobody discloses them, so we infer their size from price, assuming the labs keep 60% of it as gross margin. At 45% the models are bigger, take more of today’s compute and grow more slowly: 41 GW. At 75%, 55 GW.</p>
<p><strong>How compute scales with size.</strong> We make compute per token proportional to active parameters. Across InferenceX’s six B200 results it rises more slowly, roughly with active parameters to the power 0.89. On that basis small models cost relatively more, the shift toward them saves less, and the market would need 53 GW.</p>
<p><strong>Software.</strong> Benchmarks move every month. InferenceX has measured gains of 1.5–2× from software alone on the same chips within weeks, on DeepSeek-R1 and on DeepSeek V4 Pro. Each doubling roughly halves the need; we hold today’s software fixed.</p>
<p><strong>Speed.</strong> We measure at 100 tokens/s per user. Serving agents faster costs throughput steeply: on DeepSeek V4 Pro, a GB300 rack serves about a fifth as many tokens per MW at 150 tokens/s per user as at 100, while Vera Rubin holds up better. Faster agents would raise every figure here and widen Rubin’s lead.</p>
<p><strong>Output.</strong> Agents write about 1% of their tokens. An output token costs about five times a new input token, so agents that write more would raise compute faster than tokens.</p>
<h2>What to watch</h2>
<p><strong>Google’s next token count.</strong> Its third-quarter results, due in late October, are the cleanest read on whether the rest of the market is growing near OpenRouter’s pace.</p>
<p><strong>Rubin’s share of 2027 deliveries.</strong> Each GW of Vera Rubin does the work of about two of GB300s, so the mix of what ships in 2027 roughly halves or doubles the gigawatts needed.</p>
<p><strong>Cache rates.</strong> OpenRouter’s agent traffic went from about 60% cached in January to nearly 90% in September, which kept compute growth below token growth. It can’t rise much further, so from here more of token growth turns into compute growth.</p>
<h2>What this is anchored on</h2>
<p>Compute, power, GPU counts, tier shares, the 2027 mix and the market estimates are ours, built from the sources below. OpenRouter data is licensed under CC BY 4.0.</p>
<ul><li><strong>OpenRouter tokens</strong> — Daily tokens for the 50 biggest models plus one row for the rest, October 1–18, 2026; list prices from its model catalog · <a href="https://openrouter.ai/rankings">OpenRouter rankings-daily dataset and models API. Licensed under CC BY 4.0</a></li><li><strong>Token shape</strong> — Agent API keys used about 7× the tokens of human keys in late September; agent tokens about 87% cached input, 12% new input and 1% output; human tokens about 12% output, mostly new input (the 20% cached is our assumption) · <a href="https://openrouter.ai/data/newsletter/cache-is-crucial">OpenRouter, “Cache is Crucial,” Oct 8</a></li><li><strong>Demand forecast</strong> — OpenRouter tokens and spend to December 2027: low, base and high paths · <a href="https://06.ai/packs/ai-demand">06.ai </a><a href="https://06.ai/packs/ai-demand">AI-demand</a><a href="https://06.ai/packs/ai-demand"> pack</a></li><li><strong>Lab revenue</strong> — OpenAI’s and Anthropic’s annualized revenue to December 2027 · <a href="https://06.ai/packs/ai-lab-revenue">06.ai </a><a href="https://06.ai/packs/ai-lab-revenue">lab-revenue</a><a href="https://06.ai/packs/ai-lab-revenue"> pack</a></li><li><strong>Price cuts</strong> — OpenAI cut GPT-5.6 Luna’s prices 80%, to $0.20 per million input tokens and $1.20 output · <a href="https://devtk.ai/en/blog/ai-api-price-war-august-2026/">DevTk.AI, August 2026</a></li><li><strong>Agent throughput</strong> — Total tokens/s per utility MW serving DeepSeek V4 Pro at 100 tokens/s per user on the AgentX benchmark, interpolated between measured points: Vera Rubin NVL72 59.4M (pre-release TensorRT-LLM), GB300 NVL72 28.5M, B200 6.95M, B300 5.56M, H200 2.26M, MI355X 2.01M · <a href="https://inferencex.semianalysis.com/blog/vera-rubin-nvl72-agentic-inference">SemiAnalysis InferenceX, Sep 14</a></li><li><strong>Agent traffic</strong> — AgentX replays Claude Code sessions; on DeepSeek V4 median 88K tokens in and 413 out per request, 73–96% served from cache · <a href="https://inferencex.semianalysis.com/blog/agentx-inferencexv3-does-cuda-moat">SemiAnalysis InferenceX, Aug 24</a></li><li><strong>Token accounting</strong> — AgentX totals include reused (cached) input tokens · <a href="https://inferencex.semianalysis.com/glossary/throughput">InferenceX glossary</a></li><li><strong>Power basis</strong> — InferenceX’s power per GPU is an all-in utility envelope that includes cooling and data-center overhead (near 2.17 kW for a B200 in this post) · <a href="https://inferencex.semianalysis.com/blog/deepseekv4-16t-day-0-to-day-43-performance">InferenceX, Jun 9</a></li><li><strong>Power per GPU</strong> — H100 and H200 1.37 kW, B200 1.71 kW, B300 1.90 kW, MI355X 2.09 kW · <a href="https://inferencex.semianalysis.com/chips/b300">InferenceX chip pages, Oct 19</a></li><li><strong>Power per GPU</strong> — GB300 NVL72 12,350 tokens/s per chip and 5.83M per MW, so 2.12 kW each · <a href="https://inferencex.semianalysis.com/compare/deepseek-r1-gb300-vs-mi355x">InferenceX, DeepSeek-R1 GB300 vs MI355X</a></li><li><strong>Model benchmarks</strong> — Tokens/s per GPU at 8K in / 1K out and 50 tokens/s per user: gpt-oss-120b, Llama 3.3 70B and DeepSeek-R1 on H100, H200 and B200 · <a href="https://inferencex.semianalysis.com/run">InferenceX run pages</a></li><li><strong>Model benchmarks</strong> — MiniMax-M2.5 on H100 and B200, 8K in / 1K out · <a href="https://inferencex.semianalysis.com/blog/b200-minimax-m2-5-vllm-nvfp4-vs-h100-fp8-perf-per-dollar">InferenceX, May 26</a></li><li><strong>Model benchmarks</strong> — GLM-5 on H200 and B200, 8K in / 1K out · <a href="https://inferencex.semianalysis.com/blog/b200-glm5-nvfp4-vs-h200-fp8-3-6x-perf-per-dollar">InferenceX, May 26</a></li><li><strong>Model benchmarks</strong> — Kimi K2.5 on H200 and B200, 8K in / 1K out · <a href="https://inferencex.semianalysis.com/blog/b200-nvfp4-vs-h200-int4-kimi-k2-vllm-perf-per-dollar">InferenceX, May 26</a></li><li><strong>GB200 vs GB300</strong> — GB300 NVL72 made 1.2–2.8× GB200 NVL72’s tokens per GPU on DeepSeek V4 Pro at matched speeds (8K in / 1K out, runs a month after the model’s release) · <a href="https://inferencex.semianalysis.com/blog/gb300-nvl72-vs-gb200-nvl72-dsv4-pro-vllm-fp4">InferenceX, May 27</a></li><li><strong>Model sizes</strong> — DeepSeek V4 Pro: 1.6T parameters, 49B active · <a href="https://huggingface.co/blog/deepseekv4">Hugging Face blog</a></li><li><strong>Model sizes</strong> — DeepSeek V4.1 Flash: 552B parameters, 8B active on input and 16B on output; other open models from their model cards, except the estimates named in Method · <a href="https://openrouter.ai/deepseek/deepseek-v4.1-flash">OpenRouter model pages; Hugging Face</a></li><li><strong>AI chips delivered</strong> — 20.3M H100-equivalents delivered by end-2025; 31.6M operating by September 2026, from deliveries through June with a three-month lag to install · <a href="https://epoch.ai/latest/scaling-ai-data-centers-research">Epoch AI, Sep 16</a></li><li><strong>Power per chip</strong> — 94 tracked AI data centers: 14.8M H100-equivalents, 14.2 GW of IT power, 18.5 GW at the facility; about 44% of global AI compute · <a href="https://epoch.ai/data/ai-data-centers?view=table">Epoch AI data-center hub, Oct 19</a></li><li><strong>Chips added</strong> — H100-equivalents and chip power by quarter, from estimated sales by chip · <a href="https://epoch.ai/data/ai_chip_sales_timelines_by_chip.csv">Epoch AI chip-sales data, Oct 14 (our sums)</a></li><li><strong>Facility power</strong> — A data center draws about twice its AI chips’ rated power · <a href="https://epoch.ai/data/ai-chip-sales">Epoch AI chip-sales data, FAQ</a></li><li><strong>Inference share</strong> — OpenAI’s 2025 compute split roughly evenly between research and inference · <a href="https://epoch.ai/latest/introducing-the-ai-chip-users-explorer">Epoch AI, Sep 9</a></li><li><strong>NVIDIA</strong> — Data-center revenue $193.7B in fiscal 2026; $75.2B and $89.0B in the first two quarters of fiscal 2027 · <a href="https://s201.q4cdn.com/141608511/files/doc_financials/2027/Q227/Q2FY27-CFO-Commentary.pdf">NVIDIA filings and CFO commentary</a></li><li><strong>NVIDIA</strong> — Production shipments of Vera Rubin began in August; supply expected to remain a bottleneck at least through the end of fiscal 2028, in January 2028 · <a href="https://s201.q4cdn.com/141608511/files/content_files/TRANSCRIPT_-NVIDIA-Corp-NVDA-US-Q2-2027-Earnings-Call-26-August-2026-5_00-PM-ET.pdf">NVIDIA Q2 FY27 earnings call, Aug 26</a></li><li><strong>Software gains</strong> — DeepSeek V4 Pro on B200: about 300K to nearly 500K tokens/s per MW in six weeks · <a href="https://inferencex.semianalysis.com/blog/deepseekv4-16t-day-0-to-day-43-performance">InferenceX, Jun 9</a></li><li><strong>Software gains</strong> — DeepSeek-R1 on B200: up to 1.8× from one SGLang release · <a href="https://inferencex.semianalysis.com/blog/sglang-0-5-6-b200-deepseek-r1-fp4-up-to-1-8x">InferenceX, May 2</a></li><li><strong>Google</strong> — More than 3.2 quadrillion tokens a month across its products, May 2026, 7× a year earlier · <a href="https://blog.google/innovation-and-ai/sundar-pichai-io-2026/">Google, May 19</a></li><li><strong>Google API</strong> — About 22 billion tokens a minute through customers’ direct API use, Q2 2026 · <a href="https://blog.google/company-news/inside-google/message-ceo/alphabet-earnings-q2-2026/">Google, Jul 22</a></li><li><strong>OpenAI API</strong> — More than 15 billion tokens a minute, as of its March 31 funding round · <a href="https://www.coindesk.com/tech/2026/04/01/openai-raises-a-record-usd122-billion-at-as-revenue-crosses-usd2-billion-per-month">CoinDesk, Apr 1</a></li><li><strong>ByteDance</strong> — Doubao over 180T tokens a day, June 23 · <a href="https://news.10jqka.com.cn/20260623/c677639006.shtml">10jqka, Jun 23</a></li><li><strong>China</strong> — National use over 500T tokens a day in June, reported without a source or method · <a href="https://technode.com/2026/08/28/chinas-daily-ai-token-usage-tops-500-trillion-as-compute-demand-grows/">TechNode, Aug 28</a></li><li><strong>World estimate</strong> — About 370T tokens a day, July · <a href="https://io-fund.com/ai-stocks/ai-token-demand-shattering-forecasts">I/O Fund, Jul 30</a></li><li><strong>World estimate</strong> — More than 30 quadrillion tokens a month, late June · <a href="https://connect.cfauk.org/discussion/the-state-of-the-ai-economy">Exponential View, as relayed by CFA UK, Jul 5</a></li></ul>
<h2>Method</h2>
<p><strong>Tokens.</strong> OpenRouter’s rankings for October 1–18, the window of the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s October level: 23.8T tokens a day across the 50 biggest models and a row for the rest. Following OpenRouter’s October 8 data, we take seven-eighths of tokens as agent traffic (87% cached input, 12% new input, 1% output) and one-eighth as human traffic (12% output, as OpenRouter reports, and by our assumption 20% cached and 68% new input). That is 79% cached, 19% new and 2.4% output. The <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack assumed 10% output and half of input cached to price tokens; its dollar total is pinned to Sacra’s revenue estimate, so we keep its dollars and use OpenRouter’s own split for compute.</p>
<p><strong>Compute per token.</strong> The reference is DeepSeek V4 Pro, 1.6T parameters with 49B active, on AgentX at 100 tokens/s per user, which counts cached input in its totals. Each model’s compute per token is its active parameters over 49B. DeepSeek V4.1 Flash, which uses 8B on input and 16B on output, is weighted by where the GPU time goes. GPU time per token is 5 for output, 1 for new input and 0.05 for cached input. Taking AgentX’s traffic to be shaped like OpenRouter’s agent traffic, an average OpenRouter token takes 1.63× an AgentX token. With AgentX’s own mix, 0.5% output and 73–96% of input from cache, it would take 1.1–3.1×, putting OpenRouter at 39–116 MW on today’s mix of hardware. That moves OpenRouter’s megawatts but not the market figure, which scales the fleet. Capacity runs at 60% utilization, the figure SemiAnalysis uses for revenue per GW.</p>
<p><strong>Closed models</strong> are sized from their input price: the median open model charges about $0.010 per million input tokens for each billion active parameters, and we assume closed labs keep a 60% gross margin against 30% for the hosts of open models. That puts Claude Opus 5.5 at about 221B active-equivalent parameters, a pricing proxy, not a disclosed size. Discounted versions take their model’s standard price: Muse Spark 1.3 Contributor is sized as Muse Spark 1.3. Open models’ sizes come from their model cards, except Space Bunny, GLM-5.3, GLM-5.2, MiMo-V2.5 and Nemotron 3.5 Super-VL, which are our estimates. The long tail takes the average of the rest.</p>
<p><strong>Hardware and power.</strong> AgentX’s tokens per MW for each system, with InferenceX’s power per GPU from its chip pages (1.37 kW for H200, 1.71 kW for B200, 1.90 kW for B300) and its GB300 comparison (2.12 kW). InferenceX’s power is all-in, including cooling and other data-center overhead, so every megawatt and gigawatt here is all-in. A June InferenceX post used about 2.17 kW for a B200; we use the chip pages throughout. GB200 NVL72 is our estimate at 70% of GB300 per MW and 1.87 kW per GPU, from rack power of about 135 kW. Today’s fleet is our estimate of the installed base by share of power: Hopper 21%, Blackwell 8-GPU servers 16%, NVL72 racks 32%, TPUs 15%, other 16%. On AgentX that averages 9.3M tokens/s per MW, against 28.5M for GB300 and 59.4M for Vera Rubin.</p>
<p><strong>The 2027 mix.</strong> Each month, every paid model’s tokens grow in proportion to its price raised to a negative power, with free tokens growing with the total. Each model’s price stays at its October level. We solve for the power and the scale that reproduce the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s token and spend paths, then re-weight by compute per token. In the base case the power reaches 0.68 by December 2027: a model ten times cheaper grows about 4.8× faster.</p>
<p><strong>The market.</strong> Epoch’s 31.6M H100-equivalents operating by September, at 1.25 kW each all-in (its tracked data centers: 18.5 GW at the facility for 14.8M), gives 39.5 GW; 40% serves inference (30–50%). The market’s demand grows at a set share of OpenRouter’s monthly compute growth, in logs: at 50%, a path that grows 10× becomes about 3×. New capacity needed is today’s inference fleet × (growth − 1) × today’s average tokens per MW ÷ the new hardware’s. The existing fleet stays in service. The range on today’s fleet efficiency also covers the gap between Epoch’s power basis and InferenceX’s. OpenRouter’s token shares use its average over the 30 days before each disclosure.</p>
<p><strong>2026.</strong> Our sums of Epoch AI’s estimated chip sales by quarter, which reproduce its published total of 20.3M H100-equivalents at the end of 2025 and, through June 2026, the 31.6M it counts as operating by September. The second half is 10–40% above the first. All-in power is twice the chips’ rated power, Epoch’s rule of thumb for a data center’s total draw. InferenceX’s power per GPU runs 1.5–1.7× the rating for Blackwell chips; on that basis 2026 adds 19–24 GW all-in and 7–10 GW for inference. Epoch’s estimates span roughly 1.5× either way, and it counts chips when delivered, not when running.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>How big do OpenAI and Anthropic get by 2027?</title>
  <link>https://06.ai/packs/ai-lab-revenue</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-lab-revenue</guid>
  <pubDate>Mon, 19 Oct 2026 12:08:00 GMT</pubDate>
  <description>We gathered 145 reported figures on the two labs’ revenue, rebuilt their run-rates month by month, tested simple forecasting rules against what was later reported, and projected to the end of 2027.</description>
  <category>AI labs</category>
  <enclosure url="https://06.ai/newsletter/ai-lab-revenue/cover.png" length="65166" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-lab-revenue/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-lab-revenue"><img src="https://06.ai/newsletter/ai-lab-revenue/thumb.png" alt="How big do OpenAI and Anthropic get by 2027?" width="421" height="391"></a><figcaption><a href="https://06.ai/packs/ai-lab-revenue">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>Our base case has <strong>Anthropic at about $265B</strong> and <strong>OpenAI at about $230B</strong> of annualized revenue in December 2027, up from $71B and $50B at the end of September. The ranges overlap almost completely. History says the bigger risk is that both numbers are too low.</p>
<ul><li><strong>$72B</strong> — OpenAI, end of 2026. Range $66–79B. OpenAI expects at least $70B</li><li><strong>$100B</strong> — Anthropic, end of 2026. Range $88–114B. About $93B on OpenAI’s accounting</li><li><strong>$230B</strong> — OpenAI, end of 2027. Range $150–360B</li><li><strong>$265B</strong> — Anthropic, end of 2027. Range $185–400B. About $245B on OpenAI’s accounting</li></ul>
<h2>Rebuilt from the record, projected to 2027</h2>
<figure><a href="https://06.ai/packs/ai-lab-revenue#runrates"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-01.png" alt="Rebuilt from the record, projected to 2027" width="694" height="520"></a><figcaption>Annualized revenue (run-rate), log scale. Lines are one smooth path per company fitted to 40 reported run-rate and revenue figures. Dashed lines are our base case; shading is the 80% range. Anthropic counts sales through cloud marketplaces in full; OpenAI counts only its share.</figcaption></figure>
<h2>The leaks agree with each other</h2>
<p>Neither company reports its run-rate on a schedule. The figures arrive through funding announcements, investor updates and leaks, on different dates and sometimes on different definitions. We collected 145 of them. 80 give a run-rate or revenue for a specific period; dropping repeats of the same figure, later restatements and figures on a different basis leaves the 40 we fit. One smooth path through each company’s figures misses the typical Anthropic figure by 3% and the typical OpenAI figure by 1%; the largest miss is 17%. The run-rates, the quarterly revenue and Anthropic’s draft prospectus tell one story.</p>
<p>The OpenAI path implies about $10.1B of revenue in the third quarter, up 50% from the second. OpenAI hasn’t reported it yet.</p>
<h2>Anthropic slowed as OpenAI sped up</h2>
<figure><a href="https://06.ai/packs/ai-lab-revenue#growth"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-02.png" alt="Anthropic slowed as OpenAI sped up" width="694" height="362"></a><figcaption>Monthly growth of the run-rate, from the fitted paths. The fit smooths launch months, so single months were lumpier than this.</figcaption></figure>
<h2>The curves crossed in the summer</h2>
<p>On the fitted path, Anthropic’s run-rate grew about 44% a month in February and 49% in March and was down to about 3% by September; only the third-quarter total pins down how August and September split. Its revenue rose 45% in the third quarter, after 145% in the second. OpenAI went the other way: about 3–4% a month in March and April, 17–19% from July to September. The Information reported that OpenAI’s run-rate grew 70% from the end of June to the end of September, and Bloomberg that enterprise sales were driving most of the growth.</p>
<h2>What a simple rule would have said</h2>
<figure><a href="https://06.ai/packs/ai-lab-revenue#backtest"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-03.png" alt="What a simple rule would have said" width="694" height="337"></a><figcaption>At past half-year ends, we projected the next 12 months at the growth of the previous 12, using only figures public at the time (dashed, starting from the latest figure then available; Anthropic’s figures are too sparse before mid-2025). Solid lines and dots are what was reported later. Log scale.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-lab-revenue#backtest"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-04.png" alt="OpenAI, trend — Up to 3 months out: 18% mixed · 4–7: 8% mixed · 8–12: 19% high · 13–18: 24% high; OpenAI, fading — Up to 3 months out: 18% low · 4–7: 13% low · 8–12: 23% low · 13–18: 35% low; Anthropic, trend — Up to 3 months out: 30% low · 4–7: 34% low · 8–12: 32% low · 13–18: 74% low; Anthropic, fading — Up to 3 months out: 29% low · 4–7: 39% low · 8–12: 48% low · 13–18: 86% low" width="694" height="230"></a></figure>
<p>Trend: the last 12 months’ growth continues. Fading: that growth halves over 18 months. Each rule was run at every month-end since March 2024 (January 2025 for Anthropic) and scored against every fitted run-rate and quarterly revenue figure dated up to 18 months later, as forecast ÷ outcome − 1. The table shows the median size of the miss and its usual direction.</p>
<h2>OpenAI followed the rule; Anthropic broke it twice</h2>
<p>The simplest forecast is that the next 12 months grow like the last 12. Run at every month-end with only the figures public at the time, it called OpenAI well: its typical miss was 8% four to seven months out and 19–24% further out, on the high side. On Anthropic it missed by about a third four to 12 months out and by 74% beyond a year, on the low side, because Anthropic kept accelerating. Then it broke the other way. Run today, it puts Anthropic at about $174B at the end of 2026, far above the roughly $100–110B in recent reporting.</p>
<p>The version that has growth halving over 18 months did worse than the plain rule beyond three months for both companies, because neither has slowed on a twelve-month view yet. Anthropic has slowed for a few months before: its monthly growth fell from about 40% to about 12% during 2025, then picked up again in early 2026.</p>
<h2>OpenAI’s plans land; Anthropic’s haven’t</h2>
<figure><a href="https://06.ai/packs/ai-lab-revenue#plans"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-05.png" alt="OpenAI’s plans land; Anthropic’s haven’t" width="694" height="500"></a><figcaption>What happened, divided by what the company projected, log scale. Open circles compare a plan with our 2026 estimates. Two projections were made partway through the period they cover: September 2024 for 2024 revenue and May 2026 for the second quarter.</figcaption></figure>
<p>OpenAI hit its 2024 revenue plan exactly and its 2025 plans within 3–13%. On its own latest forecast of about $35B, it will beat the 2026 plans it had in 2025 by 17–19% (about 25% on our estimate). Only its earliest pitch was far off: in late 2022 it told investors it would make $1B in 2024, and it made $3.7B. Anthropic’s projections a year out have been too low, mostly by a lot: its 2025 base case was less than half what it booked, and in October 2025 its internal base case for its 2026 run-rate was $20B. Its short-range calls held up: it projected $9B for the end of 2025 and got $9B, and its second-quarter projection was within 6%. Its one miss on the high side was its first: a $200M pace by the end of 2023, against $87M at the start of 2024.</p>
<h2>OpenRouter tracks Anthropic, with big swings in share</h2>
<figure><a href="https://06.ai/packs/ai-lab-revenue#openrouter"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-06.png" alt="OpenRouter tracks Anthropic, with big swings in share" width="694" height="307"></a><figcaption>Left: Anthropic’s share of estimated spend through OpenRouter, by month; October is the 1st–18th. Right: Anthropic’s run-rate if its OpenRouter spend follows the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s base case for the whole market at three different shares, against our base case.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-lab-revenue#openrouter"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-07.png" alt="Holds at October’s level — Share: 37% · Run-rate: $350B; Settles at 30% — Share: 30% · Run-rate: $285B; Keeps falling at 2026’s pace — Share: 19% · Run-rate: $180B; Our base case implies — Share: 28% · Run-rate: $265B" width="694" height="229"></a></figure>
<h2>A read on Anthropic, not on OpenAI</h2>
<p>Spend on Anthropic’s models through OpenRouter has run at 1.5–2.1% of its revenue each quarter since the end of 2025. Scaling each quarter’s OpenRouter spend by the previous quarter’s ratio would have called Anthropic’s revenue within 12–17% in four of the last five quarters and been 29% off in the fifth (the two 2025 quarters are our estimates from annual revenue). It can’t do the same for OpenAI, whose revenue comes mostly from ChatGPT and from businesses buying directly, which OpenRouter doesn’t see.</p>
<p>The swing factor is Anthropic’s share. It held at 54–62% of OpenRouter’s dollars from January to July, fell to 42% in August as its own spend there dropped, and to 28% in September as OpenAI’s GPT-5.6 and GPT-6 models took share. It recovered to 37% in October after Anthropic released Opus 5.5 and Sonnet 5.5 in late September and Haiku 5.5 in early October. Opus 5.5 alone is drawing more spend than Opus 5 ever did, at lower prices: $4 and $20 per million input and output tokens, against $5 and $25. Revenue moves less than this share does: in August and September, Anthropic’s spend through OpenRouter ran about 30% below July’s while its run-rate kept rising.</p>
<p><a href="https://06.ai/packs/ai-demand">The </a><a href="https://06.ai/packs/ai-demand">AI-demand</a><a href="https://06.ai/packs/ai-demand"> pack</a>’s base case has spend through OpenRouter growing 4.2× from October to December 2027. If Anthropic held its October share, that would put its run-rate near $350B; if its share settled at 30%, about $285B; if it kept falling at this year’s pace, about $180B. Our base case of $265B implies a share near 28%, about where it was at its September low.</p>
<h2>How fast growth fades decides 2027</h2>
<p>Run-rate in December 2027 if each company’s growth rate entering 2027 in our base case (about 13% a month for OpenAI and 11% for Anthropic) halves at different speeds.</p>
<figure><a href="https://06.ai/packs/ai-lab-revenue#forecast"><img src="https://06.ai/newsletter/ai-lab-revenue/fig-08.png" alt="Every 6 months — OpenAI: $155B · Anthropic: $195B; Every 12 months — OpenAI: $205B · Anthropic: $240B; Every 18 months (base) — OpenAI: $230B · Anthropic: $265B; Never — OpenAI: $305B · Anthropic: $340B" width="694" height="229"></a></figure>
<h2>The forecast</h2>
<p><strong>End of 2026.</strong> OpenAI expects to reach or exceed a $70B run-rate. It beat its end-2025 target by 7%, and the trend rule says $70B. We use $72B. For Anthropic, October’s spend through OpenRouter implies a run-rate of about $84B at this year’s average quarterly ratio (1.8%), and about $80B if October behaves like June, the last month with a launch-driven jump of the same size. We take $83B. Growth of about 10% a month from there reaches $100B in December, with about $22B of fourth-quarter revenue. That is at the top of what the FT reported after Anthropic’s investor day, an annualized figure below $100B, and short of the $110B analysts said was possible.</p>
<p><strong>2027.</strong> For OpenAI we assume its growth rate in December 2026, about 13% a month, halves every 18 months. That gives about $230B in December 2027. For Anthropic we take the midpoint of two methods. The same rule, applied to its growth of about 10% a month late in 2026, gives $245B. OpenRouter gives $285B if Anthropic’s share of spend there settles at 30% while the market follows the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s base case. The midpoint, $265B, is what you get if Anthropic enters 2027 growing about 11% a month and that rate halves every 18 months. The ranges come from varying the year-end level, the starting growth rate and the fade, from halving every 6 months to every 4½ years. On OpenAI’s accounting Anthropic would be about $245B, a little ahead of OpenAI.</p>
<p>For OpenAI, history leans to the upside: a rule that had its growth halving over 18 months ran 23–35% low eight to 18 months out. For Anthropic it cuts both ways: rules built on its trailing growth were far too low until mid-2026 and are far too high now. Scale argues for caution. Each company would add roughly $155–165B of run-rate in 2027, more than either has added in a year so far, and both depend on compute arriving on schedule. Anthropic’s own IPO projection, $190–200B of revenue in 2028, implies about $140B at the end of 2027 if its growth fades as in our base case. It has beaten every longer-range projection it has made since the start of 2025.</p>
<h2>What to watch</h2>
<p><strong>Anthropic on OpenRouter in November.</strong> If spend holds near the $4.5–5M a day it has averaged since October 6, the October jump was real demand and $100B by December looks low. If it falls back by a third or more, as it did in late July, $85–90B is more likely.</p>
<p><strong>OpenAI’s third-quarter revenue.</strong> Our fitted path says about $10.1B. Much less would mean the run-rate figures ran ahead of revenue.</p>
<p><strong>Anthropic’s prospectus.</strong> If Anthropic goes ahead with its IPO, the public filing should show quarterly revenue on one definition, next to the run-rates it has been quoting.</p>
<h2>What this is anchored on</h2>
<p>Run-rates and revenue are as reported; fitted paths, back-tests, OpenRouter spend and forecasts are our estimates. All 40 figures used in the fit are listed below with their sources.</p>
<ul><li><strong>OpenAI</strong> — About $50B run-rate at the end of September on OpenAI’s own (net) basis; the ~$70B figure came from investors applying Anthropic’s gross method; expects to reach or exceed $70B by the end of 2026 · <a href="https://www.bloomberglinea.com/negocios/openai-preve-superar-los-us70000-millones-en-ingresos-anualizados-a-finales-de-2026/">Bloomberg, via Bloomberg Línea, Oct 9</a></li><li><strong>OpenAI</strong> — About $50B at the end of September, less than the ~$70B previously indicated to investors · <a href="https://www.thestandard.com.hk/finance/article/345035/OpenAIs-September-annualized-revenue-nears-US50-billion-less-than-previously-indicated-source-says">Reuters, citing the FT, via The Standard, Oct 8</a></li><li><strong>OpenAI</strong> — Run-rate grew 70% from the end of June to the end of September (The Information, citing the CFO); enterprise sales driving most of the growth (Bloomberg) · <a href="https://thenextweb.com/news/openai-revenue-70bn-year-end-50bn-september">The Next Web, Oct 9</a></li><li><strong>OpenAI</strong> — Full-year 2026 revenue of around $35B · <a href="https://aiweekly.co/alerts/anthropic-books-gross-cloud-sales-openai-only-its-net-share">Bloomberg, via AI Weekly</a></li><li><strong>OpenAI</strong> — Annual recurring revenue “nearing $70 billion” · <a href="https://www.axios.com/2026/09/29/scoop-openais-annual-recurring-revenue-nears-70b">Axios, Sep 29</a></li><li><strong>OpenAI</strong> — More than $40B run-rate in mid-August · <a href="https://investinglive.com/stocks/openai-s-annualized-revenue-run-rate-has-surpassed-40-billion-says-a-bloomberg-report/">Bloomberg, via investingLive, Aug 13</a></li><li><strong>OpenAI</strong> — $2B of revenue a month (March 2026) · <a href="https://openai.com/index/accelerating-the-next-phase-ai/">OpenAI, Mar 31</a></li><li><strong>OpenAI</strong> — $21.4B run-rate at the end of 2025; more than $25B at the end of February · <a href="https://www.techloy.com/openai-hits-25-billion-in-annualized-revenue-while-anthropic-surges-to-19-billion/">The Information, via Techloy, Mar 5</a></li><li><strong>OpenAI</strong> — Revenue $5.7B in Q1 2026 · <a href="https://thenextweb.com/news/openai-burned-3-7-billion-q1-2026">The Information, via The Next Web, Jun 17</a></li><li><strong>OpenAI</strong> — Revenue $6.7B in Q2 2026 · <a href="https://aiweekly.co/alerts/wsj-openai-q2-revenue-grew-18-qoq-to-67b-as-operating-margin-sank-further">Wall Street Journal, via AI Weekly, Aug 18</a></li><li><strong>OpenAI</strong> — Audited revenue: $3.7B in 2024, $13.07B in 2025 · <a href="https://wheresyoured.at/exclusive-openai-financials">Where’s Your Ed At (verified by the FT), Jun 15</a></li><li><strong>OpenAI</strong> — Projected revenue of $12.7B for 2025 and $29.4B for 2026 (March 2025) · <a href="https://www.advisorperspectives.com/articles/2025/03/27/openai-revenue-triple-12-7-billion-year">Bloomberg, via Advisor Perspectives</a></li><li><strong>Anthropic</strong> — Revenue $16.8B in Q3 2026, up about 45% from Q2 · <a href="https://thenextweb.com/news/anthropic-q3-revenue-16-8bn-ipo">Financial Times, via The Next Web, Oct 14</a></li><li><strong>Anthropic</strong> — Revenue $4.7B in Q1 2026 and $11.6B in Q2 · <a href="https://www.businessday.co.za/world/international-companies/2026-10-15-anthropic-revenue-jumps-45-to-168bn/">Reuters, via BusinessDay, Oct 15</a></li><li><strong>Anthropic</strong> — Run-rate of $65B at the end of July · <a href="https://news.bgov.com/financial-accounting/anthropic-revenue-run-rate-surpasses-65-billion-ahead-of-ipo">Bloomberg, via Bloomberg Government, Aug 17</a></li><li><strong>Anthropic</strong> — Run-rate of $14B · <a href="https://www.anthropic.com/news/anthropic-raises-30-billion-series-g-funding-380-billion-post-money-valuation">Anthropic, Series G announcement, Feb 12</a></li><li><strong>Anthropic</strong> — Run-rate above $30B, up from about $9B at the end of 2025 · <a href="https://www.anthropic.com/news/google-broadcom-partnership-compute">Anthropic, Apr 6</a></li><li><strong>Anthropic</strong> — Run-rate crossed $47B in early May · <a href="https://www.anthropic.com/news/series-h">Anthropic, Series H announcement, May 28</a></li><li><strong>Anthropic</strong> — Revenue of about $386M in 2024 and $4.59B in 2025 (draft IPO prospectus) · <a href="https://www.tradingkey.com/analysis/stocks/us-stocks/262190854-anthropic-ipo-prospectus-revealed-tradingkey">Reuters, via TradingKey, Sep 29</a></li><li><strong>Anthropic</strong> — Revenue of nearly $4.6B in 2025; cloud-marketplace sales booked in full, with the partners’ cut as an expense · <a href="https://www.khaleejtimes.com/business/anthropic-ipo-prospectus-lays-bare-deep-dependence-on-big-tech-partners">Reuters, via Khaleej Times, Sep 30</a></li><li><strong>Anthropic</strong> — Internal base case of $20B of annualized revenue for 2026, best case $26B (October 2025) · <a href="https://finance.yahoo.com/news/exclusive-anthropic-aims-nearly-triple-170234463.html">Reuters, via Yahoo Finance, Oct 15, 2025</a></li><li><strong>Anthropic</strong> — Projected 2026 revenue of $18B (January 2026) · <a href="https://www.investing.com/news/stock-market-news/anthropic-ups-2026-revenue-forecast-delays-cashpositive-target--the-information-4469111">The Information, via Investing.com, Jan 27</a></li><li><strong>Anthropic</strong> — 2028 revenue of roughly $190–200B underpinning the IPO valuation · <a href="https://finance.yahoo.com/technology/ai/articles/exclusive-anthropic-ipo-valuation-hinges-001158885.html">Reuters, via Yahoo Finance, Aug 14</a></li><li><strong>Anthropic</strong> — Annualized revenue expected to stay below $100B · <a href="https://finance.yahoo.com/technology/ai/articles/anthropic-reports-45-revenue-growth-102235753.html">Financial Times, via Yahoo Finance, Oct 15</a></li><li><strong>Anthropic</strong> — Analysts who met executives: run-rate “could reach $110 billion by the end of the year” · <a href="https://www.calcalistech.com/ctechnews/article/tgb6eqw4z">Reuters, via Calcalist, Oct 15</a></li><li><strong>Anthropic</strong> — About $74B annualized in October (third-party estimate) · <a href="https://www.implicator.ai/anthropic-tells-investors-q3-revenue-hit-16-8-billion-as-growth-slowed-to-45/">SemiAnalysis, via Implicator, Oct 15</a></li><li><strong>OpenRouter</strong> — Daily tokens by model, Jan 1, 2025–Oct 18, 2026; spend is our estimate at catalog prices (see the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack) · <a href="https://openrouter.ai/rankings">OpenRouter rankings. Licensed under CC BY 4.0</a></li><li><strong>OpenRouter</strong> — List prices, including Opus 5.5 at $4 and $20 per million input and output tokens and Opus 5 at $5 and $25 · <a href="https://openrouter.ai/docs/api/api-reference/endpoints/list-all-endpoints-for-a-model.md">OpenRouter models API, Oct 19</a></li></ul>
<h2>Method</h2>
<p><strong>Figures.</strong> We collected 145 reported figures on the two companies’ revenue, run-rates, projections and users, with a link for each. Of these, 80 give a run-rate or revenue for a period; we fit 40, dropping repeats of the same figure, later restatements and figures on a different basis. Third-party estimates are shown but not fitted. OpenAI’s 2024 and 2025 full-year revenue includes items its run-rate figures leave out, so we don’t fit it. Each figure is placed on the date it describes; the back-test uses the date it was first reported.</p>
<p><strong>Fitted paths.</strong> Each company’s log run-rate is a piecewise-linear curve with knots every half month and a penalty on curvature. Run-rates are fitted as points; quarterly and annual revenue as the integral of run-rate ÷ 12 over the period, weighted more heavily because they are booked numbers. Monthly growth in the second chart is month-end to month-end on these paths.</p>
<p><strong>Back-test.</strong> At each month-end from March 2024 (January 2025 for Anthropic) to September 2026, a rule sees only figures reported by then. Its level is the latest figure (quarterly revenue counts as four times itself at mid-quarter) and its growth is the average over the previous 12 months, held constant or halving over n months. It is scored against every fitted run-rate and quarterly revenue figure dated up to 18 months later, as forecast ÷ outcome − 1.</p>
<p><strong>Plans</strong> compare projections with what was later reported. Two were made partway through the period they cover: September 2024 for 2024 revenue and May 2026 for the second quarter. 2026 outcomes are our estimates.</p>
<p><strong>OpenRouter.</strong> Spend on each lab’s models is estimated as in the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack, at catalog prices. The share is Anthropic’s spend over all spend. The scenarios scale the <a href="https://06.ai/packs/ai-demand">AI-demand</a> pack’s base path for total spend by Anthropic’s share, moving geometrically from October’s level to the end value, and convert spend to run-rate at October’s ratio.</p>
<p><strong>Forecast.</strong> End-2026: OpenAI from its own target; Anthropic from an October run-rate of about $83B, between a launch-month reading of OpenRouter and its quarterly average ratio, then about 10% a month. 2027: growth halves every 18 months, g(t) = g₀ × 2<sup>−t/18</sup>. For OpenAI g₀ is its December 2026 growth; for Anthropic it is set so December 2027 lands midway between that rule applied to its late-2026 growth and the OpenRouter lens with a 30% share. The 80% ranges simulate the year-end level (±7% for OpenAI and ±10% for Anthropic at one standard deviation), the starting growth (±25%) and a half-life between 6 and 54 months. Run-rates are each company’s own: Anthropic books sales through cloud marketplaces in full and pays the partners’ cut as an expense, about 16% of those sales, which were 47% of its 2025 revenue; we put Anthropic about 7.5% lower on OpenAI’s net method.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>How fast is AI demand growing?</title>
  <link>https://06.ai/packs/ai-demand</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-demand</guid>
  <pubDate>Sun, 18 Oct 2026 12:07:00 GMT</pubDate>
  <description>OpenRouter publishes daily token counts for the models it routes. Tokens are up 33× in a year and spend about 11× since January. What’s driving it, who captures it, and three paths for 2027.</description>
  <category>AI demand</category>
  <enclosure url="https://06.ai/newsletter/ai-demand/cover.png" length="54682" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-demand/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-demand"><img src="https://06.ai/newsletter/ai-demand/thumb.png" alt="How fast is AI demand growing?" width="421" height="415"></a><figcaption><a href="https://06.ai/packs/ai-demand">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>OpenRouter routed <strong>23.8T tokens a day</strong> in October, 33× as many as a year earlier. We estimate its customers are spending about <strong>$4.2B a year</strong> on them, 11× January’s pace. Tokens are growing faster than dollars, Chinese models supply most of the tokens while US labs collect most of the dollars, and most tokens go to code and agent work.</p>
<ul><li><strong>23.8T</strong> — Tokens a day, October. 33× October 2025. 2.2 quadrillion so far this year, against OpenRouter’s May forecast of more than 1 quadrillion for all of 2026</li><li><strong>$4.2B</strong> — Annualized spend, October. Our estimate of what customers spend through OpenRouter, 11× January. About $230M a year of fees for OpenRouter at 5.5%</li><li><strong>$0.48</strong> — Average price, million tokens. October, against $0.96 in the first half, as cheaper models took share</li><li><strong>73K</strong> — Tokens per request, top 100 apps. 5.4× January. Agents re-send their working context at every step</li></ul>
<h2>Tokens: 33× in a year</h2>
<figure><a href="https://06.ai/packs/ai-demand#tokens"><img src="https://06.ai/newsletter/ai-demand/fig-01.png" alt="Tokens: 33× in a year" width="694" height="442"></a><figcaption>Tokens a week by where each model’s developer is based, January 2025 to October 18, 2026. Other is the rest of the world, stealth models and OpenRouter’s long-tail row. Each model’s tokens are counted with its own tokenizer. Shown: Stacked.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-demand#tokens"><img src="https://06.ai/newsletter/ai-demand/fig-02.png" alt="Tokens: 33× in a year — Log scale" width="694" height="473"></a><figcaption><strong>Log scale.</strong></figcaption></figure>
<h2>What OpenRouter can see</h2>
<p>OpenRouter sells access to more than 400 models through one API and publishes the daily token count of the 50 biggest, plus a single row for everything else. It sees developers, startups and agent tools. It doesn’t see ChatGPT’s subscribers or companies that call OpenAI and Anthropic directly, and its public counts leave out private and zero-data-retention traffic. So it is a slice: about $4.2B a year of spend, against roughly $120–140B of annualized revenue at OpenAI and Anthropic combined, depending on how OpenAI’s revenue is counted. But it is one of the few public daily counts of AI demand, and it has been growing faster than Google, which gives a figure from time to time. Google said in May it was processing 3.2 quadrillion tokens a month, 7× a year earlier. OpenRouter grew 12× over the same twelve months.</p>
<h2>Tokens up 23× this year, dollars 11×</h2>
<p>Since January, daily tokens are up 23× and our estimate of spend 11×. The difference is price. The average million tokens cost $0.96 in the first half of the year and $0.48 in October. We price every model at today’s list price, so the whole fall is mix: cheap models, above all from DeepSeek and Z.ai, took share. At the first half’s average price, October’s tokens would be worth $8.3B a year, not $4.2B.</p>
<p>Dollars are also where growth has started to slow. Spend grew 30% a month from April to July and 21% a month from July to October. Tokens went the other way, from 35% to 48%.</p>
<h2>Dollars are growing more slowly than tokens</h2>
<figure><a href="https://06.ai/packs/ai-demand#spend"><img src="https://06.ai/newsletter/ai-demand/fig-03.png" alt="Dollars are growing more slowly than tokens" width="694" height="422"></a><figcaption>Estimated spend through OpenRouter, annualized from each week, log scale. Dots are Sacra’s estimates of OpenRouter’s revenue divided by its 5.5% fee; July’s is the one we calibrate to. The gray line prices each week’s tokens at the first half’s average. Shading runs to the last week in which more than a tenth of tokens came from models no longer in OpenRouter’s price list.</figcaption></figure>
<h2>Chinese models supply the tokens; US labs collect the dollars</h2>
<figure><a href="https://06.ai/packs/ai-demand#labs"><img src="https://06.ai/newsletter/ai-demand/fig-04.png" alt="Chinese models supply the tokens; US labs collect the dollars" width="694" height="512"></a><figcaption>Share of tokens and of estimated spend, September 21 to October 18. For Chinese labs, “serves” is how much of the spend on their models goes to the lab’s own API; the rest goes to other hosts. Free &amp; stealth is free versions and unreleased models, counted at $0.</figcaption></figure>
<h2>China’s tokens, America’s dollars</h2>
<p>Models from Chinese labs first passed US models in weekly tokens in the week of March 23 and have led every week since April 27. Over the past four weeks they were 57% of tokens (64% last week) and 26% of estimated spend. DeepSeek is the biggest lab by tokens, with 26%, and takes 4% of the dollars. Anthropic has 5% of the tokens and 35% of the dollars; OpenAI 9% and 26%. Between them, the two take 61% of the dollars from 14% of the tokens.</p>
<p>Much of what is spent on Chinese models doesn’t reach Chinese labs either. Their models are open-weight, so anyone can host them: 28 providers serve the September version of DeepSeek V4.1-Flash, its most-used model, and DeepSeek isn’t one of them. On a snapshot of where requests go, DeepSeek serves 9% of the spend on its own models, Z.ai 6% and Moonshot 10%. The rest goes to hosts such as Together, DeepInfra and Baseten. Tencent, Xiaomi and MiniMax keep most of theirs.</p>
<p>Those hosts often charge more than the single price OpenRouter lists for a model, which is the one we use. Weighting each host’s price by its share of requests in the same snapshot would add about 17% to October’s spend, most of it on Chinese models, and lift their share of the dollars to about 37%. We leave that out of our figures because a 30-minute snapshot can’t be applied to earlier months.</p>
<h2>Agents are the demand</h2>
<p>The average request from OpenRouter’s 100 biggest apps carried 73,000 tokens in October, against 13,000 in January. Coding agents re-send their working context at every step, so one task can run to millions of tokens. Hermes Agent, Claude Code, Kilo Code and Cline are the four biggest apps, and OpenRouter classifies 63% of last week’s tokens as code or agent work. Roleplay, about a third of tokens in mid-2025, is down to about 5%.</p>
<p>Agents also make dollars harder to measure. Much of what they send is context they have sent before, which providers bill at cached rates, often a tenth of the input price or less. The cached share is the biggest unknown in our spend estimate; matching Sacra’s July revenue figure implies about 51% of input.</p>
<h2>Free tokens are a launch strategy</h2>
<p>Labs buy demand on OpenRouter with free models. Free versions and stealth models, released under code names before launch, were 15% of tokens over the past four weeks and peaked at 31% in April 2025. Z.ai ran GLM-5.3-Flash as “Ox Alpha” for a week in August; on August 24, OpenRouter said it was on track for nearly 6 trillion tokens that day. A model called Space Bunny Alpha has done 57 trillion tokens in the past 30 days without its maker being named. We count all of it at $0, which is why tokens and dollars can diverge sharply within a month.</p>
<h2>Requests got five times bigger</h2>
<figure><a href="https://06.ai/packs/ai-demand#agents"><img src="https://06.ai/newsletter/ai-demand/fig-05.png" alt="Requests got five times bigger" width="694" height="323"></a><figcaption>Left: tokens per request across the 100 biggest apps each month; labels mark when a new app became the biggest. October is the 1st–18th. Right: OpenRouter’s sampled estimates of each category’s share of tokens, four-week averages; categories can overlap, and the latest two weeks are still being classified and are left out.</figcaption></figure>
<h2>Spend on Anthropic’s models through OpenRouter has tracked its revenue</h2>
<figure><a href="https://06.ai/packs/ai-demand#anthropic"><img src="https://06.ai/newsletter/ai-demand/fig-06.png" alt="Spend on Anthropic’s models through OpenRouter has tracked its revenue" width="694" height="312"></a><figcaption>Anthropic’s reported revenue and our estimate of spend on its models through OpenRouter, each indexed to Q1 = 1. Q4 is October 1–18 at a full-quarter pace.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-demand#anthropic"><img src="https://06.ai/newsletter/ai-demand/fig-07.png" alt="Q1 2026 — Revenue: $4.7B · On OpenRouter: $83M · Share: 1.8%; Q2 2026 — Revenue: $11.5B · On OpenRouter: $238M · Share: 2.1%; Q3 2026 — Revenue: $16.8B · On OpenRouter: $285M · Share: 1.7%; Q4, Oct 1–18 pace — Revenue: $19–23B implied · On OpenRouter: $388M" width="694" height="230"></a></figure>
<h2>A read on Anthropic</h2>
<p>Spend on Anthropic’s models through OpenRouter was 1.8% of its reported revenue in the first quarter, 2.1% in the second and 1.7% in the third. In October so far it is running 36% above the third quarter’s pace. If OpenRouter’s share stays in that range, Anthropic is on course for $19–23B of revenue in the fourth quarter, against $16.8B in the third. That is the quarter in which it plans to list; bankers are reported to be pricing the IPO on $190–200B of revenue in 2028. Anthropic released Opus 5.5 and Sonnet 5.5 in late September and Haiku 5.5 in October, and launch weeks can pull spend forward.</p>
<p>OpenAI is different. Spend on its models through OpenRouter grew 4× from the first quarter to the second and 13× by the third, while its reported revenue grew 18% from the first quarter to the second. OpenRouter is not a read on OpenAI.</p>
<h2>Three paths for 2027</h2>
<figure><a href="https://06.ai/packs/ai-demand#forecast"><img src="https://06.ai/newsletter/ai-demand/fig-08.png" alt="Three paths for 2027" width="694" height="412"></a><figcaption>By month, log scale; October is the 1st–18th. Projections start from the past quarter’s monthly growth (21% for dollars, 48% for tokens) and assume that rate halves every few months. Move the slider to choose how many. Shown: Dollars.</figcaption></figure>
<p><em>At the default setting (Growth halves every 6 months), from the </em><a href="https://06.ai/packs/ai-demand#forecast"><em>interactive version</em></a><em>:</em></p>
<ul><li>Spend in December 2027, a year: <strong>$18B</strong></li><li>Multiple of October: <strong>4.2×</strong></li><li>OpenRouter fees at 5.5%: <strong>$1.0B</strong></li><li>Monthly growth by then: <strong>4.7%</strong></li></ul>
<figure><a href="https://06.ai/packs/ai-demand#forecast"><img src="https://06.ai/newsletter/ai-demand/fig-09.png" alt="3 months — Dec 2026: $5.9B · Jun 2027: $9.3B · Dec 2027: $10B · Tokens a day, Dec 2027: 171T; 6 months (base) — Dec 2026: $6.0B · Jun 2027: $12B · Dec 2027: $18B · Tokens a day, Dec 2027: 513T; 12 months — Dec 2026: $6.1B · Jun 2027: $15B · Dec 2027: $29B · Tokens a day, Dec 2027: 1,350T" width="694" height="189"></a></figure>
<figure><a href="https://06.ai/packs/ai-demand#forecast"><img src="https://06.ai/newsletter/ai-demand/fig-10.png" alt="Three paths for 2027 — Tokens" width="694" height="442"></a><figcaption><strong>Tokens.</strong></figcaption></figure>
<h2>The forecast</h2>
<p>Spend growth on OpenRouter slowed from 30% a month to 21% between the last two quarters. That is what a growth rate halving about every 6 months looks like, and it is our base case. On it, spend reaches about $18B a year by December 2027, 4.2× today’s, and is still growing about 5% a month. If growth halves every three months, spend levels off near $10B; if it halves only once a year, it reaches about $29B. Even the low case is 2.5× today’s. The high case needs another wave like 2026’s, with agents spreading from coding into other work.</p>
<p>The token paths are steeper because tokens have been growing faster than dollars. In the base case OpenRouter handles about 513T tokens a day by the end of 2027 at about $0.09 per million. That only happens if cheap models keep taking share.</p>
<p>The three paths barely differ over the next quarter: spend grows 60% to 72% from October to January on all of them. They separate during 2027, so the early quarters won’t settle which one we’re on.</p>
<h2>What it means for the earlier packs</h2>
<p><a href="https://06.ai/packs/ai-funding-scale">The </a><a href="https://06.ai/packs/ai-funding-scale">funding-scale</a><a href="https://06.ai/packs/ai-funding-scale"> pack</a> adds up to about $1.54T of debt and equity that the buildout needs through 2030. On OpenRouter, demand is not the constraint: spend is growing about 21% a month and tokens about 48%.</p>
<p>What changes is what a dollar buys. A dollar spent on OpenRouter buys 2.0× as many tokens as it did in the first half, because the mix has moved to cheaper models. This data can’t say how much of that is cheaper serving and how much is thinner margins; the models taking share are smaller, so some of it is efficiency. <a href="https://06.ai/packs/token-prices">The </a><a href="https://06.ai/packs/token-prices">token-price</a><a href="https://06.ai/packs/token-prices"> pack</a> found the same pattern in list prices: the price of a top-tier token has held while everything below it falls. It is why the labs’ share of the dollars matters more than their share of the tokens: Anthropic and OpenAI take 61% of the dollars from 14% of the tokens.</p>
<h2>What to watch</h2>
<p><strong>The dollar growth rate in the spring.</strong> Average monthly growth from December to March of about 11% would put spend on the low path, 15% on the base path and 18% on the high one. Single months are noisy: spend fell 2% in August and rose 47% in September.</p>
<p><strong>Anthropic’s share.</strong> If OpenRouter stays near 1.7–2.1% of Anthropic’s revenue, it is a weekly read on Anthropic’s growth ahead of its IPO.</p>
<p><strong>Free and stealth tokens.</strong> When they spike, token counts overstate demand.</p>
<p><strong>Who hosts the open models.</strong> DeepSeek serves 64% of requests for its new V4.1-Flash-1017 itself, against none of the September version. Chinese labs taking back hosting would move dollars back to them.</p>
<h2>What this is anchored on</h2>
<p>Source: OpenRouter (openrouter.ai/rankings), as of 2026-10-19. Licensed under CC BY 4.0. Spend, prices per token and forecasts are our estimates.</p>
<ul><li><strong>Tokens</strong> — Daily tokens for the 50 biggest models plus one row for the rest, Jan 1, 2025–Oct 18, 2026; prompt plus completion, counted with each provider’s tokenizer; public traffic only · <a href="https://openrouter.ai/rankings">OpenRouter rankings-daily dataset, as of 2026-10-19 01:29 UTC. Licensed under CC BY 4.0</a></li><li><strong>Prices</strong> — List price of every model, and of every host serving it, with each host’s requests over the 30 minutes to 01:30 UTC, Oct 19 · <a href="https://openrouter.ai/docs/api/api-reference/endpoints/list-all-endpoints-for-a-model.md">OpenRouter models and endpoints APIs</a></li><li><strong>Use and apps</strong> — Weekly token estimates by category (sampled); tokens and requests of the 100 biggest apps each month; 7-day task classification · <a href="https://openrouter.ai/docs/cookbook/administration/data-api">OpenRouter Data API. Licensed under CC BY 4.0</a></li><li><strong>OpenRouter revenue</strong> — About $19M annualized at the end of 2025 and $50M in March 2026 · <a href="https://sacra.com/research/3t-token-coinbase-of-the-inference-economy/">Sacra, Jun 1</a></li><li><strong>OpenRouter revenue</strong> — $140M annualized in July 2026 and $160M in August (estimates; OpenRouter doesn’t disclose revenue) · <a href="https://sacra.com/c/openrouter/">Sacra</a></li><li><strong>OpenRouter fee</strong> — 5.5% on pay-as-you-go credit purchases · <a href="https://openrouter.ai/blog/tutorials/how-to-get-the-lowest-cost-llm-inference-on-openrouter/">OpenRouter</a></li><li><strong>OpenRouter volume</strong> — 25T tokens a week at the May 26 Series B · <a href="https://pulse2.com/openrouter-113-million-raised-for-ai-model-exchange-platform-as-weekly-volume-reaches-25-trillion-tokens/amp/">Pulse 2.0, May 26</a></li><li><strong>OpenRouter volume</strong> — Forecast at the Series B of more than 1 quadrillion tokens for 2026 · <a href="https://www.implicator.ai/stripe-openrouter-10-billion-talks/">Implicator, Jul 24</a></li><li><strong>Google</strong> — More than 3.2 quadrillion tokens a month across its products, 7× a year earlier · <a href="https://blog.google/innovation-and-ai/sundar-pichai-io-2026/">Google, May 19</a></li><li><strong>Anthropic</strong> — Revenue $4.73B in Q1 2026 and more than $11.5B in Q2 (preliminary) · <a href="https://thenextweb.com/news/anthropic-q2-2026-revenue-11-5-billion-operating-income">Bloomberg, via The Next Web, Aug 15</a></li><li><strong>Anthropic</strong> — Revenue $16.8B in Q3 2026 · <a href="https://www.khaleejtimes.com/business/anthropic-says-revenue-jumped-to-nearly-17b-last-quarter-reports-2">AFP, via Khaleej Times, Oct 15</a></li><li><strong>Anthropic</strong> — IPO targeted for mid-to-late November; bankers reported to be pricing it on ~$190–200B of 2028 revenue · <a href="https://www.thestar.com.my/tech/tech-news/2026/08/15/exclusive-anthropic-ipo-valuation-hinges-on-190-200-billion-2028-revenue-forecast-sources-say">Bloomberg, Oct 1; Reuters, Aug 14</a></li><li><strong>OpenAI</strong> — Revenue $5.7B in Q1 2026 and $6.7B in Q2 · <a href="https://thenextweb.com/news/openai-burned-3-7-billion-q1-2026">The Information, via The Next Web; WSJ</a></li><li><strong>Ox Alpha</strong> — Stealth model revealed as Z.ai’s GLM-5.3-Flash on Aug 26; OpenRouter said it was on track for nearly 6T tokens on Aug 24 · <a href="https://www.digitalapplied.com/blog/openrouter-usage-charts-what-they-measure">Digital Applied; Pasquale Pillitteri</a></li></ul>
<h2>Method</h2>
<p><strong>Tokens</strong> come from OpenRouter’s rankings-daily dataset: the 50 biggest models each UTC day plus one row for the rest, prompt plus completion tokens counted with each provider’s tokenizer. It covers public traffic only. Weeks run Monday to Sunday. June 15 and July 15, 2025 are missing from the dataset and are filled with the average of the days either side. Region is the developer’s home country; Ox Alpha is counted as Z.ai’s, and developers we couldn’t place are in Other.</p>
<p><strong>Spend</strong> prices each model’s tokens at its standard catalog price; variants such as batch are priced as themselves, and free versions and stealth models at $0. We assume 10% of tokens are output and 51% of input is billed at cached rates, the share that reproduces Sacra’s $140M estimate of OpenRouter’s July revenue at its 5.5% fee. The level of spend depends on that assumption; growth rates and shares much less. The catalog price is often the cheapest host’s: weighting hosts’ prices by their share of requests in a 30-minute snapshot on October 19 would add about 17% to October’s spend, mostly on Chinese models. We leave it out because it can’t be applied to earlier months. Before May 2026, 10–27% of tokens came from models no longer in the price list; they are priced at the median for their lab.</p>
<p><strong>The gray line</strong> prices every week’s tokens at the first half’s average of $0.96 per million.</p>
<p><strong>Anthropic and OpenAI</strong> compare estimated spend on each lab’s models through OpenRouter, by calendar quarter, with reported revenue. Q4 scales October 1–18 to a full quarter.</p>
<p><strong>Apps</strong> divide total tokens by total requests across the 100 biggest apps in each calendar month. <strong>Categories</strong> are OpenRouter’s sampled weekly estimates, which can overlap.</p>
<p><strong>The forecast</strong> starts from the October 1–18 level and the monthly growth between July’s average and October’s, 2.8 months apart: 20.9% for dollars and 47.7% for tokens. That rate then halves every n months: growth in month m is g × 2<sup>−(m−1)/n</sup>. The half-life is the main assumption; the slowdown in dollar growth between the last two quarters implies 5.7 months. It inherits the spend method’s assumptions, and the token paths assume the mix keeps moving to cheaper models.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Who sets the price of a token?</title>
  <link>https://06.ai/packs/token-prices</link>
  <guid isPermaLink="true">https://06.ai/packs/token-prices</guid>
  <pubDate>Sat, 17 Oct 2026 12:06:00 GMT</pubDate>
  <description>DeepSeek’s newest model claims top-tier scores on agentic coding at OpenAI’s budget-tier price. What earlier DeepSeek releases did to US token prices, and what this one might do.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/token-prices/cover.png" length="58054" type="image/png" />
  <media:content url="https://06.ai/newsletter/token-prices/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/token-prices"><img src="https://06.ai/newsletter/token-prices/thumb.png" alt="Who sets the price of a token?" width="421" height="391"></a><figcaption><a href="https://06.ai/packs/token-prices">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>DeepSeek’s V4.1-Flash-1017 costs <strong>$0.15</strong> per million input tokens and <strong>$0.60</strong> per million output tokens in US business hours, about what OpenAI charges for its cheapest model. On DeepSWE, DeepSeek’s headline coding benchmark, it scores above GPT-5.6 Sol and Claude Opus 5, which cost 33× to 42× more per output token.</p>
<ul><li><strong>$0.60</strong> — DeepSeek V4.1-Flash-1017, output. Per million tokens in US hours; input $0.15; $0.30 / $1.20 at peak</li><li><strong>33×</strong> — Cheaper than GPT-5.6 Sol. On output; 27× on input and 133× on cached input, at Sol’s discounted rate</li><li><strong>77.0</strong> — DeepSWE v1.1, DeepSeek’s figures. Claude Opus 5 74.0, GPT-5.6 Sol 73.0</li><li><strong>16B</strong> — Active parameters. Of 552B, when writing output; 8B when reading input</li></ul>
<h2>The price ladder</h2>
<figure><a href="https://06.ai/packs/token-prices#ladder"><img src="https://06.ai/newsletter/token-prices/fig-01.png" alt="The price ladder" width="694" height="408"></a><figcaption>Price per million output tokens, log scale. Filled dots are what a US customer pays today; hollow dots are DeepSeek’s peak-hour rate, Sol’s list price and Gemini Flash’s price after its launch discount ends. DeepSWE scores are DeepSeek’s figures, for the models in its table.</figcaption></figure>
<h2>The gap narrowed after R1, then widened again</h2>
<figure><a href="https://06.ai/packs/token-prices#history"><img src="https://06.ai/newsletter/token-prices/fig-02.png" alt="The gap narrowed after R1, then widened again" width="694" height="462"></a><figcaption>Launch price per million output tokens of each lab’s top model, log scale; DeepSeek at its peak rate. Dashed lines mark DeepSeek releases. Lines connect launches and skip versions at similar prices.</figcaption></figure>
<h2>What DeepSeek says you get for the price</h2>
<p>DeepSeek’s published table, 10 of the 11 benchmarks it reported. Bold marks the best score in each row. It beats GPT-5.6 Sol on 9 of 10 and Claude Opus 5 on 4 of 10; Opus 5 leads on the harder long-horizon tests. Prices are input / output per million tokens.</p>
<ul><li><strong>DeepSWE v1.1</strong> — DeepSeek V4.1-Flash-1017: 77.0 · DeepSeek V4.1-Flash (Sep): 74.2 · Kimi K3: 67.5 · GLM 5.3: 66.9 · GPT-5.6 Sol: 73.0 · Claude Opus 5: 74.0</li><li><strong>Terminal-Bench 4.0</strong> — DeepSeek V4.1-Flash-1017: 42.3 · DeepSeek V4.1-Flash (Sep): 31.2 · Kimi K3: 12.6 · GLM 5.3: 37.9 · GPT-5.6 Sol: 39.9 · Claude Opus 5: 51.8</li><li><strong>ProgramBench</strong> — DeepSeek V4.1-Flash-1017: 29.1 · DeepSeek V4.1-Flash (Sep): 20.3 · Kimi K3: 17.5 · GLM 5.3: 19.0 · GPT-5.6 Sol: 23.0 · Claude Opus 5: 37.0</li><li><strong>NL2Repo-Bench</strong> — DeepSeek V4.1-Flash-1017: 68.2 · DeepSeek V4.1-Flash (Sep): 65.4 · Kimi K3: 58.0 · GLM 5.3: 58.0 · GPT-5.6 Sol: 56.8 · Claude Opus 5: 75.3</li><li><strong>Automation-Bench v1.0.6</strong> — DeepSeek V4.1-Flash-1017: 60.5 · DeepSeek V4.1-Flash (Sep): 54.8 · Kimi K3: 46.7 · GLM 5.3: 48.8 · GPT-5.6 Sol: 45.8 · Claude Opus 5: 50.3</li><li><strong>Agents’ Last Exam</strong> — DeepSeek V4.1-Flash-1017: 35.4 · DeepSeek V4.1-Flash (Sep): 31.8 · Kimi K3: 27.6 · GLM 5.3: 28.5 · GPT-5.6 Sol: 26.7 · Claude Opus 5: 28.6</li><li><strong>Apex Bench v1.1</strong> — DeepSeek V4.1-Flash-1017: 72.1 · DeepSeek V4.1-Flash (Sep): 64.6 · Kimi K3: 47.8 · GLM 5.3: 56.6 · GPT-5.6 Sol: 54.3 · Claude Opus 5: 65.8</li><li><strong>HLE, no tools</strong> — DeepSeek V4.1-Flash-1017: 42.6 · DeepSeek V4.1-Flash (Sep): 36.8 · Kimi K3: 43.5 · GLM 5.3: 42.0 · GPT-5.6 Sol: 44.5 · Claude Opus 5: 56.3</li><li><strong>Chartography, with tools</strong> — DeepSeek V4.1-Flash-1017: 83.0 · DeepSeek V4.1-Flash (Sep): 78.9 · Kimi K3: 68.1 · GPT-5.6 Sol: 79.9 · Claude Opus 5: 84.0</li><li><strong>BabyVision</strong> — DeepSeek V4.1-Flash-1017: 92.5 · DeepSeek V4.1-Flash (Sep): 89.6 · Kimi K3: 85.7 · GPT-5.6 Sol: 88.9 · Claude Opus 5: 94.1</li></ul>
<h2>The model</h2>
<p>V4.1-Flash-1017 is a new version of the V4.1-Flash model DeepSeek released in September, with its weights posted under the MIT license, so anyone can host it. It is large, at 552B parameters plus 196B in a separate memory layer, but sparse: only 8B parameters are active when it reads and 16B when it writes, which is why it is cheap to serve. DeepSeek says it beats September’s version on all 11 benchmarks it reports and gives shorter answers. Its table shows it ahead of GPT-5.6 Sol on 9 of 10 benchmarks and of Claude Opus 5 on 4. Opus 5 still leads on the harder long-horizon tests, Terminal-Bench (51.8 against 42.3), NL2Repo (75.3 against 68.2) and ProgramBench (37.0 against 29.1), and on HLE (56.3 against 42.6). These are DeepSeek’s numbers, several from benchmarks few others report, run on its own agent harness. Independent evaluations aren’t out yet.</p>
<h2>Priced like a budget model</h2>
<p>US business hours fall in DeepSeek’s off-peak window, when it charges $0.15 per million input tokens and $0.60 per million output tokens. That is 27× less than GPT-5.6 Sol on input and 33× less on output, even at Sol’s discounted $4/$20, and 133× less on cached input. Cached input matters most for agents, which re-read the same context at every step. Against OpenAI’s cheapest model, GPT-5.6 Luna at $0.20/$1.20, it costs about the same. DeepSeek is selling a model it benchmarks against Sol and Opus at Luna’s price.</p>
<h2>What earlier DeepSeek releases did</h2>
<p>V2, in May 2024, started a price war in China: Alibaba cut a Qwen model 97%, Baidu made two Ernie models free and Zhipu cut 80%. US prices didn’t move. R1, in January 2025, roughly matched OpenAI’s o1 at $0.55/$2.19 against $15/$60, and Nvidia lost about $589B of market value on January 27. The biggest US cuts came over the following year. OpenAI released the cheaper o3-mini four days after the selloff and cut o3 by 80%, to $2/$8, in June. GPT-5 launched in August at $1.25/$10, and Anthropic took Opus from $15/$75 to $5/$25 in November. By mid-2025 the gap between DeepSeek and OpenAI’s flagship was the narrowest it has been.</p>
<p>2026 went the other way. GPT-5.5 launched the same week DeepSeek previewed V4, at $5/$30, double GPT-5.4. DeepSeek made a 75% cut to V4-Pro permanent in May, and US flagships didn’t follow. US labs cut later and selectively: OpenAI cut its cheapest model, Luna, by 80% in August and put Sol on a three-month discount, and Anthropic priced Opus 5.5 20% below Opus 5. None came near DeepSeek’s prices. DeepSeek itself raised prices in August and added peak-hour rates, a sign it couldn’t serve all the demand at its old prices.</p>
<h2>The pattern</h2>
<p>Each DeepSeek release resets the price of “good enough”. US labs answer by repricing the tier that competes and by temporary discounts, while holding flagship list prices around $4–5 for input and $20–30 for output. The price of a given level of capability falls very fast (Epoch AI measured 9× to 900× a year, depending on the benchmark), but the price of a top-tier token hasn’t. Two things limit DeepSeek’s direct pull: its own serving capacity, and the US companies and government users that won’t send data to a Chinese API. The pressure arrives through US companies hosting the open weights.</p>
<h2>What this one might do</h2>
<p><strong>Mid-tier prices go first.</strong> If independent tests confirm Sol-level agentic scores at Luna-level prices, GPT-5.6 Terra ($2/$12) and Anthropic’s Sonnet-class models are the most exposed. Expect cuts and discounts there, and more bundling into subscriptions such as Codex and Claude Code, where per-token prices are harder to compare.</p>
<p><strong>Cached input gets cheaper.</strong> It costs the labs little to serve, and most of what an agent reads is cached.</p>
<p><strong>Flagship prices are the tell.</strong> Sol’s discount runs at least to November 21. Extending it or making it permanent would be the DeepSeek effect; going back to $5/$30 would mean OpenAI still has pricing power. Google’s plan to double Gemini Flash prices on January 1 is the same test.</p>
<p><strong>DeepSeek is also going after agent developers.</strong> It now sells web search and page fetching to agents at $0.75 per 1,000 calls, free until November 1 when the calls come through Claude Code, Codex or DeepSeek’s own agent tool.</p>
<h2>What it means for the lab-funding and funding-scale packs</h2>
<p>OpenAI’s plan needs revenue to grow from $36B this year to $350B in 2030, and Anthropic’s IPO is being priced on $190–200B of revenue in 2028. Both assume usage grows much faster than prices fall. A model that caps mid-tier prices pushes more of that revenue onto the top tier, where DeepSeek still trails. Each 10% that OpenAI’s revenue falls short of plan adds about $84B to the $116B it still has to raise; try it below. For compute, cheaper tokens have so far meant more demand, not less: DeepSeek is rationing capacity with peak pricing, and V4’s launch barely moved US markets. The risk sits with the labs’ margins and the backlogs that depend on them, such as Oracle’s, Microsoft’s and CoreWeave’s, more than with the chipmakers.</p>
<h2>If token prices take OpenAI’s revenue below plan</h2>
<p>OpenAI’s July 2026 plan from <a href="https://06.ai/packs/ai-labs-funding">the </a><a href="https://06.ai/packs/ai-labs-funding">lab-funding</a><a href="https://06.ai/packs/ai-labs-funding"> pack</a>: $840B of revenue and $278B of cash burn over 2026–30, with $162B in hand. Assumes costs don’t fall with revenue, since much of its compute is contracted.</p>
<p><em>At the default setting (Revenue below plan 0%), from the </em><a href="https://06.ai/packs/token-prices#sens"><em>interactive version</em></a><em>:</em></p>
<ul><li>Cash burn, 2026–30: <strong>$278B</strong></li><li>Still to raise: <strong>$116B</strong></li><li>Total need in the <a href="https://06.ai/packs/ai-funding-scale">funding-scale</a> pack: <strong>$1.54T</strong></li></ul>
<h2>What this is anchored on</h2>
<p>List prices per million tokens as of October 17, 2026, standard rates for short prompts.</p>
<ul><li><strong>V4.1-Flash-1017</strong> — Released Oct 17 as a new version of September’s V4.1-Flash; 552B parameters plus 196B ‘Engram’ parameters, 8B active on input and 16B on output; 1M-token context; $0.30/$1.20 at peak and half off-peak; beats the September version on all 11 benchmarks reported · <a href="https://www.marktechpost.com/2026/10/17/deepseek-just-released-v4-1-flash-1017-scores-77-0-on-deepswe-opens-search-api/">MarkTechPost, Oct 17</a></li><li><strong>V4.1-Flash-1017</strong> — Weights on Hugging Face under the MIT license; Search and Fetch APIs at $0.75 per 1,000 requests, free via DeepSeek Harness, Claude Code or Codex until Nov 1 · <a href="https://aiweekly.co/alerts/deepseek-opens-v41-flash-1017-weights-and-075-search-api">AI Weekly, Oct 17</a></li><li><strong>V4.1-Flash-1017</strong> — $0.15 input, $0.60 output, $0.003 cached input per million tokens · <a href="https://openrouter.ai/deepseek/deepseek-v4.1-flash-1017">OpenRouter</a></li><li><strong>DeepSeek rates</strong> — Peak hours 01:00–04:00 and 06:00–10:00 UTC on weekdays; V4.1-Flash $0.30/$1.20 peak and $0.15/$0.60 off-peak; V4-Pro $1.32/$3.96 at peak · <a href="https://www.yottalabs.ai/post/deepseek-v4-1-flash-pricing-specs-v4-pro-routing-2026">Yotta Labs</a></li><li><strong>GPT-5.6 Sol</strong> — $4 input, $0.40 cached input, $20 output; discounted pricing available at least through Nov 21, 2026 · <a href="https://developers.openai.com/api/docs/models/gpt-5.6-sol.md">OpenAI</a></li><li><strong>GPT-5.6 Sol</strong> — Cut from $5/$30 to $4/$20 for three months on Aug 21; Claude Opus 5 at $5/$25 and Claude Fable 5 at $10/$50 · <a href="https://letsdatascience.com/news/openai-cuts-gpt-56-sol-api-prices-fbfd85f3">Let’s Data Science, Aug 22</a></li><li><strong>GPT-5.6 family</strong> — Terra $2/$12; Luna $0.20/$1.20; general availability Jul 9, 2026 · <a href="https://costbench.com/software/llm-api-providers/gpt-5-6/">CostBench</a></li><li><strong>Claude Opus 5.5</strong> — Released Sep 22, 2026 at $4/$20, against $5/$25 for Opus 5 · <a href="https://metricnexus.ai/blog/claude-opus-5-5-benchmarks-pricing">Metric Nexus</a></li><li><strong>August 2026</strong> — Luna cut 80% to $0.20/$1.20; Gemini 3.7 Flash launched at $0.75/$3.75, set to double on Jan 1; DeepSeek V4-Flash moved from $0.14/$0.28 to $0.22/$0.66 off-peak and $0.44/$1.32 at peak · <a href="https://devtk.ai/en/blog/ai-api-price-war-august-2026/">DevTk.AI</a></li><li><strong>DeepSeek V4-Pro</strong> — Output price raised from $0.87 to $3.96 at peak and $1.98 off-peak on Aug 16; Nvidia lost about $589B of market value on Jan 27, 2025 · <a href="https://www.regardsofwallstreet.com/news/deepseek-price-increase-openai-pause-compute-demand">Regards of Wall Street</a></li><li><strong>DeepSeek V4-Pro</strong> — Launched about Apr 24, 2026 (1.6T parameters, 49B active, open weights) at $3.48 output; 75% discount · <a href="https://thenextweb.com/news/deepseek-v4-pro-price-cut-75-percent">The Next Web, Apr 27</a></li><li><strong>DeepSeek V4-Pro</strong> — 75% cut made permanent May 23; GPT-5.5 at $5/$30 and Claude Opus 4.7 at $5/$25; no US price response · <a href="https://www.thestreet.com/markets/chinese-ai-rival-hits-openai-anthropic-where-it-really-hurts">TheStreet, May 25</a></li><li><strong>DeepSeek V4</strong> — Muted initial market reaction to the Apr 24 preview · <a href="https://letsdatascience.com/news/deepseek-launches-v4-pressures-wall-street-stocks-9d72545c">Let’s Data Science</a></li><li><strong>GPT-5.5</strong> — Launched at $5/$30, double GPT-5.4’s $2.50/$15 · <a href="https://www.aipricing.guru/news/openai-gpt-5-5-launches-pricing-april-2026/">AI Pricing Guru, Apr 24</a></li><li><strong>Opus 4.5</strong> — Released Nov 24, 2025 at $5/$25, against $15/$75 for Opus 4 and 4.1 · <a href="https://claudefa.st/blog/models/claude-opus-4-5">ClaudeFast</a></li><li><strong>GPT-5</strong> — Launched at $1.25/$10, against $15/$75 for Claude Opus 4.1 · <a href="https://techcrunch.com/2025/08/08/openai-priced-gpt-5-so-low-it-may-spark-a-price-war">TechCrunch, Aug 8, 2025</a></li><li><strong>DeepSeek V3.2-Exp</strong> — API prices cut by more than half on Sep 29, 2025, to $0.28 input and $0.42 output · <a href="https://gigazine.net/gsc_news/en/20250930-deepseek-v3-2-exp">GIGAZINE, Sep 30, 2025</a></li><li><strong>o3</strong> — Cut 80% on Jun 10, 2025, from $10/$40 to $2/$8 · <a href="https://venturebeat.com/ai/openai-announces-80-price-drop-for-o3-its-most-powerful-reasoning-model">VentureBeat</a></li><li><strong>R1 vs o1</strong> — DeepSeek-R1 at $0.55/$2.19 (Jan 20, 2025) against o1 at $15/$60 · <a href="https://anotherwrapper.com/tools/llm-pricing/deepseek-r1/o1-2024-12-17">AnotherWrapper, citing both companies’ price pages</a></li><li><strong>o3-mini</strong> — OpenAI released o3-mini on Jan 31, 2025, in the wake of DeepSeek · <a href="https://bnnbloomberg.ca/business/technology/2025/01/31/openai-releases-cheaper-model-o3-mini-in-wake-of-deepseek">BNN Bloomberg</a></li><li><strong>China, 2024</strong> — DeepSeek-V2 at ¥1–2 per million tokens (May 6, 2024); Alibaba cut Qwen-Long 97%, Baidu made Ernie Speed and Lite free, Zhipu cut GLM-3-Turbo 80% · <a href="https://kr-asia.com/llm-prices-hit-rock-bottom-in-china-as-alibaba-cloud-enters-the-fray">KrASIA, May 30, 2024</a></li><li><strong>Price trends</strong> — The price of reaching a fixed level of performance fell 9× to 900× a year, depending on the benchmark · <a href="https://epoch.ai/blog/llm-inference-price-trends">Epoch AI, Mar 2025</a></li></ul>
<h2>Method</h2>
<p><strong>Prices</strong> are list prices per million tokens on October 17, 2026, at standard rates for prompts under each provider’s long-context threshold. DeepSeek charges its peak rate, double the off-peak rate, from 01:00 to 04:00 and 06:00 to 10:00 UTC on weekdays; US business hours fall outside both windows. GPT-5.6 Sol is shown at its discounted rate, available at least through November 21, with its list price as the hollow dot. Gemini 3.7 Flash is shown at its launch price, which is set to double on January 1.</p>
<p><strong>Benchmarks</strong> are DeepSeek’s own table. Kimi K3 and GLM 5.3 have no prices here because their pay-as-you-go API prices weren’t published in the sources used.</p>
<p><strong>The price history</strong> uses launch list prices of each lab’s top model: OpenAI’s o1, o3, GPT-5, GPT-5.5 and GPT-5.6 Sol; Anthropic’s Opus line; DeepSeek’s R1, V3.2-Exp, V4-Pro and V4.1-Flash-1017, at peak rates where DeepSeek has them. It is a picture of list prices, not of what any customer paid after discounts.</p>
<p><strong>The funding sensitivity</strong> scales the <a href="https://06.ai/packs/ai-labs-funding">lab-funding</a> pack’s plan: a revenue shortfall adds to cash burn one for one, with no cost savings. The <a href="https://06.ai/packs/ai-funding-scale">funding-scale</a> pack’s total adds the same amount to its five-year figure.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Can markets fund the AI buildout?</title>
  <link>https://06.ai/packs/ai-funding-scale</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-funding-scale</guid>
  <pubDate>Sat, 17 Oct 2026 12:05:00 GMT</pubDate>
  <description>The hyperscaler, neocloud, leveraged-middle and lab-funding packs added up: about $1.54T of debt or equity through 2030, set against government borrowing, mortgages and the markets that would have to supply it.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/ai-funding-scale/cover.png" length="53402" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-funding-scale/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-funding-scale"><img src="https://06.ai/newsletter/ai-funding-scale/thumb.png" alt="Can markets fund the AI buildout?" width="421" height="398"></a><figcaption><a href="https://06.ai/packs/ai-funding-scale">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>Thirteen companies need about <strong>$1.54T</strong> of debt or equity over 2026–30, <strong>$435B</strong> of it in 2028. Next to Treasury borrowing and mortgages, that’s small. Next to the new money US businesses borrow each year, and the markets the weakest of these borrowers use, it isn’t.</p>
<ul><li><strong>$1.54T</strong> — Total need, 2026–30. Debt or equity · $1.26T for infrastructure, $278B for the labs</li><li><strong>$435B</strong> — Peak year. 2028 · 1.3% of GDP</li><li><strong>$438B</strong> — Hyperscalers. 28% of the total · peak $155B in 2027</li><li><strong>$476B</strong> — Builders. 31% · Oracle $65B, SpaceX $411B</li><li><strong>$347B</strong> — Neoclouds. 23% · plus $75B of GPU loans to roll</li><li><strong>$278B</strong> — Labs. 18% · all OpenAI; Anthropic is cash-flow positive</li></ul>
<h2>Debt or equity needed, by year</h2>
<figure><a href="https://06.ai/packs/ai-funding-scale#by-year"><img src="https://06.ai/newsletter/ai-funding-scale/fig-01.png" alt="Debt or equity needed, by year" width="694" height="508"></a><figcaption>What capex leaves after operating cash flow and customer prepays, plus the labs’ own cash burn, in calendar years. Each group’s pack has the company detail. Hover or tap a bar for the split. Shown: Street consensus.</figcaption></figure>
<p>Oracle is converted from fiscal years ending May. Neocloud figures are new money only: another $75B of GPU-backed loans comes due over the period and has to be refinanced. The labs’ figure is OpenAI’s own plan; on Anthropic’s own figures it needs no outside money.</p>
<h2>Against government, mortgages and credit markets</h2>
<figure><a href="https://06.ai/packs/ai-funding-scale#vs-markets"><img src="https://06.ai/newsletter/ai-funding-scale/fig-02.png" alt="Against government, mortgages and credit markets" width="694" height="532"></a><figcaption>Shown: Per year.</figcaption></figure>
<figure><a href="https://06.ai/packs/ai-funding-scale#vs-markets"><img src="https://06.ai/newsletter/ai-funding-scale/fig-03.png" alt="Against government, mortgages and credit markets — Outstanding" width="694" height="448"></a><figcaption><strong>Outstanding.</strong></figcaption></figure>
<h2>Each group against the market it borrows in</h2>
<p>The total hides where the money has to come from. Each group’s peak-year need against a year of issuance in the market it mostly draws on. For the neoclouds, the peak includes GPU-backed loans that have to be refinanced that year.</p>
<p>Hyperscalers · High grade</p>
<p><strong>6.8%</strong> · Peak-year need as a share of a year of US investment-grade bonds</p>
<ul><li><strong>Need, 2026–30</strong>: $438B</li><li><strong>Peak year</strong>: $155B in 2027</li><li><strong>That market</strong>: $2.27T a year</li><li><strong>Raises through</strong>: Investment-grade bonds, equity</li></ul>
<p>Builders · BBB / BBB−</p>
<p><strong>4.9%</strong> · Peak-year need as a share of a year of US investment-grade bonds</p>
<ul><li><strong>Need, 2026–30</strong>: $476B</li><li><strong>Peak year</strong>: $110B in 2028</li><li><strong>That market</strong>: $2.27T a year</li><li><strong>Raises through</strong>: Investment-grade bonds, chip financing, equity</li></ul>
<p>Neoclouds · High yield or unrated</p>
<p><strong>12%</strong> · Peak-year need as a share of a year of high-yield bonds, convertibles and direct-lending funds</p>
<ul><li><strong>Need, 2026–30</strong>: $347B + $75B to roll</li><li><strong>Peak year</strong>: $98B in 2027 incl. $8B to roll</li><li><strong>That market</strong>: $799B a year</li><li><strong>Raises through</strong>: GPU-backed loans, high-yield bonds, converts, equity</li></ul>
<p>Labs · Private, unrated</p>
<p><strong>22%</strong> · Peak-year need as a share of a year of US IPOs and share sales</p>
<ul><li><strong>Need, 2026–30</strong>: $278B</li><li><strong>Peak year</strong>: $111B in 2028</li><li><strong>That market</strong>: $502B a year</li><li><strong>Raises through</strong>: Private funding rounds, strategic investors, an IPO</li></ul>
<h2>Small next to Treasuries and mortgages</h2>
<p>At the 2028 peak the need is $435B, about 1.3% of GDP. That is 22% of the $1.99T deficit the federal government ran in FY2026, and 21% of the $2.1T of mortgages lenders will write this year. Debt across every US borrower outside finance (households, businesses and governments) is growing about $4.4T a year, and the AI peak would be 10% of that. Even on stated targets, where SpaceX builds to 10 GW and 2027 reaches $755B, the peak is 38% of one year’s deficit.</p>
<h2>Large next to what’s actually new</h2>
<p>Those comparisons flatter it. Most mortgage lending and bond issuance replaces debt that already exists; the AI need is new money. With mortgage rates near 7%, US mortgage debt grew only $182B over the past year, so the 2028 peak is 2.4× the net growth in all US mortgage debt. If it were all borrowed, it would also be 39% of the $1.1T a year that all US nonfinancial businesses are adding in debt, and 68% on stated targets.</p>
<h2>Hyperscalers are the easy part</h2>
<p>The four need $438B over five years, peaking at $155B in 2027: 6.8% of a year of US investment-grade issuance at the 2026 pace. Hyperscalers as a group have gone from about 2% of that market in 2023–24 to 11% this year, by Vanguard’s count, including Amazon’s $54B sale in March, the largest corporate bond deal on record, and investment-grade spreads have barely moved: 84bp on October 15, 4bp wider than at the end of August. The need is counted before dividends and buybacks. If the four keep paying out, they raise more; if markets tighten, payouts are the first thing they can cut.</p>
<h2>The strain is in three places</h2>
<p><strong>SpaceX on its stated targets.</strong> Building to about 10 GW by end-2027 needs about $370B in 2027 from one BBB-rated issuer. That is roughly what the whole US high-yield market raised in 2025, 6.9× the largest corporate bond deal ever, and 4.3× what SpaceX raised in its IPO, itself a record. On Street numbers it needs $80B that year. Either the build is slower than Musk has described, or chip vendors and partners finance most of it.</p>
<p><strong>The neoclouds.</strong> They need $347B of new money plus $75B of GPU loans to roll, mostly through high-yield bonds, convertibles and private credit. At the 2027 peak that is about 12% of what those markets raise in a year, and convertibles alone carry up to $32B a year, 17% of US convertible issuance. Those markets are already straining. High-yield spreads have widened 60bp since the end of August, to 323bp, after the heaviest month of junk supply this year, while investment grade moved 4bp. CoreWeave’s bonds yield over 15%.</p>
<p><strong>OpenAI.</strong> Its own plan burns $278B over 2026–30, $116B more than the cash it started the year with plus the $122B it raised in March. That has to come from private rounds and, eventually, an IPO that Altman says won’t happen in 2026. At the 2028 peak the need is 22% of what US IPOs and share sales raised at this year’s record pace, and two deals, SpaceX’s IPO and Alphabet’s raise, were about two-thirds of that. Anthropic is the opposite case: on its own figures it already funds itself, and its risk is $518B of mostly non-cancellable compute commitments that need its revenue to keep growing.</p>
<h2>Issuance is already running ahead of the gap</h2>
<p>Goldman counts nearly $600B of AI-linked debt priced this year, against a $259B gap for 2026 here. Part of the difference is issuers raising ahead of need: by Vanguard’s count, hyperscalers had sold about $132B of bonds by the end of July, against a 2026 gap here of $83B for the four, and Alphabet alone raised $85B in June. The rest is borrowers beyond these companies: data-center developers and the lease-backed vehicles that build sites and buy chips for the labs.</p>
<h2>Some of the money goes in a circle</h2>
<p>Since the start of 2025, at least $110B of the labs’ new equity has come from companies they buy compute from. Amazon alone put $39B into the two labs in the first half of 2026, close to its $45B capex gap for the whole year. That doesn’t change the total here. It moves part of the labs’ need onto their suppliers, whose gaps in the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a> pack don’t include these investments.</p>
<h2>Read the total as a floor</h2>
<p>It excludes about $830B of data-center leases the four hyperscalers have signed but not started, which developers finance with their own debt; the debt partners and lessors raise to build and equip the labs’ capacity (almost $100B against OpenAI’s sites by late 2025, and more than $100B of packages this year for chips and sites serving Anthropic, among others); power and grid; and payouts. Broader estimates run higher: Morgan Stanley sees a $1.5T data-center financing gap for 2025–28, and JPMorgan expects more than $2.1T of data-center financing from investment-grade bonds alone over five years.</p>
<h2>The telecom comparison</h2>
<p>The last debt-funded network buildout is the obvious reference. Telecom companies raised about $1.3T of debt in the five years to 2001, by Cambridge Associates’ count, in an economy a third the size of today’s, and by 2001 telecom bonds were nearly a quarter of the US high-yield market. This one needs $1.54T over five years: more in dollars, far less relative to the economy. Where it rhymes is in who is stretching: the weakest borrowers, funded in high yield, selling to a few customers.</p>
<p>So the total is manageable. The risk is in its shape: a few issuers, the weakest credit markets, and revenue that traces back to two AI labs, one of which still has to raise another $116B.</p>
<h2>What the comparisons are anchored on</h2>
<p>Latest data as of October 17, 2026. Company figures come from the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a>, <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> and <a href="https://06.ai/packs/ai-labs-funding">lab-funding</a> packs, which cite their own sources.</p>
<ul><li><strong>Government</strong> — Figure: FY2026 deficit $1,993B (preliminary), against $1,775B in FY2025 · <a href="https://www.cbo.gov/publication/61985">CBO, Monthly Budget Review: September 2026</a></li><li><strong>All borrowers</strong> — Figure: Q2 2026: domestic nonfinancial debt $84.1T, growing at a 5.2% annual rate; nonfinancial business $23.97T (4.6%); federal government $34.92T; home mortgages $14.01T · <a href="https://www.federalreserve.gov/releases/z1/20260911/z1.pdf">Federal Reserve, Financial Accounts of the US (Z.1), Q2 2026</a></li><li><strong>Mortgages</strong> — Figure: Mortgage balances $13.117T at Q2 2026, up $182B on the year; Q2 originations $505B · <a href="https://www.newyorkfed.org/newsevents/news/research/2026/20260811">New York Fed, Household Debt and Credit Report, Q2 2026</a></li><li><strong>Mortgages</strong> — Figure: Originations about $2.1T in 2026 and $1.99T in 2027, with rates near 7% · <a href="https://www.housingwire.com/articles/mba-originations-forecast-2027-rates/">MBA forecast, via HousingWire, Oct 11</a></li><li><strong>Investment grade</strong> — Figure: $1.7T issued Jan–Sep 2026, up 31%; $195B in September · <a href="https://www.incomeresearch.com/monthly-fixed-income-market-update-september-2026/">IR+M, Monthly Fixed Income Market Update, September 2026</a></li><li><strong>Investment grade</strong> — Figure: Spread 80bp at Aug 31, 84bp at Oct 15 (ICE BofA US Corporate OAS) · <a href="https://fred.stlouisfed.org/series/BAMLC0A0CM">FRED, BAMLC0A0CM</a></li><li><strong>Hyperscalers</strong> — Figure: Bond sales $93B in 2025 and about $132B in 2026 to July 31; about 11% of IG issuance in 2026, against about 2% in 2023–24 · <a href="https://corporate.vanguard.com/content/corporatesite/us/en/corp/vemo/ai-buildout-comes-to-bond-market.html">Vanguard, The AI buildout comes to the bond market (Aug 19); share as charted by CIO</a></li><li><strong>Investment grade</strong> — Figure: Amazon’s ~$53.8B two-currency sale in March 2026, the largest corporate bond sale on record (Verizon’s $49B in 2013 was the previous one) · <a href="https://www.ifre.com/bonds/2397565/amazon-makes-market-history-with-largest-corporate-bond-sale-ever">IFR</a></li><li><strong>Corporate bonds</strong> — Figure: $12.1T outstanding at Q2 2026 · <a href="https://www.sifma.org/resources/research/statistics/us-corporate-bonds-statistics/">SIFMA, US Corporate Bonds Statistics</a></li><li><strong>High yield</strong> — Figure: Record $219B issued in H1 2026; $364B in 2025. Other providers count less for 2025 ($298–328B) · <a href="https://www.aranca.com/assets/docs/US-High-Yield-Bond-Newsletter-1H-26.pdf">Aranca, US High-Yield Newsletter 1H’26 (Bloomberg data)</a></li><li><strong>High yield</strong> — Figure: $38.5B issued in September, the heaviest month of 2026; Goldman counts nearly $600B of AI-linked debt priced this year · <a href="https://www.briefs.co/?p=22964">Bloomberg, via Briefs, Sep 28</a></li><li><strong>High yield</strong> — Figure: Spread 263bp at Aug 31, 312bp at Sep 30, 323bp at Oct 15 (ICE BofA US High Yield OAS) · <a href="https://fred.stlouisfed.org/series/BAMLH0A0HYM2">FRED, BAMLH0A0HYM2</a></li><li><strong>High yield</strong> — Figure: $1.53T par outstanding at Sep 30, 2026 (ICE index) · <a href="https://www.morganstanley.com/content/dam/im/assets/publication/thought-leadership/article/article_highyieldmarketmonitor_q32026.pdf">Morgan Stanley IM, High Yield Market Monitor Q3 2026</a></li><li><strong>Convertibles</strong> — Figure: $131B raised by US-listed companies this year to early September, a record; 44% AI-related · <a href="https://www.advisorperspectives.com/articles/2026/09/11/convertible-market-record-ai-spending-surges">Bloomberg, via Advisor Perspectives, Sep 11</a></li><li><strong>Private credit</strong> — Figure: Direct-lending funds raised $129.15B in Jan–Sep 2026, up 35% · <a href="https://www.ksl.com/article/51636914/private-credit-faces-deployment-squeeze-as-fundraising-hits-record">Reuters, via KSL, Oct 15</a></li><li><strong>Private credit</strong> — Figure: US direct lending about $1.7T (March 2026) · <a href="https://www.blackrock.com/gls-download/literature/market-commentary/1h2026-credit-currents-chartbook-stamped.pdf">BlackRock, 1H2026 Credit Currents chartbook</a></li><li><strong>Leveraged loans</strong> — Figure: Morningstar LSTA index outstandings a record $1.55T at end-2025 · <a href="https://www.lsta.org/content/morningstar-lsta-leveraged-loan-index-analysis-december-2025/">LSTA</a></li><li><strong>Equity</strong> — Figure: Record $251B of US IPOs and share sales in H1 2026, including SpaceX’s $86.2B IPO (the largest ever) and Alphabet’s $85B raise · <a href="https://www.briefs.co/?p=10024">Bloomberg, via Briefs, Jun 29</a></li><li><strong>Labs</strong> — Figure: Amazon paid $15.0B and $13.7B into OpenAI in Q1 and Q2 2026, and $5B into each of Anthropic’s Series G and H · <a href="https://www.sec.gov/Archives/edgar/data/0001018724/000101872426000026/amzn-20260630.htm">Amazon 10-Q, quarter to Jun 30, 2026</a></li><li><strong>Economy</strong> — Figure: Nominal GDP $32.56T at an annual rate, Q2 2026 · <a href="https://fred.stlouisfed.org/graph/?g=wo6u">BEA, via FRED</a></li><li><strong>Street estimates</strong> — Figure: ~$2.9T of data-center capex 2025–28 and a ~$1.5T financing gap: ~$800B private credit, ~$200B corporate bonds, ~$150B ABS/CMBS, ~$350B other · <a href="https://prod-mssip.morganstanley.com/content/dam/msdotcom/en/assets/pdfs/Research_Bridging-Data-Center-Gap.pdf">Morgan Stanley Research, July 2025</a></li><li><strong>Street estimates</strong> — Figure: More than $2.1T of data-center financing from high-grade bonds over five years · <a href="https://fortune.com/2026/06/25/what-bubble-jpmorgan-5-5-trillion-ai-capex-explosion-profitable-for-now/">JPMorgan, via Fortune, Jun 25</a></li><li><strong>Telecom, 1996–2001</strong> — Figure: About $1.3T of debt raised in the five years to 2001 (unsourced in the report) · <a href="https://publishedresearch.cambridgeassociates.com/wp-content/uploads/2015/01/Telecom-Investing-2002.pdf">Cambridge Associates, Telecom Investing 2002</a></li><li><strong>Telecom, 1996–2001</strong> — Figure: Telecom bonds nearly a quarter of US high-yield bonds outstanding in 2001 · <a href="https://www.bis.org/publ/cgfs19board2.pdf">Federal Reserve Board staff paper, for the BIS CGFS, April 2001</a></li></ul>
<h2>Method</h2>
<p><strong>The AI need</strong> is each pack’s debt-or-equity line summed by calendar year: capex minus customer prepays minus operating cash flow, with no surplus carried between years. Hyperscalers come from the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a> pack and the builders from the <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> pack. Oracle’s fiscal years end in May, so calendar year t is 5/12 of FY t plus 7/12 of FY t+1 (FY31 is taken as equal to FY30). That is why Oracle shows $65B here against $79B in the <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> pack: seven months of FY26 fell in 2025. Neoclouds are the <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> pack’s base case, new money only. The labs are the <a href="https://06.ai/packs/ai-labs-funding">lab-funding</a> pack: OpenAI’s July 2026 plan ($278B over 2026–30, split by year as described there), and zero for Anthropic, which reports adjusted free cash flow above zero. Adding the labs doesn’t double count: what a lab pays a cloud is a cost in its burn and revenue in the cloud’s operating cash flow, so the two cancel out. Supplier investments in the labs move need between groups without changing the total.</p>
<p><strong>Scenarios.</strong> “Street consensus” uses Street capex for the hyperscalers and SpaceX. “Stated targets” uses Meta’s $600B-through-2028 pledge, Amazon’s doubled power by end-2027 and SpaceX building toward ~10 GW by end-2027. Oracle has no separate target, and the neocloud and lab figures are already each company’s own plan, so none of those change.</p>
<p><strong>Benchmarks.</strong> Flows are annual, and partial-year 2026 figures are annualized as labeled. Net flows (the deficit, the change in mortgage debt, net business borrowing) are the like-for-like comparison for new money; gross issuance includes refinancing. The AI need includes equity, so comparing it with borrowing assumes all of it is borrowed. High-yield totals vary by provider: Bloomberg-based counts put 2025 at $364B, others at $298–328B. Mortgage debt growth uses the New York Fed’s household data; debt outstanding uses the Fed’s Financial Accounts, which measure mortgages slightly differently. Several neoclouds are based outside the US but raise mostly in US markets.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Who funds the labs?</title>
  <link>https://06.ai/packs/ai-labs-funding</link>
  <guid isPermaLink="true">https://06.ai/packs/ai-labs-funding</guid>
  <pubDate>Sat, 17 Oct 2026 12:04:00 GMT</pubDate>
  <description>OpenAI and Anthropic are the customers behind the hyperscaler, neocloud and leveraged-middle packs. What each still has to raise to pay for its compute, and how much of that money comes from the companies selling it to them.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/ai-labs-funding/cover.png" length="46331" type="image/png" />
  <media:content url="https://06.ai/newsletter/ai-labs-funding/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/ai-labs-funding"><img src="https://06.ai/newsletter/ai-labs-funding/thumb.png" alt="Who funds the labs?" width="421" height="374"></a><figcaption><a href="https://06.ai/packs/ai-labs-funding">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>OpenAI and Anthropic, the customers behind the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> and <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> packs, have opposite problems. OpenAI’s own plan burns <strong>$278B</strong> of cash through 2030, <strong>$116B</strong> more than it has in hand. Anthropic reports it is already cash-flow positive, but it has signed <strong>$518B</strong> of compute it mostly can’t cancel.</p>
<h3>OpenAI</h3>
<p><strong>$278B</strong> · Cash burn over 2026–30 in its own July 2026 plan</p>
<ul><li><strong>In hand</strong>: $162B: about $40B of cash at the end of 2025 plus the $122B round that closed in March</li><li><strong>Still to raise</strong>: <strong>$116B</strong>, with the money in hand running out in 2028</li><li><strong>Revenue</strong>: About $50B a year at the end of September (about $70B counted Anthropic’s way); the plan has $350B in 2030</li><li><strong>Compute</strong>: $856B planned on compute and infrastructure through 2030, about $171B a year, 3.4× current revenue</li></ul>
<h3>Anthropic</h3>
<p><strong>$518B</strong> · Compute commitments over about a decade, roughly 80% non-cancellable</p>
<ul><li><strong>Cash flow</strong>: Positive since Q3 2026 on an adjusted basis, by its own figures</li><li><strong>Raised</strong>: $121.5B since 2025, $105B of it this year, plus an IPO of up to $100B planned for November</li><li><strong>Revenue</strong>: $16.8B in Q3 2026, about $67B annualized, against $4.6B in all of 2025</li><li><strong>Compute</strong>: About $52B a year of commitments on average, 0.8× current revenue</li></ul>
<h2>OpenAI keeps raising its own burn forecast</h2>
<figure><a href="https://06.ai/packs/ai-labs-funding#vintages"><img src="https://06.ai/newsletter/ai-labs-funding/fig-01.png" alt="OpenAI keeps raising its own burn forecast" width="694" height="362"></a><figcaption>Cash burn over 2026–30 in each of OpenAI’s reported plans, by when the plan was made. Under each bar is the 2030 revenue the same plan assumed: the burn has grown even as the revenue target has.</figcaption></figure>
<h2>On its own plan, OpenAI runs through what it has raised in 2028</h2>
<figure><a href="https://06.ai/packs/ai-labs-funding#runway"><img src="https://06.ai/newsletter/ai-labs-funding/fig-02.png" alt="On its own plan, OpenAI runs through what it has raised in 2028" width="694" height="422"></a><figcaption>Bars are yearly cash burn: the July plan’s $278B total, split by year in the proportions of February’s plan. The line is cumulative burn. The dashed line is the money in hand at the start of 2026.</figcaption></figure>
<p>Every 10% that revenue falls short of plan over the period adds about $84B to the burn if costs don’t fall with it. Much of the compute is contracted.</p>
<h2>Who writes the checks</h2>
<figure><a href="https://06.ai/packs/ai-labs-funding#checks"><img src="https://06.ai/newsletter/ai-labs-funding/fig-03.png" alt="Who writes the checks" width="694" height="224"></a><figcaption>New equity raised since January 2025, by investor. Suppliers are companies the lab buys compute from. Anthropic’s supplier figure is a floor: Microsoft’s and Nvidia’s shares of its Series G weren’t disclosed. Dashed: what’s coming next.</figcaption></figure>
<h2>Where the debt sits</h2>
<p>Little of it is in the labs’ own names. Most is raised by the partners and lessors who build sites and buy chips for them, and repaid from the labs’ rent.</p>
<ul><li><strong>Credit lines in its own name</strong> — OpenAI: About $4.7B, undrawn; a $520M Bank of America line · Anthropic: $2.5B, being expanded to $15B</li><li><strong>Loans from suppliers</strong> — OpenAI: None reported · Anthropic: Broadcom, up to $42B, convertible into shares, toward $125B of TPU leases</li><li><strong>Debt raised by partners and lessors</strong> — OpenAI: Almost $100B lined up against Stargate sites by late 2025 (Abilene ~$10B, New Mexico $18B, Vantage $38B); $16B for Oracle’s Michigan campus · Anthropic: $35B from Apollo and Blackstone; a $60B Broadcom chip package that also serves others; ~$15B for a campus in Hubbard, Texas</li><li><strong>Supplier money not yet paid in</strong> — OpenAI: $21.3B of Amazon’s $50B, due after June 30 · Anthropic: Google up to $30B; Amazon up to $15B; AMD up to $5B; Nvidia up to $10B in the IPO, in talks</li></ul>
<h2>Where the labs’ spending lands</h2>
<p>The backlogs behind the operating cash flow in the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> and <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> packs, and how much of each is these two labs.</p>
<ul><li><strong>Oracle</strong> — Backlog: $664B (Aug 2026) · From the labs: About half OpenAI · Pack: <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a></li><li><strong>Microsoft</strong> — Backlog: $625B (Dec 2025) · From the labs: About 45% OpenAI · Pack: <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a></li><li><strong>Google Cloud</strong> — Backlog: $514B (Jun 2026) · From the labs: Anthropic’s $200B commitment was over 40% of the Q1 backlog · Pack: <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a></li><li><strong>Amazon (AWS)</strong> — Backlog: $496B (Jun 2026) · From the labs: About half OpenAI and Anthropic · Pack: <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a></li><li><strong>CoreWeave</strong> — Backlog: $99B (Mar 2026) · From the labs: Under 30% from non-investment-grade AI labs · Pack: <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a></li><li><strong>SpaceX</strong> · From the labs: Anthropic pays $1.25B a month, cancellable on 90 days’ notice · Pack: <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a></li></ul>
<h2>OpenAI: the plan needs another $116B, and the plan keeps growing</h2>
<p>OpenAI’s July plan has it burning $278B of cash over 2026–30 while revenue grows from $36B to $350B. It started the year with about $40B and closed a $122B round in March, so on its own plan it runs through that money in 2028 and needs about $116B more. The plan has moved the wrong way: the same five years were $69B of burn in its September 2025 plan and $179B in February’s. And it assumes the revenue arrives. With costs unchanged, every 10% revenue shortfall over the period adds about $84B.</p>
<h2>Half of its new money comes from its suppliers</h2>
<p>Of the $164B OpenAI has raised since the start of 2025, at least $80B came from companies it buys compute from: $50B from Amazon and $30B from Nvidia. Another $60B came from SoftBank, its partner in Stargate. The March round also arrives in installments: Amazon had paid $28.7B of its $50B by the end of June. Supplier money doesn’t reduce what has to be raised. It moves part of it onto the suppliers, and the capex gaps in the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a> pack don’t include these investments.</p>
<h2>Anthropic: revenue caught up, commitments are fixed</h2>
<p>Anthropic’s revenue went from $4.6B in all of 2025 to $16.8B in the third quarter of 2026 alone, and it reported positive adjusted free cash flow for the quarter. On those figures it no longer needs outside money to run the business, but it is raising it anyway: $105B of equity this year and an IPO of up to $100B planned for November. The reason is on the other side of the ledger. It has signed at least $518B of compute over about a decade, about 80% of it non-cancellable, and bankers are pricing the IPO on $190–200B of revenue in 2028. Two customers are about a quarter of its revenue. Revenue comparisons between the two also flatter it: counted Anthropic’s way, OpenAI’s ~$50B run-rate would be ~$70B.</p>
<h2>The debt sits one step away</h2>
<p>Neither lab has borrowed much in its own name. OpenAI’s ~$4.7B credit line is undrawn, and Anthropic’s is growing to $15B. The borrowing happens at the companies that build and equip their capacity. Partners had lined up almost $100B of debt against OpenAI’s Stargate sites by late 2025. Lessors buying chips and building sites for Anthropic are raising $35B from Apollo and Blackstone and about $15B in Texas; Broadcom is arranging a $60B chip package that serves Anthropic among others, and will lend Anthropic up to $42B toward leasing its TPUs. That debt is repaid from the labs’ rent. It carries their credit risk without sitting on their balance sheets, or in the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> and <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> packs.</p>
<h2>Why the hyperscaler, neocloud and leveraged-middle packs depend on this</h2>
<p>About half of Oracle’s $664B backlog is OpenAI. OpenAI was about 45% of Microsoft’s commercial backlog at the end of 2025. Anthropic’s $200B Google commitment was more than 40% of Google Cloud’s backlog, and the two labs are about half of Amazon’s. That backlog is what turns into the operating cash flow in the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> and <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> packs. For OpenAI it depends on raising another $116B or more; for Anthropic, on revenue that keeps growing into commitments it can’t cancel. Added to the <a href="https://06.ai/packs/hyperscaler-capex-funding">hyperscaler</a>, <a href="https://06.ai/packs/neocloud-capex-funding">neocloud</a> and <a href="https://06.ai/packs/leveraged-middle">leveraged-middle</a> packs, the labs’ own need lifts the five-year total to $1.54T: see <a href="https://06.ai/packs/ai-funding-scale">the </a><a href="https://06.ai/packs/ai-funding-scale">funding-scale</a><a href="https://06.ai/packs/ai-funding-scale"> pack</a>.</p>
<h2>What this is anchored on</h2>
<p>Public reporting as of October 17, 2026. Anthropic’s figures come from press accounts of its draft IPO prospectus and investor updates, and are unaudited. OpenAI’s plans are internal projections reported by the press.</p>
<ul><li><strong>OpenAI</strong> — July 2026 plan: negative free cash flow of $278B over 2026–30; revenue $36B in 2026 rising to $350B in 2030 ($840B in total); ~$856B on compute and infrastructure; the March 2026 raise used up by 2028 · <a href="https://www.thestar.com.my/tech/tech-news/2026/09/19/openai-forecasts-cash-burn-near-280-billion-by-2030-ft-reports">FT, via Reuters, Sep 18</a></li><li><strong>OpenAI</strong> — May 2026 projection: ~$305B of burn over 2026–30 · <a href="https://thenextweb.com/news/openai-856bn-compute-vs-600bn-reset-burn-improved">The Next Web, citing the FT</a></li><li><strong>OpenAI</strong> — February 2026 plan: cash flow −$25B (2026), −$57B, −$85B, −$51B, +$39B (2030); 2025 revenue $13.1B, burn ~$8B, ~$40B of cash at year-end · <a href="https://the-decoder.com/openai-adds-111-billion-to-its-cash-burn-forecast-as-ai-costs-spiral-beyond-projections/">The Information, via The Decoder, Feb 21</a></li><li><strong>OpenAI</strong> — September 2025 plan: cash flow −$17B (2026), −$35B, −$47B, −$8B, +$38B (2030); 2030 revenue ~$200B · <a href="https://the-decoder.com/openai-has-reportedly-misjudged-its-cash-burn-by-80-billion/">The Information, via The Decoder, Sep 6, 2025</a></li><li><strong>OpenAI</strong> — 2025 audited: revenue $13.07B, costs $34B, operating loss $20.92B · <a href="https://wheresyoured.at/exclusive-openai-financials">Where’s Your Ed At (verified by the FT), Jun 15</a></li><li><strong>OpenAI</strong> — Q1 2026 revenue $5.7B, burn ~$3.7B, &gt;$73B of cash and securities at quarter-end; Q2 revenue $6.7B · <a href="https://thenextweb.com/news/openai-burned-3-7-billion-q1-2026">The Information, via The Next Web; WSJ, via Outlook Business</a></li><li><strong>OpenAI</strong> — Annualized revenue ~$50B at end-September (~$70B counted the way Anthropic counts cloud-partner sales); expects at least $70B by year-end · <a href="https://www.bloomberglinea.com/negocios/openai-preve-superar-los-us70000-millones-en-ingresos-anualizados-a-finales-de-2026/">Bloomberg, via Bloomberg Línea, Oct 9</a></li><li><strong>OpenAI</strong> — About $1.4T of data-center commitments over the next eight years · <a href="https://techcrunch.com/2025/11/06/sam-altman-says-openai-has-20b-arr-and-about-1-4-trillion-in-data-center-commitments/">TechCrunch, Nov 6, 2025</a></li><li><strong>OpenAI</strong> — $41.0B round fully funded by Dec 2025, $30B from SoftBank and $11B from co-investors · <a href="https://group.softbank/en/news/press/20251231">SoftBank Group, Dec 31, 2025</a></li><li><strong>OpenAI</strong> — $110B committed in February by Amazon ($50B), Nvidia ($30B) and SoftBank ($30B); round closed Mar 31 at $122B and an $852B valuation, ~$3B from individuals · <a href="https://techcrunch.com/2026/03/31/openai-not-yet-public-raises-3b-from-retail-investors-in-monster-122b-fund-raise/">OpenAI; TechCrunch, Mar 31</a></li><li><strong>OpenAI</strong> — Amazon paid $15.0B in Q1 2026 and $13.7B in Q2 toward its $50B, with $21.3B to come after June 30 · <a href="https://www.sec.gov/Archives/edgar/data/0001018724/000101872426000026/amzn-20260630.htm">Amazon 10-Q, quarter to Jun 30</a></li><li><strong>OpenAI</strong> — Talks to raise at least $30B at ~$1.4T; IPO ‘not 2026’ · <a href="https://propakistani.pk/2026/09/30/openai-reportedly-seeks-30-billion-at-1-4-trillion-valuation/amp/">Bloomberg, via ProPakistani, Sep 30; Reuters, Sep 13</a></li><li><strong>OpenAI</strong> — Partners’ borrowing tied to OpenAI sites ‘almost $100 billion’ (Abilene ~$10B, New Mexico $18B, $38B for Vantage in talks); OpenAI’s own credit line undrawn · <a href="https://www.irishtimes.com/business/2025/11/28/openai-partners-amass-100bn-debt-pile-to-fund-its-ambitions/">FT, via Irish Times, Nov 28, 2025</a></li><li><strong>OpenAI</strong> — Credit line expanded to ~$4.7B, undrawn; Bank of America $520M line in July · <a href="https://www.kitco.com/news/off-the-wire/2026-07-08/bofa-extends-first-520-million-loan-openai-ahead-ipo-source-says">TechCrunch, Mar 31; Reuters, via Kitco, Jul 8</a></li><li><strong>Anthropic</strong> — 2025 revenue $4.59B, operating loss $8.06B, $7.33B of compute and infrastructure costs; $20.28B of cash and short-term investments at Dec 31; two customers about a quarter of revenue · <a href="https://www.thestar.com.my/tech/tech-news/2026/09/29/exclusive-anthropic039s-ipo-prospectus-shows-sweeping-ai-vision-surging-costs">Reuters, on the draft IPO prospectus, Sep 28</a></li><li><strong>Anthropic</strong> — At least $518B of compute commitments over about a decade with six partners, ~80% non-cancellable: Broadcom ~$161.2B of equipment leases, Google ≥$111.1B, Amazon $110B, xAI/SpaceX up to $84.5B (cancellable on 90 days), Microsoft $31.4B, AMD &gt;$20B · <a href="https://www.zawya.com/en/business/anthropics-518bln-ai-buildout-hinges-largely-on-deals-that-cannot-be-canceled-filing-shows-1392642">Reuters, on the draft IPO prospectus, Sep 29</a></li><li><strong>Anthropic</strong> — Q3 2026 revenue $16.8B, adjusted operating margin 11%, adjusted free cash flow positive · <a href="https://www.khaleejtimes.com/business/anthropic-says-revenue-jumped-to-nearly-17b-last-quarter-reports-2">AFP, via Khaleej Times, citing US media reports and the FT and Bloomberg, Oct 15</a></li><li><strong>Anthropic</strong> — Q1 2026 revenue $4.73B; Q2 more than $11.5B (preliminary) · <a href="https://thenextweb.com/news/anthropic-q2-2026-revenue-11-5-billion-operating-income">Bloomberg, via The Next Web, Aug 15</a></li><li><strong>Anthropic</strong> — Bankers price the IPO on ~$190–200B of 2028 revenue · <a href="https://www.thestar.com.my/tech/tech-news/2026/08/15/exclusive-anthropic-ipo-valuation-hinges-on-190-200-billion-2028-revenue-forecast-sources-say">Reuters, Aug 14</a></li><li><strong>Anthropic</strong> — Series E $3.5B (Mar 2025), Series F $13B (Sep 2025), Series G $30B at $380B (Feb 2026) · <a href="https://www.datacenterdynamics.com/en/news/anthropic-raises-30bn-from-gic-coatue-d-e-shaw-ventures-mgx-and-others/">Orrick; Anthropic; DatacenterDynamics</a></li><li><strong>Anthropic</strong> — Series H $65B at $965B (May 2026), including $15B previously committed by hyperscalers ($5B from Amazon) · <a href="https://anthropic.com/news/series-h">Anthropic, May 28</a></li><li><strong>Anthropic</strong> — Google: $10B in cash in April, up to $30B more tied to performance targets · <a href="https://news.bgov.com/capital-markets/google-plans-to-invest-up-to-40-billion-in-anthropic">Bloomberg, Apr 24</a></li><li><strong>Anthropic</strong> — Amazon: $5B in Series G and $5B in Series H; milestone facility for further investment reduced to $15B · <a href="https://www.sec.gov/Archives/edgar/data/0001018724/000101872426000026/amzn-20260630.htm">Amazon 10-Q, quarter to Jun 30</a></li><li><strong>Anthropic</strong> — Broadcom to lend up to $42B, convertible into shares, toward a $125.2B five-year TPU lease commitment · <a href="https://www.thestar.com.my/tech/tech-news/2026/10/01/exclusive-broadcom-to-lend-anthropic-up-to-42-billion-to-lease-its-chips-filing-says">Reuters, on the draft prospectus, Oct 1</a></li><li><strong>Anthropic</strong> — Lessor financing for its capacity: $35B initial tranche from Apollo and Blackstone; a $60B Broadcom chip package ($42B senior, $18B junior); ~$15B for a Hubbard, Texas campus · <a href="https://www.advisorperspectives.com/articles/2026/10/02/banks-amass-60-billion-broadcoms-ai-chip">Apollo; Bloomberg, via Advisor Perspectives, Oct 2; Reuters, Jul 30</a></li><li><strong>Anthropic</strong> — Credit line expanding from $2.5B to $15B · <a href="https://www.advisorperspectives.com/articles/2026/09/05/anthropic-finalizing-15-billion-credit-facility">Bloomberg, via Advisor Perspectives, Sep 5</a></li><li><strong>Anthropic</strong> — IPO targeted for mid-to-late November on Nasdaq, raising up to $100B at about $2T; Nvidia in talks to anchor with up to $10B · <a href="https://news.bgov.com/banking-law/anthropic-said-to-target-mega-ipo-before-thanksgiving-holiday">Bloomberg, Oct 1; WSJ, via PYMNTS; Reuters, Sep 11</a></li><li><strong>OpenAI</strong> — Related Digital finalizing $16B of financing for Oracle’s Saline Township, Michigan campus serving OpenAI · <a href="https://news.bloomberglaw.com/private-equity/oracle-data-center-nears-16-billion-financing-after-twisty-path">Bloomberg, via Bloomberg Law, Apr 1</a></li><li><strong>Oracle</strong> — RPO $664B in the quarter to August, roughly half tied to OpenAI · <a href="https://erp.today/oracle-q1-fy27-results-664b-backlog-ai-contracts/">ERP Today, Sep 11</a></li><li><strong>Microsoft</strong> — About 45% of the $625B commercial RPO at Dec 31, 2025 came from OpenAI commitments · <a href="https://cloudwars.com/cloud/microsoft-q2-rpo-soars-110-led-by-openai-commitment-of-281-billion/">Cloud Wars, on Microsoft’s FY26 Q2 slides</a></li><li><strong>Google</strong> — Google Cloud backlog $513.9B at Jun 30, 2026; Anthropic’s $200B commitment was more than 40% of the backlog disclosed for Q1 · <a href="https://www.sec.gov/Archives/edgar/data/0001652044/000165204426000071/goog-20260630.htm">Alphabet 10-Q; Reuters, citing The Information, May 5</a></li><li><strong>Amazon</strong> — AWS backlog ~$496B at Jun 30, 2026; OpenAI and Anthropic about half of the announced backlog · <a href="https://michaelparekh.substack.com/p/ai-anthropic-and-opemai-half-of-2">Amazon 10-Q; Michael Parekh, citing The Information</a></li><li><strong>CoreWeave</strong> — Backlog $99.4B at Mar 31, 2026, of which non-investment-grade AI labs were under 30% · <a href="https://investors.coreweave.com/news/news-details/2026/CoreWeave-Reports-Strong-Second-Quarter-2026-Results/default.aspx">CoreWeave Q2 2026 results</a></li><li><strong>SpaceX</strong> — Anthropic pays $1.25B a month through May 2029; either side can end it on 90 days’ notice · <a href="https://simonwillison.net/2026/May/20/spacex-s1/">SpaceX S-1, via Simon Willison, May 20</a></li></ul>
<h2>Method</h2>
<p><strong>OpenAI’s need</strong> is the $278B of negative free cash flow over 2026–30 in its July 2026 plan, as reported by the FT. That plan’s year-by-year split hasn’t been reported. We keep the February 2026 plan’s 2026 figure ($25B) and spread the rest over 2027–29 in February’s proportions, with 2030 at zero. If 2030 turns cash-positive, as it did in February’s plan, the money needed before then is larger.</p>
<p><strong>Money in hand</strong> is about $40B of cash at the end of 2025 plus the $122B round that closed in March. Part of that round is paid in installments: Amazon had paid $28.7B of its $50B by June 30.</p>
<p><strong>Burn forecasts by vintage.</strong> The September 2025 and February 2026 figures sum each plan’s reported cash flows for 2026–30, including a positive 2030. May and July 2026 are reported totals.</p>
<p><strong>Anthropic</strong> is shown with no outside need on its own figures: it reports positive adjusted free cash flow since Q3 2026. Its cash flow for the first half of 2026 hasn’t been disclosed.</p>
<p><strong>Raised</strong> counts new equity only, not tender offers or buybacks. Supplier money is investment from companies the lab buys compute from. <strong>Compute a year</strong> is OpenAI’s planned compute and infrastructure spending over 2026–30 divided by five, and Anthropic’s signed commitments divided by their roughly ten-year span. One is a spending plan and the other signed contracts, so they are shown for scale only.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>The leveraged middle</title>
  <link>https://06.ai/packs/leveraged-middle</link>
  <guid isPermaLink="true">https://06.ai/packs/leveraged-middle</guid>
  <pubDate>Sat, 17 Oct 2026 12:03:00 GMT</pubDate>
  <description>Oracle and SpaceX build like hyperscalers but fund like neoclouds. What each needs from outside, and who’s lending.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/leveraged-middle/cover.png" length="49086" type="image/png" />
  <media:content url="https://06.ai/newsletter/leveraged-middle/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/leveraged-middle"><img src="https://06.ai/newsletter/leveraged-middle/thumb.png" alt="The leveraged middle" width="421" height="415"></a><figcaption><a href="https://06.ai/packs/leveraged-middle">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>Over five years Oracle needs about <strong>$78.7B</strong> of debt or equity even after <strong>$67.1B</strong> of customer prepays — and has already raised about $67.9B. SpaceX needs <strong>$411B</strong> on Street numbers, against $93.5B of cash.</p>
<ul><li><strong>$1.08T</strong> — Capex, next 5 years. Both · Street consensus</li><li><strong>$526B</strong> — Covered by operating cash flow. Capped at each year's capex</li><li><strong>$67.1B</strong> — Covered by customer prepays. Cash received ahead of service</li><li><strong>$490B</strong> — Needs debt or equity. 45% of capex</li></ul>
<h2>Capex by year, and how it gets paid for</h2>
<figure><a href="https://06.ai/packs/leveraged-middle#chart"><img src="https://06.ai/newsletter/leveraged-middle/fig-01.png" alt="Capex by year, and how it gets paid for" width="694" height="825"></a><figcaption>Oracle on fiscal years ending May (FY27 = Jun 2026–May 2027); SpaceX on calendar years. Scales differ by panel. Blue is customer prepays; orange is what prepays and operating cash flow can’t cover; the black tick marks operating cash flow. Shown: Street consensus · Both.</figcaption></figure>
<h2>Cumulative next 5 years by company</h2>
<p>$B. Dividends and buybacks aren't deducted, so the true need is larger where payouts continue.</p>
<figure><a href="https://06.ai/packs/leveraged-middle#breakdown"><img src="https://06.ai/newsletter/leveraged-middle/fig-02.png" alt="Oracle — Capex: $408B · Cash-flow funded: $262B · Customer prepays: $67.1B · Debt / equity: $78.7B · Share: 19% · Peak gap: FY27; SpaceX — Capex: $675B · Cash-flow funded: $264B · Customer prepays: $0B · Debt / equity: $411B · Share: 61% · Peak gap: 2028; Both — Capex: $1.08T · Cash-flow funded: $526B · Customer prepays: $67.1B · Debt / equity: $490B · Share: 45% · Peak gap: 2028" width="694" height="207"></a></figure>
<h2>How credit markets price them</h2>
<p>Ratings, default-swap levels and lender exposure. CoreWeave included as the neocloud reference point.</p>
<ul><li><strong>ORCL</strong> — Rating: BBB- (S&amp;P, cut Jul 2026) · 5-year CDS: 288bp 5y — record, Oct 15 2026 · Debt: $125.3B (Aug 31 2026) · Customer concentration: OpenAI ≈ half of $664B RPO</li><li><strong>SPCX</strong> — Rating: BBB · 5-year CDS: No liquid CDS quoted · Debt: $38.4B principal (Jun 30 2026); $40B chip financing in talks · Customer concentration: Anthropic $1.25B/mo + Google $920M/mo, cancelable on 90 days</li><li><strong>CRWV</strong> — Rating: High yield · 5-year CDS: &gt;1,000bp 5y, Oct 2026 · Debt: 2032 bonds ≈77¢, &gt;15% yield · Customer concentration: Reference point: neocloud</li></ul>
<h2>Oracle: the gap is funded; the counterparty isn’t diversified</h2>
<p>Oracle’s FY27 guide is $90–95B of capex but “not more than $70B” of net cash capex. Customers prepay the difference: $11.4B came in during the first quarter alone, and most new contracts are prepay or bring-your-own-hardware. Add $67.9B of notes, convertible preferred and at-the-market equity raised since FY26, and most of the five-year gap is already financed.</p>
<p>The risk sits elsewhere. Oracle books these prepays with a “significant financing component” — economically, a loan from the customer that it repays in compute. About half of its $664B backlog is one customer, OpenAI. That’s why its CDS hit a record 288bp in October with the funding gap largely closed: the market is pricing who pays, not how much is needed. If you treat the prepays as debt, Oracle’s external need rises to $146B.</p>
<h2>SpaceX: cash now, a cliff if it builds to plan</h2>
<p>On Street numbers SpaceX needs about $411B over five years. The $93.5B of IPO cash covers 2026 and roughly half of 2027. Building to the ~10 GW Musk has described for end-2027 raises the five-year need to $651B, and $426B of that lands in 2026–27 alone, while the build is happening. Against that, the $40B chip financing now in talks is a down payment. There are no prepays: Anthropic and Google pay monthly, and either can walk on 90 days’ notice. The revenue backing this buildout can be cancelled faster than the debt can be repaid.</p>
<h2>What this is anchored on</h2>
<p>Company filings, calls and press reports as of October 17, 2026.</p>
<ul><li><strong>ORCL</strong> — FY26: capex $55.7B, OCF $32.0B (incl. $4.6B customer prepays), FCF −$23.7B · Oracle FY26 results; Investing.com, Aug 2026</li><li><strong>ORCL</strong> — FQ1'27: capex $28.5B, OCF $23.1B incl. $11.4B prepays booked as deferred revenue with a financing component; FCF −$5B · Oracle Q1 FY27 release &amp; 10-Q, Sep 2026</li><li><strong>ORCL</strong> — FY27 capex guide $90–95B with net cash capex 'not more than $70B'; most new contracts via prepay or bring-your-own-hardware · Oracle Q1 FY27 call (CFO Hilary Maxson)</li><li><strong>ORCL</strong> — Raised $43B senior notes + $5B mandatory convertible (FY26) and $19.9B ATM equity (FQ1'27) · Oracle 10-Q, Aug 31 2026</li><li><strong>ORCL</strong> — New RPO won't hit capex or revenue until FY28+; ~half of $664B RPO converts within 36 months · Oracle Q1 FY27 call</li><li><strong>SPCX</strong> — H1'26 capex $28.5B (Q2 $18.4B, of which AI $15.8B); H1 operating cash flow $3.5B · SpaceX Q2 2026 10-Q</li><li><strong>SPCX</strong> — $14.3B deferred revenue relates to Space and Connectivity contracts — no AI-compute prepayment disclosed · SpaceX Q2 2026 10-Q</li><li><strong>SPCX</strong> — Cash $93.5B after ~$86B IPO; $25B senior notes (5.86% avg coupon); seeking $40B ($30B IG + $10B loans) for Nvidia chips · SpaceX 10-Q; FT/Reuters, Oct 6 2026</li><li><strong>SPCX</strong> — &gt;2 GW compute end-2026, 'closer to 10 GW' end-2027 · SpaceX Q2 2026 call (Musk)</li></ul>
<h2>Method</h2>
<p><strong>Oracle</strong> uses fiscal years ending May. FY26 is actual (capex $55.7B; OCF $32.0B split into $27.4B ex-prepay and $4.6B prepays, which reproduces the reported −$23.7B FCF). FY27 uses the $92.5B capex midpoint, with prepays set so net cash capex lands at the $70B ceiling. FY28–30 are our estimates: capex peaks in FY28 as the RPO Oracle says “won’t impact capex until fiscal 28” is built, then falls; prepays fade as fewer new contracts are signed; operating cash flow ramps as about half the backlog converts within three years.</p>
<p><strong>SpaceX</strong> is calendar-year. Capex: Street blends ~$65B for 2026 (H1 $28.5B, H2 at the Q2 run rate) with analyst paths above $100B for 2027; the stated-target path builds toward ~10 GW by end-2027 at about $50B per GW ($400B of capex in 2027), then spends about $150B a year in 2028–30. Musk hasn’t given a target beyond end-2027, so the path doesn’t keep building at the 2027 pace. Operating cash flow is our estimate from H1 2026’s $3.5B and the ~$26B annual run rate of the Anthropic and Google compute contracts; it is the softest number here.</p>
<p><strong>Prepays</strong> appear only where disclosed. SpaceX’s $14.3B of deferred revenue relates to space and connectivity contracts, not AI compute, so it isn’t counted.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Who funds the neoclouds?</title>
  <link>https://06.ai/packs/neocloud-capex-funding</link>
  <guid isPermaLink="true">https://06.ai/packs/neocloud-capex-funding</guid>
  <pubDate>Fri, 16 Oct 2026 12:02:00 GMT</pubDate>
  <description>CoreWeave, Nebius, IREN, Lambda and Nscale need about $623B of capex through 2030. What prepayments and cash flow cover, what has to be borrowed, and what that money costs now.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/neocloud-capex-funding/cover.png" length="49277" type="image/png" />
  <media:content url="https://06.ai/newsletter/neocloud-capex-funding/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/neocloud-capex-funding"><img src="https://06.ai/newsletter/neocloud-capex-funding/thumb.png" alt="Who funds the neoclouds?" width="421" height="398"></a><figcaption><a href="https://06.ai/packs/neocloud-capex-funding">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>CoreWeave, Nebius, IREN, Lambda and Nscale need about <strong>$623B</strong> of capex through 2030 to hit their own targets. Prepayments and operating cash flow cover <strong>$278B</strong>. The other <strong>$347B</strong> has to come from debt or equity, plus <strong>$75B</strong> of GPU loans to roll, at a time when CoreWeave’s bonds yield 15%.</p>
<ul><li><strong>$623B</strong> — Capex, 2026–30. All five · base case</li><li><strong>$136B</strong> — Covered by operating cash flow. 22% of capex; $54B in 2030</li><li><strong>$142B</strong> — Covered by customer prepays. 23% of capex</li><li><strong>$347B</strong> — Needs debt or equity. 56% of capex · peak 2027</li><li><strong>$422B</strong> — Gross issuance. Incl. $75B of GPU loans to roll</li></ul>
<h2>Capex by year, and how it gets paid for</h2>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-01.png" alt="Capex by year, and how it gets paid for" width="824" height="472"></a><figcaption>Shown: All five · Funding sources.</figcaption></figure>
<p><em>Sliders at their defaults: Capex per GW 100% · Prepay coverage 100% · EBITDA vs base 100%.</em></p>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-02.png" alt="Capex by year, and how it gets paid for — By funding type" width="824" height="502"></a><figcaption><strong>By funding type.</strong></figcaption></figure>
<h3>By company</h3>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-03.png" alt="Capex by year, and how it gets paid for — CoreWeave" width="824" height="502"></a><figcaption><strong>CoreWeave</strong>: Capex, 2026–30 $234B · Covered by operating cash flow $62B · Covered by customer prepays $24B · Needs debt or equity $148B · Gross issuance $188B</figcaption></figure>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-04.png" alt="Capex by year, and how it gets paid for — Nebius" width="824" height="502"></a><figcaption><strong>Nebius</strong>: Capex, 2026–30 $146B · Covered by operating cash flow $21B · Covered by customer prepays $56B · Needs debt or equity $69B · Gross issuance $71B</figcaption></figure>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-05.png" alt="Capex by year, and how it gets paid for — IREN" width="824" height="502"></a><figcaption><strong>IREN</strong>: Capex, 2026–30 $106B · Covered by operating cash flow $25B · Covered by customer prepays $33B · Needs debt or equity $48B · Gross issuance $61B</figcaption></figure>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-06.png" alt="Capex by year, and how it gets paid for — Lambda" width="824" height="502"></a><figcaption><strong>Lambda</strong>: Capex, 2026–30 $74B · Covered by operating cash flow $20B · Covered by customer prepays $7B · Needs debt or equity $46B · Gross issuance $54B</figcaption></figure>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#chart"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-07.png" alt="Capex by year, and how it gets paid for — Nscale" width="824" height="502"></a><figcaption><strong>Nscale</strong>: Capex, 2026–30 $64B · Covered by operating cash flow $8B · Covered by customer prepays $22B · Needs debt or equity $36B · Gross issuance $48B</figcaption></figure>
<h2>Company by company</h2>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#by-company"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-08.png" alt="Company by company" width="824" height="354"></a><figcaption>Same scale for all five; the gridline marks $30B. Each header shows the 2026–30 debt or equity need and its share of capex. Click a company to focus the page on it.</figcaption></figure>
<h2>The gap peaks in 2027, then cash flow takes over</h2>
<p>In the base case, net new money peaks at $90B in 2027. Operating cash flow is only $3B in 2026, with Nscale still losing money and IREN about break-even, but it reaches $54B by 2030 and covers 22% of capex over the five years. CoreWeave is $148B of the $347B the group needs.</p>
<h2>Most of that cash is already spoken for</h2>
<p>The operating cash flow here is after $61B of interest and excludes $69B of revenue customers prepaid in earlier years. Much of it comes from capacity financed with amortizing GPU loans, which get paid down first: $75B of scheduled amortization has to be raised again, which takes gross issuance to $422B. The 2026 need is roughly covered already: the five raised or committed about $76B this year against a $68B net need. The open question is 2027–30.</p>
<h2>What the money costs</h2>
<p>Rate at issue on each 2026 raise, with earlier deals for reference. Rings show where CoreWeave’s bonds trade now and what Nebius’ accreting converts yield if held to maturity. Floating loans are shown at SOFR of 3.88% plus their spread.</p>
<p><strong>5.9–6.9% </strong>Secured GPU debt rated or priced investment grade · <strong>8.4–9.4% </strong>Secured GPU debt below investment grade · <strong>15.1% </strong>CoreWeave 9.75% 2031s on Oct 16, issued at par in April · <strong>0.5–4.5% </strong>Convert cash coupons; 3.2–7.1% for Nebius with accretion</p>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#costs"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-09.png" alt="What the money costs" width="824" height="814"></a></figure>
<p>Convertible coupons understate the cost: the rest is paid in conversion optionality and dilution. Nscale’s $3.36B pre-IPO converts (September, including $1B from Nvidia) are left off because no coupon has been disclosed; they convert at a double-digit discount to the IPO price, capped at a $30B valuation.</p>
<h2>What they raised in 2026</h2>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#raised"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-10.png" alt="What they raised in 2026" width="824" height="302"></a><figcaption>Facilities and offerings announced Jan 1 to Oct 16, 2026, at committed size, excluding customer prepayments. Each company’s mix here drives the “By funding type” view above.</figcaption></figure>
<h2>Secured debt got cheaper. Unsecured debt didn’t.</h2>
<p>GPU loans backed by investment-grade customers now price at 5.9–6.9%, against about 15% on CoreWeave’s first GPU loan and 13–15% on Nscale’s earlier private credit. Unsecured paper went the other way. CoreWeave’s 9.75% 2031s, issued at par in April, traded at 81.8 on October 16 for a 15.1% yield, and its five-year CDS hit a record 1,194.5 bp the day before. Its September convert needed a 2.875% coupon and a 22.5% premium, against 1.75% and 30% in April.</p>
<h2>A third of the need leans on converts</h2>
<p>If each company keeps its 2026 financing mix, $139B of the $347B comes as secured GPU debt and $123B as convertibles. Nebius drives that: 93% of what it raised this year was convertible. The cash coupons look cheap at 0.5–4.5%, but the notes accrete to 110–125% at maturity, a 3.2–7.1% yield if they never convert, plus the dilution if they do. That channel depends on the share prices, and CoreWeave and Nebius each lost about a fifth of their value this week.</p>
<h2>The numbers</h2>
<p>$B, calendar years, for the selection above. Reflects the sliders.</p>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#numbers"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-11.png" alt="Capex — 2026: 93.5 · 2027: 134.7 · 2028: 143.5 · 2029: 133.7 · 2030: 117.4 · 2026–30: 622.8; Customer prepays — 2026: 23.1 · 2027: 32.6 · 2028: 34.1 · 2029: 29.4 · 2030: 22.5 · 2026–30: 141.6; Operating cash flow applied — 2026: 3.4 · 2027: 12.9 · 2028: 26.1 · 2029: 39.7 · 2030: 54.0 · 2026–30: 136.2; Debt / equity needed — 2026: 68.0 · 2027: 89.9 · 2028: 83.4 · 2029: 64.6 · 2030: 40.9 · 2026–30: 346.7; of which secured GPU debt — 2026: 27.9 · 2027: 37.2 · 2028: 31.7 · 2029: 24.5 · 2030: 17.9 · 2026–30: 139.1; of which unsecured notes — 2026: 6.1 · 2027: 6.5 · 2028: 6.3 · 2029: 5.8 · 2030: 4.7 · 2026–30: 29.4; of which convertibles — 2026: 24.5 · 2027: 32.2 · 2028: 32.4 · 2029: 23.3 · 2030: 10.1 · 2026–30: 122.6; of which equity — 2026: 9.4 · 2027: 14.0 · 2028: 13.0 · 2029: 11.1 · 2030: 8.2 · 2026–30: 55.6; GPU loans to roll — 2026: 2.6 · 2027: 8.2 · 2028: 15.7 · 2029: 22.0 · 2030: 26.9 · 2026–30: 75.4; Gross issuance — 2026: 70.6 · 2027: 98.1 · 2028: 99.0 · 2029: 86.6 · 2030: 67.7 · 2026–30: 422.0; Memo: revenue — 2026: 19.8 · 2027: 53.1 · 2028: 94.6 · 2029: 137.3 · 2030: 174.6 · 2026–30: 479.3; Memo: EBITDA — 2026: 9.2 · 2027: 27.8 · 2028: 52.5 · 2029: 76.8 · 2030: 97.8 · 2026–30: 264.1; Memo: cash interest — 2026: 4.1 · 2027: 8.2 · 2028: 12.7 · 2029: 16.4 · 2030: 19.3 · 2026–30: 60.7; Memo: prepaid revenue excluded — 2026: 2.7 · 2027: 7.3 · 2028: 13.8 · 2029: 20.6 · 2030: 24.5 · 2026–30: 68.9; Memo: debt outstanding — 2026: 90.3 · 2027: 166.2 · 2028: 236.6 · 2029: 290.2…" width="824" height="670"></a></figure>
<h3>Cumulative 2026–30 by company</h3>
<figure><a href="https://06.ai/packs/neocloud-capex-funding#numbers"><img src="https://06.ai/newsletter/neocloud-capex-funding/fig-12.png" alt="CoreWeave — Capex: $234B · Prepays: $24B · Cash-flow funded: $62B · Debt / equity: $148B · Share: 63% · Peak year: 2027 · GPU loans to roll: $40B; Nebius — Capex: $146B · Prepays: $56B · Cash-flow funded: $21B · Debt / equity: $69B · Share: 47% · Peak year: 2028 · GPU loans to roll: $2B; IREN — Capex: $106B · Prepays: $33B · Cash-flow funded: $25B · Debt / equity: $48B · Share: 45% · Peak year: 2027 · GPU loans to roll: $13B; Lambda — Capex: $74B · Prepays: $7B · Cash-flow funded: $20B · Debt / equity: $46B · Share: 63% · Peak year: 2028 · GPU loans to roll: $8B; Nscale — Capex: $64B · Prepays: $22B · Cash-flow funded: $8B · Debt / equity: $36B · Share: 56% · Peak year: 2027 · GPU loans to roll: $12B; All five — Capex: $623B · Prepays: $142B · Cash-flow funded: $136B · Debt / equity: $347B · Share: 56% · Peak year: 2027 · GPU loans to roll: $75B" width="824" height="310"></a></figure>
<h2>What this is anchored on</h2>
<p>Guidance, filings and market data as of October 16, 2026.</p>
<ul><li><strong>CRWV</strong> — 2026 capex $35–39B; revenue $12.4–13.2B; ≥1.85 GW active power by year-end; ≥8 GW by 2030; 4.2 GW contracted · CoreWeave Q2 2026 call, Aug 11 2026</li><li><strong>CRWV</strong> — Q2 adj. EBITDA $1.51B (59%); net interest $640M; deferred revenue $9.7B at Jun 30; H1 operating cash flow $3.66B · CoreWeave Q2 2026 results</li><li><strong>CRWV</strong> — DDTL 4.0 $8.5B (A3, ~5.9% fixed / SOFR+225); DDTL 5.0 $3.1B (Ba2, SOFR+450); DDTL 5.5 $2.6B (SOFR+550) · Company releases Mar 31 and May 18 2026; Stocktitan debt summary</li><li><strong>CRWV</strong> — 9.75% 2031 notes $2.75B (Apr); 9.625% 2032 $1.25B and 8.50% € 2032 €2B (Jun); converts 1.75% 2032 $4.0B (Apr), 2.875% 2033 $4.2B (Sep) · Company releases, Apr–Sep 2026</li><li><strong>CRWV</strong> — 9.75% 2031s at 81.8 / 15.08% yield (Oct 16); 5-year CDS record 1,194.5 bp (Oct 15); Nvidia $2B equity (Jan) · ICE via Bloomberg/Benzinga, Oct 16 2026; Bloomberg, Jan 26 2026</li><li><strong>NBIS</strong> — 2026 capex $20–25B; revenue $3.0–3.4B; ~40% adj. EBITDA margin; 0.8–1 GW connected and 5 GW contracted by year-end; &gt;$9B prepayments in 2026 covering 50–60% of associated capex · Nebius Q1/Q2 2026 results and calls</li><li><strong>NBIS</strong> — Converts $4.34B 1.25% 2031 / 2.625% 2033 accreting to 120% (Mar); $5.75B 0.50% 2030 (110%) / 4.50% 2034 (125%) (Aug); first secured loan ~$775M at SOFR+250 (Jul) · Nebius 6-K filings, Mar and Aug 2026</li><li><strong>IREN</strong> — FY27 capex $25–30B; 0.3 GW IT in 2026, 0.8 GW cumulative in 2027; $4B contracted run rate for 2026 capacity; prepays 45–55% of GPU capex · IREN FY26 results and call, Aug 27 2026</li><li><strong>IREN</strong> — $3.65B investment-grade GPU financing at 6.0% (Jun); $2.4B Blue Owl/PIMCO at 9.0% (Aug); $3.0B 1.00% 2033 converts (May) · IREN releases, May–Aug 2026</li><li><strong>Lambda</strong> — 3 GW by 2030 target; backlog $15B (Jun) to $50B (Sep); 2026 revenue above $1.5B; raising up to $4B pre-IPO · WSJ via TechCrunch, Oct 6 2026; Bloomberg</li><li><strong>Lambda</strong> — $926M term loan B (Baa2, SOFR+300, Aug); $1.008B DDTL at 6.78% fixed (Baa1, Oct); $1B secured facility (May) · Lambda releases, May–Oct 2026</li><li><strong>Nscale</strong> — $103.4B contracted (Microsoft ≤$43.8B, Anthropic ≤$44.6B for 460 MW); $24B equipment + $3.5B construction committed, mainly 2026–27; H1 capex $3.2B; deferred revenue $2.0B to $6.5B · Nscale S-1, Sep 18 2026</li><li><strong>Nscale</strong> — $3.36B pre-IPO converts incl. $1B Nvidia (Sep); newest facilities SOFR+237.5 (IG); legacy Sandton loans 13–15% · Nscale release Sep 25 2026; S-1</li><li><strong>Rates</strong> — SOFR 3.88% and fed funds 3.75–4.00% after a September hike; 10-year UST 5.12%; US high-yield index effective yield ~8.1% · Fed/market data, Oct 13–16 2026</li></ul>
<h2>Method</h2>
<p><strong>Capex.</strong> 2026 is company guidance at midpoints, with IREN converted from its June fiscal year and Nscale built from the commitments in its S-1. Later years turn each company’s stated power target into capacity added per year, priced at a company-specific capex per GW. Lambda’s whole path is our estimate.</p>
<p><strong>Prepayments</strong> are gross cash received, from guidance (Nebius, IREN), filings (CoreWeave, Nscale) or an assumed share of capex.</p>
<p><strong>Operating cash flow</strong> is revenue × adjusted EBITDA margin, less cash interest on the debt the model raises (solved year by year), less revenue a customer prepaid in an earlier year. No cash taxes (bonus depreciation, losses) and no working-capital swings. It is the biggest swing factor in 2028–30; the EBITDA slider flexes it.</p>
<p><strong>Debt or equity needed</strong> is what’s left, split by each company’s 2026 financing mix. Scheduled amortization of secured GPU loans (about five years) is shown as refinancing on top. Bullet maturities inside the window, such as CoreWeave’s 2030 notes and Nebius’ February 2030 converts if they don’t convert, are not included.</p>
<p><strong>Not included:</strong> GPU refresh as 2024–25 fleets come off their first contracts; leased powered shells, whose rent is already inside EBITDA; and Crusoe, whose Abilene campus sits in a separately financed joint venture. Power units differ: CoreWeave counts active power, Nebius connected power, IREN critical IT load.</p>
<h3>CoreWeave CRWV</h3>
<p>At least 8 GW active by 2030 (1.85 GW guided for year-end 2026; 4.2 GW contracted in August).</p>
<ul><li>Capex: 2026 at the $35–39B guidance midpoint. Then +6.15 GW to reach 8 GW (1.35 GW in 2027, then 1.5 / 1.6 / 1.7 GW) at about $32B per GW; most data centers are leased.</li><li>Prepayments counted gross: about $2B arrived in H1 2026, so 2026 is set at $4.0B, then 10% of capex.</li><li>Cash flow: $12.8B of revenue in 2026, then about $9.5B per GW-year of average active power (consistent with the ~$30B exit run rate pointed to for 2027). 60% adjusted EBITDA margin (Q2: 59%). 8% cash interest on all debt. The $8.2B deferred-revenue balance comes out over four years.</li><li>2026 raised: $14.2B secured, $6.3B unsecured notes, $8.2B converts, $3B equity.</li></ul>
<h3>Nebius NBIS</h3>
<p>5 GW contracted by year-end 2026, nearly all online within 2 to 3.5 years; 0.8–1 GW connected at year-end 2026; more than 1 GW of new capacity in 2027.</p>
<ul><li>Capex: 2026 at the $20–25B guidance midpoint. Then about 4.1 GW to reach roughly 5 GW, phased 1.1 / 1.4 / 1.1 / 0.5 GW so it lands by early 2030, at about $30B per GW (more than 75% owned sites).</li><li>Prepayments: more than $9B guided for 2026, then 38% of capex (about 70% of Q2 deals carried prepays covering 50–60% of capex).</li><li>Cash flow: $3.2B of revenue in 2026, then about $8B per GW-year of average connected power. EBITDA margin 40% (guided), 45% in 2027, 50% after. 3% cash interest; convert accretion is paid at maturity, not counted here.</li><li>2026 raised: $10.1B of converts and a first $0.78B secured loan.</li></ul>
<h3>IREN IREN</h3>
<p>0.3 GW IT delivered in 2026 and 0.8 GW IT cumulative in 2027; more than 5 GW of secured power; no stated pace after 2027.</p>
<ul><li>Capex: FY27 (Jul 2026–Jun 2027) guided at $25–30B. Calendar 2026 ≈ $3.3B H1 actual plus about half of FY27 ≈ $16B; calendar 2027 ≈ $25.5B. 2028–30 assumes 0.5 GW IT a year at about $43B per GW IT.</li><li>Prepayments at 33% of capex: recent prepays fund 45–55% of GPU capex, and GPUs are about two-thirds of the total.</li><li>Cash flow: about $1.4B of revenue in calendar 2026, then about $13B per GW-year of IT load ($4B of contracted run rate on 0.3 GW). EBITDA margin 35% in 2026, 60–65% after (owned sites, cheap power). 5.5% cash interest.</li><li>2026 raised: $6.45B secured GPU financing, $3.0B converts, about $2.5B equity.</li></ul>
<h3>Lambda private</h3>
<p>3 GW of compute under management by 2030 (private; no capex disclosure).</p>
<ul><li>Capex: backlog went from $15B in June to $50B in September, largely one AI lab, so the path is front-loaded: $6B / $13B / $17B / $19B / $18.5B at about $25B per GW. Prepayments assumed at 10% of capex.</li><li>Cash flow: $1.6B of revenue in 2026 (reported above $1.5B), then about $9B per GW-year. EBITDA margin 30% rising to 45%, lower than owners of their own sites because colocation rent is an operating cost. 7% cash interest.</li><li>2026 raised: $2.9B secured (August and October facilities rated investment grade), plus up to $4B of equity in progress.</li></ul>
<h3>Nscale private</h3>
<p>$103.4B contracted (Microsoft up to $43.8B; Anthropic up to $44.6B for 460 MW at Monarch, WV); 1.37 GW active and contracted; Monarch to 2 GW by H1 2028.</p>
<ul><li>Capex, from the S-1: $3.2B in H1 2026 plus $24B of equipment and $3.5B of construction committed, payable mainly in 2026–27, so about $12B in 2026 and $20B in 2027. 2028 covers the Anthropic and Monarch build (~$15B); 2029–30 assumed at $8–9B a year.</li><li>Prepayments average about 23% of contract value at signing; deferred revenue went from $2.0B to $6.5B in H1, so 2026 is set at $6B and later years at 30% of capex.</li><li>Cash flow: revenue from the $103.4B of contracts as they deliver, about $0.75B / $5B / $11B / $16B / $18B. EBITDA margin −50% in 2026 (H1: −142%), 35% in 2027, 50–55% after. 6.5% cash interest. Early losses add to the external need.</li><li>The S-1 says no binding financing is in place yet for the Anthropic contracts.</li></ul>
<p><strong>Source links</strong></p>
<ul><li><a href="https://finance.yahoo.com/quote/CRWV/earnings/CRWV-Q2-2026-earnings_call-662772.html">CoreWeave Q2 2026 call</a></li><li><a href="https://investors.coreweave.com/news/news-details/2026/CoreWeave-Reports-Strong-Second-Quarter-2026-Results/default.aspx">CoreWeave Q2 2026 results</a></li><li><a href="https://www.theglobeandmail.com/investing/markets/stocks/CRWV-Q/pressreleases/3917877/coreweave-crwv-q2-2026-earnings-call-transcript/">CoreWeave 8 GW target</a></li><li><a href="https://investors.coreweave.com/news/news-details/2026/CoreWeave-Closes-Landmark-8-5-Billion-Financing-Facility-Achieving-First-Investment-Grade-Rated-GPU-backed-Financing/default.aspx">CoreWeave DDTL 4.0</a></li><li><a href="https://investors.coreweave.com/news/news-details/2026/CoreWeave-Closes-3-1-Billion-Loan-Facility-Expanding-Access-to-Public-Markets-for-GPU-Backed-Financing/default.aspx">CoreWeave DDTL 5.0</a></li><li><a href="https://investors.coreweave.com/news/news-details/2026/CoreWeave-Announces-Upsize-and-Pricing-of-1750-Million-of-Senior-Notes/default.aspx">CoreWeave 9.75% 2031 notes</a></li><li><a href="https://www.businesswire.com/news/home/20260611950890/en/CoreWeave-Announces-Pricing-of-$1.25-Billion-of-Senior-Notes-and-%E2%82%AC2-Billion-of-Senior-Notes">CoreWeave June notes</a></li><li><a href="https://investors.coreweave.com/news/news-details/2026/CoreWeave-Prices-Upsized-3-5-Billion-Convertible-Senior-Notes-Offering/default.aspx">CoreWeave April converts</a></li><li><a href="https://blockspace.media/insight/coreweave-closes-4-2-billion-convertible-notes-offering/">CoreWeave September converts</a></li><li><a href="https://www.stocktitan.net/articles/coreweave-nebius-ai-cloud-debt-when-it-comes-due">CoreWeave and Nebius debt stack</a></li><li><a href="https://www.benzinga.com/markets/tech/26/10/62412918/coreweave-bonds-distress-ai-darwin-moment-hartnett">CoreWeave CDS and bond prices, Oct 16</a></li><li><a href="https://finance.yahoo.com/markets/options/articles/coreweave-ai-bonds-tumble-raising-111700097.html">CoreWeave bonds and the HY index</a></li><li><a href="https://www.fool.com/earnings/call-transcripts/2026/08/19/nebius-nbis-q2-2026-earnings-call-transcript/">Nebius Q2 2026 call</a></li><li><a href="https://www.sec.gov/Archives/edgar/data/1513845/000110465926029863/tm268409d3_ex99-1.htm">Nebius March 2026 converts</a></li><li><a href="https://www.sec.gov/Archives/edgar/data/0001513845/000110465926098924/tm2623617d1_ex99-1.htm">Nebius August 2026 converts</a></li><li><a href="https://www.globenewswire.com/news-release/2026/08/27/3352401/0/en/iren-reports-fy26-results.html">IREN FY26 results</a></li><li><a href="https://www.marketbeat.com/instant-alerts/transcript-iren-q4-earnings-call-highlights-2026-08-27/">IREN FY27 capex guidance</a></li><li><a href="https://www.globenewswire.com/news-release/2026/06/01/3304211/0/en/iren-closes-3-65bn-investment-grade-gpu-financing.html">IREN investment-grade GPU financing</a></li><li><a href="https://www.globenewswire.com/news-release/2026/05/14/3295320/0/en/iren-closes-3-0-billion-convertible-notes-offering.html">IREN May 2026 converts</a></li><li><a href="https://lambda.ai/blog/lambda-prices-926-million-senior-secured-term-loan-b-facility">Lambda term loan B</a></li><li><a href="https://lambda.ai/blog/lambda-closes-1-billion-senior-secured-fixed-rate-financing">Lambda fixed-rate financing</a></li><li><a href="https://techcrunch.com/2026/10/06/ai-computing-startup-lambda-to-raise-4b-ahead-of-planned-ipo/">Lambda pre-IPO raise</a></li><li><a href="https://www.theenergymag.com/news/2026-09-19/nscale-ipo-ai-contract-funding">Nscale S-1 contracts and commitments</a></li><li><a href="https://www.mostlymetrics.com/p/nscale-ipo-s1-breakdown">Nscale S-1 breakdown</a></li><li><a href="https://www.nscale.com/press-releases/pre-ipo-convertible-financing">Nscale pre-IPO converts</a></li><li><a href="https://ryanoconnellfinance.com/fed-rate-dashboard/">Fed funds and SOFR, Oct 15</a></li></ul>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
<item>
  <title>Who pays for the AI buildout?</title>
  <link>https://06.ai/packs/hyperscaler-capex-funding</link>
  <guid isPermaLink="true">https://06.ai/packs/hyperscaler-capex-funding</guid>
  <pubDate>Fri, 16 Oct 2026 12:01:00 GMT</pubDate>
  <description>Capex the four hyperscalers need through 2030, and how much of it operating cash flow can’t cover.</description>
  <category>AI infrastructure</category>
  <enclosure url="https://06.ai/newsletter/hyperscaler-capex-funding/cover.png" length="48895" type="image/png" />
  <media:content url="https://06.ai/newsletter/hyperscaler-capex-funding/cover.png" medium="image" type="image/png" />
  <content:encoded><![CDATA[<figure><a href="https://06.ai/packs/hyperscaler-capex-funding"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/thumb.png" alt="Who pays for the AI buildout?" width="421" height="398"></a><figcaption><a href="https://06.ai/packs/hyperscaler-capex-funding">Interactive version and data on 06.ai →</a></figcaption></figure>
<p>On Street consensus numbers, Microsoft, Alphabet, Amazon and Meta need about <strong>$438B</strong> of debt or equity over 2026–30 — <strong>8%</strong> of capex. The rest comes out of operating cash flow.</p>
<ul><li><strong>$5.29T</strong> — Capex, 2026–30. All four · Street consensus</li><li><strong>$4.85T</strong> — Covered by operating cash flow. Capped at each year's capex</li><li><strong>$438B</strong> — Needs debt or equity. 8% of capex</li></ul>
<h2>Capex by year, and how it gets paid for</h2>
<figure><a href="https://06.ai/packs/hyperscaler-capex-funding#chart"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/fig-01.png" alt="Capex by year, and how it gets paid for" width="694" height="462"></a><figcaption>Full bar = capex. Orange is what operating cash flow can’t cover. The black tick marks operating cash flow — above the bar is a cushion. Shown: Street consensus · All four.</figcaption></figure>
<h3>By company</h3>
<figure><a href="https://06.ai/packs/hyperscaler-capex-funding#chart"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/fig-02.png" alt="Capex by year, and how it gets paid for — MSFT" width="694" height="493"></a><figcaption><strong>MSFT</strong>: Capex, 2026–30 $1.15T · Covered by operating cash flow $1.15T · Needs debt or equity $0B</figcaption></figure>
<figure><a href="https://06.ai/packs/hyperscaler-capex-funding#chart"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/fig-03.png" alt="Capex by year, and how it gets paid for — GOOGL" width="694" height="493"></a><figcaption><strong>GOOGL</strong>: Capex, 2026–30 $1.53T · Covered by operating cash flow $1.36T · Needs debt or equity $165B</figcaption></figure>
<figure><a href="https://06.ai/packs/hyperscaler-capex-funding#chart"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/fig-04.png" alt="Capex by year, and how it gets paid for — AMZN" width="694" height="493"></a><figcaption><strong>AMZN</strong>: Capex, 2026–30 $1.5T · Covered by operating cash flow $1.39T · Needs debt or equity $110B</figcaption></figure>
<figure><a href="https://06.ai/packs/hyperscaler-capex-funding#chart"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/fig-05.png" alt="Capex by year, and how it gets paid for — META" width="694" height="493"></a><figcaption><strong>META</strong>: Capex, 2026–30 $1.11T · Covered by operating cash flow $945B · Needs debt or equity $163B</figcaption></figure>
<h2>Cumulative 2026–30 by company</h2>
<p>$B. Dividends and buybacks aren't deducted, so the true need is larger where payouts continue.</p>
<figure><a href="https://06.ai/packs/hyperscaler-capex-funding#breakdown"><img src="https://06.ai/newsletter/hyperscaler-capex-funding/fig-06.png" alt="Microsoft — Capex: $1.15T · Cash-flow funded: $1.15T · Debt / equity: $0B · Share: 0%; Alphabet — Capex: $1.53T · Cash-flow funded: $1.36T · Debt / equity: $165B · Share: 11% · Peak gap: 2027; Amazon — Capex: $1.5T · Cash-flow funded: $1.39T · Debt / equity: $110B · Share: 7% · Peak gap: 2026; Meta — Capex: $1.11T · Cash-flow funded: $945B · Debt / equity: $163B · Share: 15% · Peak gap: 2028; All four — Capex: $5.29T · Cash-flow funded: $4.85T · Debt / equity: $438B · Share: 8% · Peak gap: 2027" width="694" height="270"></a></figure>
<h2>The gap is real, but small against the balance sheets</h2>
<p>Microsoft funds everything from cash flow on every path. Alphabet ($165B), Meta ($163B) and Amazon ($110B) run gaps concentrated in 2027–28, and some of that is already pre-funded — Alphabet raised $84.75B of equity in June, and all three have issued bonds. Moving to management’s stated targets adds only about $36B: their own targets already roughly match Street numbers.</p>
<h2>Why there’s no prepay line</h2>
<p>These four are the funding source. They invest in the labs, and the labs commit that money back as cloud spend. None of them reports capex-linked customer prepayments. That changes if a cash-rich lab — after an IPO, say — starts paying hyperscalers up front; that would be worth watching.</p>
<h2>Where Oracle and SpaceX went</h2>
<p>Both build at hyperscaler scale but fund like something in between: capex far above cash flow, customer prepays or chip financing, concentrated lab customers, BBB-area credit. They have their own pack: <a href="https://06.ai/packs/leveraged-middle">The leveraged middle</a>.</p>
<h2>What this is anchored on</h2>
<p>Guidance, stated targets and analyst estimates as of October 16, 2026.</p>
<ul><li><strong>MSFT</strong> — CY26 capex incl. finance leases ~$175B (was ~$190B before lease-accounting change); FY27 to grow YoY; FY26 OCF $183B · Microsoft FY26 Q4 call, Jul 29 2026</li><li><strong>MSFT</strong> — $329B of data-center leases signed but not yet commenced (operating leases, outside capex) · Microsoft FY26 10-K</li><li><strong>GOOGL</strong> — 2026 capex $195–205B; 2027 to rise 'significantly'; Q2 FCF −$5.9B (first negative since IPO) · Alphabet Q2 2026 results, Jul 2026</li><li><strong>GOOGL</strong> — $84.75B equity raise (Jun 2026) incl. $40B ATM from Q3; LT debt $98.2B at Jun 30 · Alphabet release Jun 3 2026; Q2 balance sheet</li><li><strong>AMZN</strong> — 2026 cash capex ~$220B; goal to double power capacity by end-2027 vs 2025; TTM FCF −$7.6B · Amazon Q2 2026 call, Jul 30 2026</li><li><strong>META</strong> — 2026 capex $130–145B; 'at least $600B' US infra spend through 2028; ~14 GW compute target · Meta Q2 2026; Zuckerberg (Sep 2025); Citi</li><li><strong>ALL</strong> — 2027 Street capex: Citi GOOGL $308B / META $205B / AMZN $288B; Morgan Stanley META $225B→$250B (2028), AMZN $308B→$318B · Citi Jul 2026; Morgan Stanley Sep 2026</li></ul>
<h2>Method</h2>
<p><strong>Capex</strong> is calendar-year. 2026 is latest company guidance at midpoints (Microsoft on its post-lease-change basis). 2027–28 blend Citi, Morgan Stanley and LSEG consensus; 2029–30 assume growth flattening toward 2030, as consensus implies. “Stated targets” uses paths that hit what management has said: Meta’s $600B-through-2028 pledge and Amazon’s doubled power by end-2027. Microsoft and Alphabet have no quantified target beyond “grow”, so they match Street.</p>
<p><strong>Operating cash flow</strong> is our estimate, triangulated from FY26 actuals and published 2027 FCF estimates (S&amp;P, MarketScreener, BofA, TIKR); 2029–30 are extrapolated. Each year, cash flow covers capex up to its level; a surplus isn’t carried into the next year.</p>
<p><strong>Not in capex:</strong> operating leases signed but not commenced — $329B Microsoft, ~$279B Meta, $137B Amazon, $85B Alphabet — a second, off-balance-sheet funding channel.</p>
<hr>
<p>Every chart above links to its interactive version on 06.ai, with the data behind it. The daily trackers are at <a href="https://06.ai/trackers">06.ai/trackers</a>.</p>
<p><em>Not investment advice. Estimates are labeled as estimates.</em></p>]]></content:encoded>
</item>
</channel>
</rss>
