A look at the deluge of AI computing power set to come online in the coming years; Epoch AI expects the number of AI chips in use to double every nine months
The milestones for artificial intelligence keep getting grander. — In 2023, an A.I. system passed the bar exam.LinkedIn:William GarrityLinkedIn:William Garrity:We shouldn't talk about artificial intelligence as though it were weightless - software floating somewhere in “the cloud.” — It is not. …
Context & Ripple Effects
This forecast extends coverage of an AI data-center buildout already marked by limits and return-on-investment questions, including the large pipeline of U.S. capacity under construction, planning, or review. It puts a concrete growth cadence on the physical infrastructure behind model development and deployment.
The expansion also arrives as [[a:1171551|AI sales have exceeded estimated data-center and chip depreciation costs while margins remain thin]], making utilization and efficiency as important as headline capacity additions.
First-order effects
- Chipmakers, data-center operators, cloud providers, and large AI developers face a faster-moving capacity-planning cycle if the projected chip deployment rate materializes.
- More compute coming online raises the near-term importance of power, cooling, storage, networking, and facility delivery alongside the chips themselves.
Second-order effects
- AI infrastructure buyers will face stronger pressure to keep new capacity utilized and improve performance per GPU, because rapid additions can amplify depreciation and margin pressure.
- The buildout widens the competitive gap between organizations able to finance and operate data-center-scale compute and smaller AI developers dependent on rented capacity.
Third-order effects
- If sustained, the pattern would make AI progress increasingly tied to industrial supply chains and utility-scale infrastructure rather than software alone.
- The central constraint may shift from access to chips toward the duration and economics of infrastructure commitments: whether demand and revenue can support continuously refreshed capacity remains unresolved.
The trend: AI is industrializing into a capital-intensive infrastructure race in which compute scale, utilization, and physical delivery increasingly shape who can advance and commercialize models.