💰AI Spending Surges Ahead of Maturity
Enterprises are overspending on AI infrastructure
TL;DR
New data shows companies are ramping up AI spend faster than they can track costs or utilization. Most run AI on familiar platforms, but plans to switch providers suggest a shift is coming.
Across 107 enterprises, AI infrastructure spending is accelerating far ahead of the ability to see or steer its economics. Most organizations rely on hyperscalers and model-provider APIs for their AI needs, with Google Cloud leading at 48%. However, only about one in five (21%) run AI in production at scale, while fewer than half rigorously track what their compute actually costs. The next dollar is aimed at specialized compute almost none of them use today, indicating a shift towards more tailored solutions.
Key Points
Across 107 enterprises, AI infrastructure spend is outpacing maturity metrics
Google Cloud dominates at 48%, followed by Azure (29%) and AWS (22%)
Only 6% run their own on-prem GPU clusters; 4% use custom open-source stacks
Most can't track costs or utilization accurately: GPUs sit at half capacity
A majority plan to switch providers within a year, with 38% doing so in Q1
Why It Matters
If you're running AI workloads on Google Cloud, the shift towards specialized compute could impact your budget. With only one in five enterprises scaling production AI and most struggling to track costs, this signals a period of rapid change for cloud providers and their pricing models.
Frequently Asked Questions
Why does this matter?
If you're running AI workloads on Google Cloud, the shift towards specialized compute could impact your budget. With only one in five enterprises scaling production AI and most struggling to track costs, this signals a period of rapid change for cloud providers and their pricing models.
What happened?
New data shows companies are ramping up AI spend faster than they can track costs or utilization. Most run AI on familiar platforms, but plans to switch providers suggest a shift is coming.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.
Join 2,077 builders reading daily.