🤖AMD Reveals Helion Racks for AI at OCP Summit
AMD's new Helion racks for AI are a game-changer
TL;DR
AMD introduces Helion racks for AI, offering CPU-only and mixed CPU/GPU configurations. The CPU-only version supports up to 32,768 Zen 6 cores and 16 Instinct MI350P GPUs, with 102 Tbps networking. Available for partner-built configurations in November 2026.
AMD just unveiled Helion racks for AI agents at the OCP summit, offering both CPU-only and mixed CPU/GPU configurations. The CPU-only version supports up to 32,768 Zen 6 cores and 16 Instinct MI350P GPUs, delivering 102 Tbps of networking bandwidth. This is a big deal for anyone running AI workloads, as it provides dedicated capacity for agent execution and connections to separate model inference infrastructure. The enterprise configuration combines agent execution, GPU inference, and supporting workloads in one rack, using EPYC 9006 chips rated at 400 W for dense deployments and 600 W for balanced blades. The Helion racks are designed to bring Epyc performance, open software, and flexible rack designs together, allowing partners to build systems around customer needs and make efficient use of available power.
Key Points
AMD Helion racks offer CPU-only and mixed CPU/GPU configurations for AI agents.
CPU-only version supports up to 32,768 Zen 6 cores and 16 Instinct MI350P GPUs.
Networking bandwidth up to 102 Tbps in CPU-only configuration.
Enterprise configuration uses EPYC 9006 chips rated at 400 W for dense deployments.
Helion racks available for partner-built configurations in November 2026.
Why It Matters
If you're running AI workloads, AMD's Helion racks offer a dedicated capacity for agent execution and connections to separate model inference infrastructure. The CPU-only version supports up to 32,768 Zen 6 cores and 16 Instinct MI350P GPUs, making it a powerful solution for large-scale AI deployments. The enterprise configuration combines agent execution, GPU inference, and supporting workloads in one rack, using EPYC 9006 chips rated at 400 W for dense deployments and 600 W for balanced blades.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.
Join 3,569 builders reading daily.