🤖AMD's Gorgon Halo SoC Arrives with 192 GB Unified Memory
The new Gorgon Halo is here, but it's pricey
TL;DR
AMD's Gorgon Halo SoC, featuring 192 GB of unified memory, is now available starting at $6,799. This is a big deal for AI enthusiasts and developers working with large language models, but the price tag is steep.
AMD's Gorgon Halo SoC has arrived with a whopping 192 GB of unified memory, making it a game-changer for AI enthusiasts and developers working with large language models. The platform supports up to 345 billion parameters on Linux and 320 billion on Windows, thanks to its high memory bandwidth of 273 GB/s. However, the regular pricing starts at $6,799, making it a significant investment. The ongoing memory shortage has pushed prices up, with DDR5 prices now around $4,000, and LPDDR5x in short supply due to the AI boom. This means Gorgon Halo-based products will likely be even pricier, with Nvidia's AI workstations doubling in price over the past year.
Key Points
Gorgon Halo SoC supports up to 192 GB of unified memory, starting at $6,799.
Memory partitioning on Linux allows for nearly all available memory to be used, up to 345 billion parameters.
Memory bandwidth on Gorgon Halo is 273 GB/s, 6.5% faster than Strix Halo's 256 GB/s.
DDR5 prices have skyrocketed to around $4,000 due to the ongoing memory shortage.
Samsung warns memory supplies will remain constrained through 2028, affecting AI-optimized products.
Why It Matters
If you're working with large language models on Linux, Gorgon Halo's 192 GB of unified memory and 345 billion parameter capacity is a huge upgrade. However, the $6,799 price tag and ongoing memory shortage mean you'll need a solid budget and patience to get your hands on it.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.