While PC gamers fight for 16GB of VRAM, AMD just unveiled a rack with 31,000 Gigabytes
This is where all our RAM is going
It’s getting harder to ignore the widening silicon inequality gap in the tech world right now thanks to RAMageddon. On one side, you have consumer PC gamers dealing with overpriced PC components, wondering if a standard 8-core CPU and 16GB of VRAM is enough to handle modern AAA games. On the other side, you have enterprise AI machines operating in a whole other universe of compute.
During its Advancing AI 2026 event, AMD announced an enormous 256-core CPU alongside the AMD Helios Rackscale solution — a single server cabinet packing a staggering 31 terabytes of high-bandwidth VRAM. No, these numbers are not typos!
Naturally, you can’t walk into your local Micro Center and buy one of these. Don’t get me wrong, the numbers are cool, but in a time where I might have to donate a kidney to afford a decent amount of RAM, it leaves a bad taste to see 31,000 gigabytes of it being (potentially) used to generate low-quality AI videos.
Here's what you need to know about AMD's enterprise CPU and server rack, along with how they stack up against a popular consumer GPU.
The 256-Core CPU
To put things into perspective, let’s consider the best gaming PCs. A high-end gaming CPU like the Ryzen 9 9950X tops out at 16 cores, which is plenty for running Cyberpunk 2077 or editing 4K videos.
Conversely, AMD’s new 6th Gen EPYC 9006 Series (SP7) server processor packs up to 256 cores and 512 threads onto a single chip, with high-frequency variants like the EPYC 9006X pushing boost speeds up to 5.15GHz. That’s 16 times the core count of a flagship desktop processor. EPYC would be an entire LAN party on one chip.
So, what’s the need to have 256 cores on a single die? AMD built these chips specifically to handle the massive overhead of agentic AI. Modern AI agents have to run code in isolated sandboxes, manage huge system memory states, and coordinate heavy feeds. This all takes a massive amount of computing power and is a far cry from our gaming PCs having to render ray-traced shadows.
Get instant access to breaking news, the hottest reviews, great deals and helpful tips.
Helios Rackscale
If you thought the CPU numbers sound wild, the RAM numbers are even more mind-blowing. The centerpiece of AMD’s announcement is the Helios Rackscale solution, which is an open-architecture AI system.
Inside a single server rack sit 18 compute trays holding a total of 72 AMD Instinct MI455X GPUs. Combined, this single cabinet delivers 31 terabytes (31,000 GB) of HBM4 VRAM with a whopping 1.7 petabytes per second of memory bandwidth.
For context, 31TB of VRAM is equivalent to roughly 1,937 Nvidia RTX 5070 Ti graphics cards chained together!
These are insane numbers when compared to what a typical gaming GPU is packing. It’s definitely impressive, but at the same time, that’s offset by the knowledge that a good chunk of the world’s RAM is going to server racks like this.
Helios Rack vs. RTX 5070 Ti
To give you an understanding of how monstrous a single Helios rack is, let’s compare its raw specs against one of the most popular upper-midrange consumer GPUs out now: The Nvidia RTX 5070 Ti (16GB GDDR7).
Feature / Spec |
Nvidia RTX 5070 Ti (desktop) |
AMD Helios Rackscale solution |
Performance equivalent |
|---|---|---|---|
VRAM capacity |
16GB GDDR7 |
31,000 GB (31 TB) HBM4 |
~1,937 RTX 5070 Tis |
Memory bandwidth |
896 GB/s |
1.7 petabytes/sec (1,700,000 GB/s) |
~1,897 RTX 5070 Tis streaming simultaneously |
Peak AI compute (FP4) |
~1,406 TFLOPS |
2.9 exaflops (2,900,000 TFLOPS) |
~2,062 RTX 5070 Tis firing at max throughput |
GPU count |
1 GPU |
72 Instinct MI455X GPUs |
1 unified server cabinet |
Looking at it through this lens, a single server rack packs the raw memory bandwidth of nearly 1,900 desktop PCs working in unison! This is a whole other level of computing, my friends.
Bottom line
AMD is certainly flexing its tech muscles with this announcement. However, there’s a sobering reality behind these staggering numbers. Seeing a single server rack hog 31 terabytes of high-bandwidth memory shows exactly where the global supply chain is funneling its resources. Namely, it’s all being swallowed by the AI boom (or bubble — however you see it). As a lifelong gamer, it hurts being pushed to the side.
Even if it stings, we can’t fault AMD for choosing to invest in more lucrative enterprise projects like this rather than in the average consumer. So, the next time you find yourself debating whether to pay a premium for a 16GB graphics card over an 8GB model, or wondering why PC component prices keep climbing, you now have a better idea of why.
Follow Tom's Guide on Google News and add us as a preferred source to get our up-to-date news, analysis, and reviews in your feeds.
More from Tom's Guide
- SK Hynix warns 2027 will be 'worst year' for RAM prices — right as a damning report reveals something that will add fuel to the price-fixing lawsuit
- OpenAI just made its biggest move against Nvidia — and it could make ChatGPT cheaper to run
- Apple seeks RAM from blacklisted Chinese company as memory shortage impacts everything — but it may not be enough

Tony is a computing writer at Tom’s Guide covering laptops, tablets, Windows, and iOS. During his off-hours, Tony enjoys reading comic books, playing video games, reading speculative fiction novels, and spending too much time on X/Twitter. His non-nerdy pursuits involve attending Hard Rock/Heavy Metal concerts and going to NYC bars with friends and colleagues. His work has appeared in publications such as Laptop Mag, PC Mag, and various independent gaming sites.
You must confirm your public display name before commenting
Please logout and then login again, you will then be prompted to enter your display name.