24GB VRAM in a budget class is a dream for many LLM enthusiasts that wants to run these models locally, NVIDIA and AMD thus far decided to only allow max 16GB VRAM in budget category and keep the higher VRAM variants in the juicy enterprise segment, the few available ones in upper mid range too get scalped to stupid markups that doesn’t make sense, now Intel partner Sparkle is coming with 24GB VRAM variant of the Intel ARC B580 GPU specially made for local AI/LLM models. Hopefully by the end of this year we will see more competition in this 24GB VRAM segment as this is the most sought after class of GPUs, currently people have no choice but to buy second hand 3090 for their LLM purpose.
ARC B580 24GB VRAM Memory Specs
| Memory | 24 GB GDDR6 |
| Graphics Memory Interface | 192 bit |
| Graphics Memory Bandwidth | 456 GB/s |
| Graphics Memory Speed | 19 Gbps |
The upcoming ARC GPU is expected to launch with ~250W TBP and all other specs will remain the same as below:
| ARC B580 24GB GPU Specification | |
|---|---|
| Xe-cores | 20 |
| Render Slices | 5 |
| Ray Tracing Units | 20 |
| IntelĀ® Xe Matrix Extensions (IntelĀ® XMX) Engines | 160 |
| Xe Vector Engines | 160 |
| Graphics Clock | 2670 MHz |
| GPU Peak TOPS (Int8) | 233 |
| TBP | 250 W |
| PCI Express Configurations | PCI Express 4.0 x8 |
Intel Arc Page -12GB Model
