Upcoming LLM Inference Hardware: Tenstorrent Blackhole series: 32GB VRAM with Pooling

By | April 4, 2025

32GB VRAM and four QSFP 800G ports per PCIe card will allow LLM runners to get up-to 128GB VRAM pooling in a single machine, this is the newly launched p150a Blackhole LLM card from Tenstorrent, there is another 28GB model named p100a that has the same up-to 300W power consumption but doesn’t come with QSFP ports for memory pooling. Both of these cards are standard PCIe 5.0 based and will work in x86_64 Intel and AMD platforms under Ubuntu 22.04, these are built on the 6nm fabrication nodes. Pricing starts at $999 for 28GB model and 1,299 for 32GB VRAM model.

Latest Blackhole Series LLM Hardware 2025 Specs:

SpecificationBlackhole p150aBlackhole p100a
ProcessorBlackhole Tensix ProcessorBlackhole Tensix Processor
Core Count140 Tensix Cores120 Tensix Cores
Memory32 GB GDDR628 GB GDDR6
Power ConsumptionUp to 300WUp to 300W
CoolingActive-cooled form factorActive-cooled form factor
ConnectivityFour passive QSFP-DD 800G ports (cables sold separately)No Ethernet or additional ports specified
Target UseDesktop workstations, multi-card linking for memory poolingDesktop workstations
Software SupportFully open-source stack (TT-Forge™, TT-NN™, TT-Metalium™, TT-LLK)Fully open-source stack (TT-Forge™, TT-NN™, TT-Metalium™, TT-LLK)
Manufacturing Process6nm (updated in latest generation)6nm (updated in latest generation)
Memory Bandwidth512 GB/sec448 GB/sec
Price $1,299 (base price for p150 variants)$999 (base price for p100)

Blackhole p150 inference speed numbers

If you wish to use 32GB LLM model in the q4km format like this Deepseek R1 then the file size of that model is 19.9GB, theoretical max tok/s will be around 25.72 tok/s, in real life the speeds will likely be around 15-20 tok/s due to optimization issues on new hardware.

Blackhole p100 inference speed numbers

Similarly, the smaller sibling will have theoretical max tok/s of around 22.5 tok/s, realistic expectations will be 13-18 tok/s.

Blackhole p150 Images:

Blackhole p100 Images

Official website

Leave a Reply