OpenModelsHQ

RTX PRO 6000 Blackwell

NVIDIA · Workstation GPU

RTX PRO 6000 Blackwell has 96 GB of memory and 1,792 GB/s of memory bandwidth. 417 open models in our directory fit at 4-bit.

Usable for models, before runtime overhead
96GB
Listed memory, before overhead
Total memory
96 GB
Bandwidth
1,792 GB/s
Models that fit at 4-bit
417
Within 86.4 GB, 90% of usable

Figures are for the Workstation Edition (600 W). The Max-Q edition has the same 96GB but is limited to 300 W.

Planning a multi-GPU deployment? Check NVLink domains and network topology as well as memory fit. A GPU specification alone does not establish the interconnect in a server or cloud allocation.

What fits by category
On RTX PRO 6000 Blackwell at 4-bit, 417 models fit, 1 are tight and 73 are too big, across 6 categories. Fits means the estimate is within 90% of usable memory; tight is between 90% and 100%. Models without a published size are left out.
What fits by category: data
CategoryFitsTightToo bigTotal
LLM227053280
Vision85120106
Image240024
Video220022
Speech400040
Embedding190019

Largest open models that fit at 4-bit

See all 417 in the table

A model fits when its 4-bit memory estimate (8k context) stays within 90% of usable memory, about 86.4 GB here. Showing the 30 largest of 417.

ModelTypeSizeMemory at 4-bit
LLM124B82.4 GB
LLM124B82.4 GB
Vision112B79.7 GB
LLM111B79.2 GB
LLM117B77.4 GB
Vision109B77.4 GB
LLM110B74.6 GB
Vision104B72.1 GB
LLM103B69.5 GB
Image83B56 GB
LLM80.4B54.2 GB
LLM78.1B51.7 GB
Vision73.4B51.4 GB
Vision72B51.3 GB
Vision71.9B51.3 GB
LLM70.6B50.3 GB
LLM70.6B50.3 GB
LLM70.6B49.5 GB
LLM70.6B49.5 GB
LLM41.8B45.3 GB
LLM67.2B45.2 GB
LLM51.6B36.8 GB
LLM51.6B36.8 GB
LLM51.6B35.2 GB
LLM51.6B35.2 GB
LLM49.1B34.7 GB
LLM40.4B28.5 GB
LLM40.4B28.5 GB
LLM40.4B28.5 GB
LLM40.4B28.5 GB

These are memory checks, not speed or runtime compatibility results.

Compared with

All hardware
HardwareTotal memoryUsable for modelsBandwidth
RTX PRO 6000 BlackwellThis device
96 GBUp to 96 GB1,792 GB/s
32 GBUp to 32 GB640 GB/s
24 GBUp to 24 GB456 GB/s
96 GB≈ 72 GB1,200 GB/s

Capacity and bandwidth answer different questions: memory decides what fits, bandwidth drives how fast it runs.

Launch dates, useful-life evidence and ownership cost scenarios