H200 SXM
H200 SXM has 141 GB of memory and 4,800 GB/s of memory bandwidth. 420 open models in our directory fit at 4-bit.
NVIDIA lists the power limit as up to 700 W (configurable).
Planning a multi-GPU deployment? Check NVLink domains and network topology as well as memory fit. A GPU specification alone does not establish the interconnect in a server or cloud allocation.
| Category | Fits | Tight | Too big | Total |
|---|---|---|---|---|
| LLM | 228 | 2 | 50 | 280 |
| Vision | 87 | 1 | 18 | 106 |
| Image | 24 | 0 | 0 | 24 |
| Video | 22 | 0 | 0 | 22 |
| Speech | 40 | 0 | 0 | 40 |
| Embedding | 19 | 0 | 0 | 19 |
Largest open models that fit at 4-bit
See all 420 in the tableA model fits when its 4-bit memory estimate (8k context) stays within 90% of usable memory, about 126.9 GB here. Showing the 30 largest of 420.
| Model | Type | Size | Memory at 4-bit |
|---|---|---|---|
| Vision | 180B | 119 GB | |
| LLM | 106B | 112.5 GB | |
| Vision | 124B | 88.7 GB | |
| LLM | 124B | 82.4 GB | |
| LLM | 124B | 82.4 GB | |
| Vision | 112B | 79.7 GB | |
| LLM | 111B | 79.2 GB | |
| LLM | 117B | 77.4 GB | |
| Vision | 109B | 77.4 GB | |
| LLM | 110B | 74.6 GB | |
| Vision | 104B | 72.1 GB | |
| LLM | 103B | 69.5 GB | |
| Image | 83B | 56 GB | |
| LLM | 80.4B | 54.2 GB | |
| LLM | 78.1B | 51.7 GB | |
| Vision | 73.4B | 51.4 GB | |
| Vision | 72B | 51.3 GB | |
| Vision | 71.9B | 51.3 GB | |
| LLM | 70.6B | 50.3 GB | |
| LLM | 70.6B | 50.3 GB | |
| LLM | 70.6B | 49.5 GB | |
| LLM | 70.6B | 49.5 GB | |
| LLM | 41.8B | 45.3 GB | |
| LLM | 67.2B | 45.2 GB | |
| LLM | 51.6B | 36.8 GB | |
| LLM | 51.6B | 36.8 GB | |
| LLM | 51.6B | 35.2 GB | |
| LLM | 51.6B | 35.2 GB | |
| LLM | 49.1B | 34.7 GB | |
| LLM | 40.4B | 28.5 GB |
These are memory checks, not speed or runtime compatibility results.
Compared with
All hardware| Hardware | Total memory | Usable for models | Bandwidth |
|---|---|---|---|
H200 SXMThis device | 141 GB | Up to 141 GB | 4,800 GB/s |
| 80 GB | Up to 80 GB | 2,039 GB/s | |
| 80 GB | Up to 80 GB | 3,350 GB/s | |
| 48 GB | Up to 48 GB | 864 GB/s |
Capacity and bandwidth answer different questions: memory decides what fits, bandwidth drives how fast it runs.
Launch dates, useful-life evidence and ownership cost scenarios