OpenModelsHQ

DGX Spark

NVIDIA · AI box

DGX Spark has 128 GB of memory, about 108.8 GB of it usable for models, and 273 GB/s of memory bandwidth. 418 open models in our directory fit at 4-bit.

Estimated usable for models
108.8GB
An allowance, shared with the system
Total memory
128 GB
Bandwidth
273 GB/s
Models that fit at 4-bit
418
Within 97.9 GB, 90% of usable

AI box memory allowance: about 85% of total memory is counted as usable for models, because the memory is shared with the operating system.

The 240 W figure is the power supply rating for the whole system; NVIDIA lists the GB10 chip at 140 W. Memory is shared between CPU and GPU. A 64GB version is listed by NVIDIA as coming soon through OEM partners.

Planning a multi-GPU deployment? Check NVLink domains and network topology as well as memory fit. A GPU specification alone does not establish the interconnect in a server or cloud allocation.

What fits by category
On DGX Spark at 4-bit, 418 models fit, 0 are tight and 73 are too big, across 6 categories. Fits means the estimate is within 90% of usable memory; tight is between 90% and 100%. Models without a published size are left out.
What fits by category: data
CategoryFitsTightToo bigTotal
LLM227053280
Vision86020106
Image240024
Video220022
Speech400040
Embedding190019

Largest open models that fit at 4-bit

See all 418 in the table

A model fits when its 4-bit memory estimate (8k context) stays within 90% of usable memory, about 97.9 GB here. Showing the 30 largest of 418.

ModelTypeSizeMemory at 4-bit
Vision124B88.7 GB
LLM124B82.4 GB
LLM124B82.4 GB
Vision112B79.7 GB
LLM111B79.2 GB
LLM117B77.4 GB
Vision109B77.4 GB
LLM110B74.6 GB
Vision104B72.1 GB
LLM103B69.5 GB
Image83B56 GB
LLM80.4B54.2 GB
LLM78.1B51.7 GB
Vision73.4B51.4 GB
Vision72B51.3 GB
Vision71.9B51.3 GB
LLM70.6B50.3 GB
LLM70.6B50.3 GB
LLM70.6B49.5 GB
LLM70.6B49.5 GB
LLM41.8B45.3 GB
LLM67.2B45.2 GB
LLM51.6B36.8 GB
LLM51.6B36.8 GB
LLM51.6B35.2 GB
LLM51.6B35.2 GB
LLM49.1B34.7 GB
LLM40.4B28.5 GB
LLM40.4B28.5 GB
LLM40.4B28.5 GB

These are memory checks, not speed or runtime compatibility results.

Compared with

All hardware
HardwareTotal memoryUsable for modelsBandwidth
DGX SparkThis device
128 GB≈ 108.8 GB273 GB/s
128 GB≈ 96 GB614 GB/s
128 GB≈ 96 GB614 GB/s
128 GB≈ 96 GB546 GB/s

Capacity and bandwidth answer different questions: memory decides what fits, bandwidth drives how fast it runs.

Launch dates, useful-life evidence and ownership cost scenarios