OpenModelsHQ

GeForce RTX 3090

NVIDIA · Consumer GPU Discontinued

GeForce RTX 3090 has 24 GB of memory and 936 GB/s of memory bandwidth. It is discontinued. 360 open models in our directory fit at 4-bit.

Usable for models, before runtime overhead
24GB
Listed memory, before overhead
Total memory
24 GB
Bandwidth
936 GB/s
Models that fit at 4-bit
360
Within 21.6 GB, 90% of usable

Bandwidth is not on NVIDIA's page; 936 GB/s is 384-bit GDDR6X at 19.5 Gbps, as listed on Wikipedia. Used 24GB cards are a common budget pick for local models.

Planning a multi-GPU deployment? Check NVLink domains and network topology as well as memory fit. A GPU specification alone does not establish the interconnect in a server or cloud allocation.

What fits by category
On GeForce RTX 3090 at 4-bit, 360 models fit, 21 are tight and 110 are too big, across 6 categories. Fits means the estimate is within 90% of usable memory; tight is between 90% and 100%. Models without a published size are left out.
What fits by category: data
CategoryFitsTightToo bigTotal
LLM1831681280
Vision75328106
Image221124
Video220022
Speech391040
Embedding190019

Largest open models that fit at 4-bit

See all 360 in the table

A model fits when its 4-bit memory estimate (8k context) stays within 90% of usable memory, about 21.6 GB here. Showing the 30 largest of 360.

These are memory checks, not speed or runtime compatibility results.

Compared with

All hardware
HardwareTotal memoryUsable for modelsBandwidth
GeForce RTX 3090DiscontinuedThis device
24 GBUp to 24 GB936 GB/s
24 GBUp to 24 GB960 GB/s
GeForce RTX 4090Discontinued
24 GBUp to 24 GB1,008 GB/s
16 GBUp to 16 GB448 GB/s

Capacity and bandwidth answer different questions: memory decides what fits, bandwidth drives how fast it runs.

Launch dates, useful-life evidence and ownership cost scenarios