OpenModelsHQ

Hardware 53

What can your hardware run? Compare graphics cards and Apple Silicon Macs by the memory available for models. Every Mac configuration gets its own row.

Memory comes first

Hardware type
Hardware
256 GB≈ 192 GB1,200 GB/s432
141 GBUp to 141 GB4,800 GB/s420
128 GB≈ 108.8 GB273 GB/s418
128 GB≈ 96 GB614 GB/s417
128 GB≈ 96 GB614 GB/s417
96 GB≈ 72 GB1,200 GB/s408
96 GBUp to 96 GB1,792 GB/s417
80 GBUp to 80 GB2,039 GB/s409
80 GBUp to 80 GB3,350 GB/s409
64 GB≈ 48 GB307 GB/s396
64 GB≈ 48 GB614 GB/s396
64 GB≈ 48 GB614 GB/s396
64 GB≈ 48 GB307 GB/s396
48 GBUp to 48 GB864 GB/s396
48 GB≈ 36 GB307 GB/s391
48 GB≈ 36 GB614 GB/s391
48 GB≈ 36 GB614 GB/s391
48 GB≈ 36 GB307 GB/s391
36 GB≈ 23.8 GB460 GB/s359
36 GB≈ 23.8 GB460 GB/s359
32 GBUp to 32 GB1,792 GB/s391
32 GB≈ 21.1 GB170 GB/s352
32 GB≈ 21.1 GB153 GB/s352
32 GBUp to 32 GB640 GB/s391
24 GBUp to 24 GB456 GB/s360
24 GBUp to 24 GB300 GB/s360
24 GB≈ 15.8 GB307 GB/s340
24 GB≈ 15.8 GB170 GB/s340
24 GB≈ 15.8 GB153 GB/s340
24 GB≈ 15.8 GB307 GB/s340
24 GBUp to 24 GB960 GB/s360
16 GBUp to 16 GB448 GB/s341
16 GBUp to 16 GB896 GB/s341
16 GBUp to 16 GB960 GB/s341
16 GB≈ 10.6 GB153 GB/s311
16 GB≈ 10.6 GB153 GB/s311
16 GBUp to 16 GB640 GB/s341
512 GB≈ 384 GB819 GB/s460
256 GB≈ 192 GB819 GB/s432
128 GB≈ 96 GB546 GB/s417
128 GB≈ 96 GB546 GB/s417
96 GB≈ 72 GB819 GB/s408
64 GB≈ 48 GB273 GB/s396
48 GB≈ 36 GB273 GB/s391
48 GB≈ 36 GB546 GB/s391
36 GB≈ 23.8 GB410 GB/s359
Mac mini M4 (32GB)Discontinued
32 GB≈ 21.1 GB120 GB/s352
GeForce RTX 3090Discontinued
24 GBUp to 24 GB936 GB/s360
GeForce RTX 4090Discontinued
24 GBUp to 24 GB1,008 GB/s360
Mac mini M4 (16GB)Discontinued
16 GB≈ 10.6 GB120 GB/s311
512 GB≈ 384 GB1,200 GB/s460
RubinAnnounced
288 GBUp to 288 GB19,200 GB/s451
Not announcedNot announcedNot announcedNot announced

Mac memory allowances: about 66% at 36 GB or less, and 75% above. AI boxes allow about 85% because their memory is shared with the operating system. Other GPU figures show memory before runtime overhead. A model fits when its 4-bit estimate stays within 90% of usable memory.