Compare how different systems and devices run local AI
Pick two to four systems or devices to see which runs more models, faster, for the kind of work you do.
Popular comparisons
-
RTX 4090
24 GB1,008 GB/s
RTX 5090
32 GB1,792 GB/s
RTX 5090: 8 GB more memory, 1.8× the bandwidth
-
RTX 3090
24 GB936 GB/s
RTX 4090
24 GB1,008 GB/s
Same 24 GB · RTX 4090: 2.3× the compute
-
RTX 4060 Ti 16GB
16 GB288 GB/s
RTX 4070 SUPER
12 GB504 GB/s
RTX 4060 Ti 16GB: 4 GB more memory · RTX 4070 SUPER: 1.8× the bandwidth
-
RTX 3060 12GB
12 GB360 GB/s
RTX 4060
8 GB272 GB/s
RTX 3060 12GB: 4 GB more memory, 1.3× the bandwidth
-
RX 7900 XTX
24 GB960 GB/s
RTX 4090
24 GB1,008 GB/s
Same 24 GB · similar speed
-
M4 Max (128 GB)
128 GB546 GB/s
RTX 5090
32 GB1,792 GB/s
M4 Max (128 GB): 96 GB more memory · RTX 5090: 3.3× the bandwidth
-
M4 Pro (48 GB)
48 GB273 GB/s
M4 Max (64 GB)
64 GB546 GB/s
M4 Max (64 GB): 16 GB more memory, 2× the bandwidth
-
Arc B580
12 GB456 GB/s
RTX 3060 12GB
12 GB360 GB/s
Same 12 GB · Arc B580: 1.3× the bandwidth
-
RX 9070 XT
16 GB640 GB/s
RTX 5070 Ti
16 GB896 GB/s
Same 16 GB · RTX 5070 Ti: 1.4× the bandwidth
-
M3 Ultra (256 GB)
256 GB819 GB/s
RTX PRO 6000 Blackwell
96 GB1,792 GB/s
M3 Ultra (256 GB): 160 GB more memory · RTX PRO 6000 Blackwell: 2.2× the bandwidth
-
RTX 3090
24 GB936 GB/s
RTX 4090
24 GB1,008 GB/s
RTX 5090
32 GB1,792 GB/s
RTX 5090 leads on memory (32 GB) and bandwidth (1,792 GB/s)
-
M4 Pro (48 GB)
48 GB273 GB/s
M4 Max (64 GB)
64 GB546 GB/s
M4 Max (128 GB)
128 GB546 GB/s
RTX 5090
32 GB1,792 GB/s
Most memory: M4 Max (128 GB) · Fastest memory: RTX 5090 (1,792 GB/s)
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.