
Hardware · NVIDIA
What AI models can the NVIDIA RTX PRO 4000 Blackwell SFF Edition run?
- VRAM
- 24.0 GB
- Usable for models
- 24.0 GB
- Memory bandwidth
- 432 GB/s
- FP16 compute
- 24.0 TFLOPS
- Released
- 2025
More about this hardware
| Maker | NVIDIA |
|---|---|
| Type | Workstation / datacenter graphics card |
| Interface | PCIe 5.0 |
Apps that run models well on the NVIDIA RTX PRO 4000 Blackwell SFF Edition
10 products with the NVIDIA RTX PRO 4000 Blackwell SFF Edition
- NVIDIA RTX PRO 4000 Blackwell SFF EditionProduct page (opens in a new tab)
Valence Workstation - VWS-172109266Product page (opens in a new tab)
TensorEX Rackmount Workstation - TWS-123065716Product page (opens in a new tab)
TensorEX Rackmount Workstation - TWS-192623777Product page (opens in a new tab)
Valence Workstation - VWS-135223847Product page (opens in a new tab)
Valence Workstation - VWS-173807702Product page (opens in a new tab)
Valence Workstation - VWS-107355433Product page (opens in a new tab)
Valence SFF Workstation - VWF-109025428Product page (opens in a new tab)
Valence Workstation - VWS-130523500Product page (opens in a new tab)
Valence SFF Workstation - VWF-139560981Product page (opens in a new tab)
Best LLMs for the NVIDIA RTX PRO 4000 Blackwell SFF Edition
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Gemma 4 26B-A4B | Q6_K | 23.4 GB | 71.8 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.6 35B-A3B | Q4_K_M | 23.9 GB | 111 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | MiniCPM-V 4.7 35B-A3B | Q4_K_M | 23.4 GB | 111 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.5 35B-A3B | Q4_K_M | 23.9 GB | 111 tok/s | Runs welltight fit |
| 87Excellent quality (A+) · 87 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Nex N2 Mini (35B-A3B) | Q4_K_M | 23.4 GB | 111 tok/s | Runs welltight fit |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | KAT-Coder V2.5 Dev (35B-A3B) | Q4_K_M | 23.1 GB | 111 tok/s | Runs welltight fit |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Sage-A1.5 35B-A3B | Q4_K_M | 23.9 GB | 111 tok/s | Runs welltight fit |
| 83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Raon-1 mini Preview (30B-A4B) | Q4_K_M | 19.4 GB | 87.2 tok/s | Runs great |
| 85Excellent quality (A+) · 85 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Ornith 1.5 35B-A3B | Q4_K_M | 23.9 GB | 111 tok/s | Runs welltight fit |
| 84Great quality (A) · 84 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Apodex 1.1 Mini (35B-A3B) | Q4_K_M | 23.9 GB | 111 tok/s | Runs welltight fit |
| 84Great quality (A) · 84 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Ornith 1.0 35B-A3B | Q4_K_M | 23.9 GB | 111 tok/s | Runs welltight fit |
| 83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | GLM-4.7 Flash (30B-A3B) | Q4_K_M | 21.3 GB | 111 tok/s | Runs welltight fit |
Best Image models for the NVIDIA RTX PRO 4000 Blackwell SFF Edition
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 90Excellent quality (A+) · 90 of 100: how capable the model is at FP8, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Krea 2 Turbo | FP8 | 20.2 GB | 9.8 s | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | ERNIE-Image Turbo | Q8 GGUF | 15.0 GB | 9.3 s | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at FP8, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 9B | FP8 | 19.9 GB | 4.1 s | Runs great |
| 89Excellent quality (A+) · 89 of 100: how capable the model is at FP8, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking. | FLUX 3 Image Klein | FP8 | 12.4 GB | 13 s | Runs great |
| 78Great quality (A) · 78 of 100: how capable the model is at FP16, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 4B | FP16 | 18.1 GB | 2.5 s | Runs great |
| 83Great quality (A) · 83 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | Z-Image Turbo | Q8 GGUF | 13.0 GB | 7.3 s | Runs great |
Best Video models for the NVIDIA RTX PRO 4000 Blackwell SFF Edition
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 86Excellent quality (A+) · 86 of 100: how capable the model is at FP8, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. | LTX-2.5 (22B, video + audio) | FP8 | 19.7 GB | 4.5 min | Runs wellCPU offload |
| 50Fair quality (C) · 50 of 100: how capable the model is at FP16, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. | LTX-Video 2B | FP16 | 17.5 GB | 63 s | Runs great |
| 83Great quality (A) · 83 of 100: how capable the model is at FP8, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. | Bernini-R A14B (video generation + editing) | FP8 | 20.3 GB | 28.7 min | Slowencoder in RAM |
| 45Fair quality (C) · 45 of 100: how capable the model is at FP16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | CogVideoX 2B | FP16 | 17.5 GB | 2.5 min | Runs great |
| 74Great quality (A) · 74 of 100: how capable the model is at FP8, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. | HY-OmniWeaving (8.3B, unified video) | FP8 | 15.7 GB | 21.1 min | Slowencoder in RAM |
Best Decision models for the NVIDIA RTX PRO 4000 Blackwell SFF Edition
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 86Excellent quality (A+) · 86 of 100: how capable the model is at F16, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3.5 | F16 | 3.2 GB | 27 ms | Runs great |
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3 Reranker 4B | Q8_0 | 6.4 GB | 138 ms | Runs well |
| 84Great quality (A) · 84 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Intern-Decision 4B | Q8_0 | 6.7 GB | 88 ms | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3 | F16 | 3.2 GB | 27 ms | Runs great |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | zerank-2 | Q8_0 | 6.4 GB | 138 ms | Runs well |
| 82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | d1 3B | F16 | 8.1 GB | 75 ms | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | mxbai-rerank-large v2 | F16 | 4.9 GB | 62 ms | Runs great |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | Shieldstral 1.0 3B | Q8_0 | 6.1 GB | 132 ms | Runs great |
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.