Hardware · NVIDIA
What AI models can the NVIDIA RTX A5500 run?
- VRAM
- 24.0 GB
- Usable for models
- 24.0 GB
- Memory bandwidth
- 768 GB/s
- FP16 compute
- 34.1 TFLOPS
- Released
- 2022
- Launch price
- $2,500
More about this hardware
| Maker | NVIDIA |
|---|---|
| Type | Workstation / datacenter graphics card |
| Interface | PCIe 4.0 |
Apps that run models well on the NVIDIA RTX A5500
10 products with the NVIDIA RTX A5500
ThinkStation P5 WorkstationProduct page (opens in a new tab)
ThinkStation P7 WorkstationProduct page (opens in a new tab)
ThinkStation PX WorkstationProduct page (opens in a new tab)
A+ Workstation AS-5014A-TTProduct page (opens in a new tab)
SuperServer SYS-741GE-TNRTProduct page (opens in a new tab)
SuperWorkstation SYS-531A-IProduct page (opens in a new tab)
SuperWorkstation SYS-531A-ILProduct page (opens in a new tab)
SuperWorkstation SYS-531AD-IProduct page (opens in a new tab)
SuperWorkstation SYS-551A-TProduct page (opens in a new tab)
SuperWorkstation SYS-751A-IProduct page (opens in a new tab)
Best LLMs for the NVIDIA RTX A5500
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 91Excellent quality (A+) · 91 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Gemma 4 26B-A4B | Q6_K | 23.4 GB | 106 tok/s | Runs welltight fit |
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.8 27B | Q4_K_M | 19.3 GB | 33.9 tok/s | Runs great |
| 89Excellent quality (A+) · 89 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.6 27B | Q4_K_M | 19.3 GB | 33.9 tok/s | Runs great |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.6 35B-A3B | Q4_K_M | 23.9 GB | 153 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | MiniCPM-V 4.7 35B-A3B | Q4_K_M | 23.4 GB | 153 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.5 35B-A3B | Q4_K_M | 23.9 GB | 153 tok/s | Runs welltight fit |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.5 27B | Q4_K_M | 19.3 GB | 33.9 tok/s | Runs great |
| 87Excellent quality (A+) · 87 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Nex N2 Mini (35B-A3B) | Q4_K_M | 23.4 GB | 153 tok/s | Runs welltight fit |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | KAT-Coder V2.5 Dev (35B-A3B) | Q4_K_M | 23.1 GB | 153 tok/s | Runs welltight fit |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Sage-A1.5 35B-A3B | Q4_K_M | 23.9 GB | 153 tok/s | Runs welltight fit |
| 87Excellent quality (A+) · 87 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Muse Glimmer 30B | Q4_K_M | 20.1 GB | 31.7 tok/s | Runs great |
| 83Great quality (A) · 83 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Raon-1 mini Preview (30B-A4B) | Q4_K_M | 19.4 GB | 126 tok/s | Runs great |
Best Image models for the NVIDIA RTX A5500
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 90Excellent quality (A+) · 90 of 100: how capable the model is at FP8, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Krea 2 Turbo | FP8 | 20.2 GB | 7.5 s | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | ERNIE-Image Turbo | Q8 GGUF | 15.0 GB | 7.1 s | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at FP8, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 9B | FP8 | 19.9 GB | 3.1 s | Runs great |
| 89Excellent quality (A+) · 89 of 100: how capable the model is at FP8, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | FLUX 3 Image Klein | FP8 | 12.4 GB | 10.0 s | Runs great |
| 78Great quality (A) · 78 of 100: how capable the model is at FP16, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 4B | FP16 | 18.1 GB | 1.9 s | Runs great |
| 83Great quality (A) · 83 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | Z-Image Turbo | Q8 GGUF | 13.0 GB | 5.6 s | Runs great |
Best Video models for the NVIDIA RTX A5500
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 86Excellent quality (A+) · 86 of 100: how capable the model is at FP8, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. | LTX-2.5 (22B, video + audio) | FP8 | 19.7 GB | 3.4 min | Runs greatCPU offload |
| 83Great quality (A) · 83 of 100: how capable the model is at FP8, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. | Bernini-R A14B (video generation + editing) | FP8 | 20.3 GB | 22.0 min | Slowencoder in RAM |
| 50Fair quality (C) · 50 of 100: how capable the model is at FP16, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. | LTX-Video 2B | FP16 | 17.5 GB | 49 s | Runs great |
| 45Fair quality (C) · 45 of 100: how capable the model is at FP16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | CogVideoX 2B | FP16 | 17.5 GB | 1.9 min | Runs great |
| 72Great quality (A) · 72 of 100: how capable the model is at FP8, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | FramePack I2V (HunyuanVideo 13B) | FP8 | 19.6 GB | 12.2 min | Slowencoder in RAM |
Best Decision models for the NVIDIA RTX A5500
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3 Reranker 4B | Q8_0 | 6.4 GB | 96 ms | Runs great |
| 88Excellent quality (A+) · 88 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking. | zerank-2 | Q8_0 | 6.4 GB | 96 ms | Runs great |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at F16, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3.5 | F16 | 3.2 GB | 19 ms | Runs great |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Shieldstral 1.0 3B | Q8_0 | 6.1 GB | 92 ms | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Intern-Decision 4B | F16 | 10.9 GB | 72 ms | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3 | F16 | 3.2 GB | 19 ms | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | d1 3B | F16 | 8.1 GB | 51 ms | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | mxbai-rerank-large v2 | F16 | 4.9 GB | 43 ms | Runs great |
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.