
Hardware · NVIDIA
What AI models can the NVIDIA T400 run?
- VRAM
- 4.0 GB
- Usable for models
- 4.0 GB
- Memory bandwidth
- 80 GB/s
- FP16 compute
- 1.1 TFLOPS
- Released
- 2021
More about this hardware
| Maker | NVIDIA |
|---|---|
| Type | Graphics card |
| Interface | PCIe 3.0 |
Apps that run models well on the NVIDIA T400
21 products with the NVIDIA T400
Precision 3460 Small Form Factor WorkstationProduct page (opens in a new tab)
Precision 5860 Tower WorkstationProduct page (opens in a new tab)
Precision 7875 Tower WorkstationProduct page (opens in a new tab)
Precision 7960 Rack WorkstationProduct page (opens in a new tab)
Precision 7960 Tower WorkstationProduct page (opens in a new tab)
Z2 Mini G9Product page (opens in a new tab)
Z2 SFF G9Product page (opens in a new tab)
Z2 Tower G9Product page (opens in a new tab)
Z4 G5Product page (opens in a new tab)
Z6 G5Product page (opens in a new tab)
Z6 G5 AProduct page (opens in a new tab)
Z8 Fury G5Product page (opens in a new tab)
Z8 G5Product page (opens in a new tab)
ThinkStation P5 WorkstationProduct page (opens in a new tab)
ThinkStation P620 Tower WorkstationProduct page (opens in a new tab)
ThinkStation P7 WorkstationProduct page (opens in a new tab)
ThinkStation P8 WorkstationProduct page (opens in a new tab)
ThinkStation PX WorkstationProduct page (opens in a new tab)
A+ Workstation AS-5014A-TTProduct page (opens in a new tab)
SuperWorkstation SYS-551A-TProduct page (opens in a new tab)
SuperWorkstation SYS-751A-IProduct page (opens in a new tab)
Best LLMs for the NVIDIA T400
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. | Gemma 4 E2B | Q4_K_M | 4.0 GB | 42.7 tok/s | Runs welltight fit |
| 57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. | MiniCPM5 2B | Q4_K_M | 2.7 GB | 39.0 tok/s | Runs great |
| 64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. | Nemotron Labs Dory 1.0 4B | Q4_K_M | 3.7 GB | 24.7 tok/s | Runs welltight fit |
| 62Good quality (B) · 62 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. | Spark-X2.6 4B | Q4_K_M | 3.6 GB | 23.9 tok/s | Runs welltight fit |
| 55Good quality (B) · 55 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. | LFM3 1.7B | Q6_K | 2.3 GB | 39.4 tok/s | Runs great |
| 57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. | TMax 4B | Q4_K_M | 3.6 GB | 23.3 tok/s | Runs welltight fit |
| 58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.5 4B | Q4_K_M | 3.9 GB | 21.1 tok/s | Runs welltight fit |
| 57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | Agents-A1 4B | Q4_K_M | 3.8 GB | 21.6 tok/s | Runs welltight fit |
| 47Fair quality (C) · 47 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | Nanbeige4.2 3B | Q2_K | 3.9 GB | 38.7 tok/s | Runs welltight fit |
| 48Fair quality (C) · 48 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. | LFM3-VL 2B | Q5_K_M | 2.3 GB | 42.3 tok/s | Runs great |
| 55Good quality (B) · 55 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. | Fara 1.5 4B | Q4_K_M | 3.8 GB | 21.6 tok/s | Runs welltight fit |
| 41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking. | Unlimited OCR 2 (3B-A0.6B) | Q4_K_M | 3.3 GB | 106 tok/s | Runs great |
Best Image models for the NVIDIA T400
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 30Basic quality (D) · 30 of 100: how capable the model is at FP16, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. | LCM DreamShaper v7 | FP16 | 2.8 GB | 6.4 s | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at Q4 GGUF, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. | FLUX 3 Image Klein | Q4 GGUF | 3.4 GB | 3.8 min | Very slowCPU offload |
| 76Great quality (A) · 76 of 100: how capable the model is at FP8, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 4B | FP8 | 3.5 GB | 30 s | Runs welltight fit · CPU offload |
| 28Basic quality (D) · 28 of 100: how capable the model is at FP16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking. | SD Turbo | FP16 | 3.3 GB | 2.1 s | Runs great |
| 42Fair quality (C) · 42 of 100: how capable the model is at FP16, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking. | Realistic Vision V5.1 | FP16 | 2.8 GB | 31 s | Runs well |
| 40Fair quality (C) · 40 of 100: how capable the model is at FP16, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking. | DreamShaper 8 | FP16 | 2.8 GB | 31 s | Runs well |
Best Video models for the NVIDIA T400
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 35Basic quality (D) · 35 of 100: how capable the model is at FP16, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking. | AnimateDiff v3 (SD 1.5) | FP16 | 2.6 GB | 11.1 min | Runs wellCPU offload |
Best Decision models for the NVIDIA T400
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 78Great quality (A) · 78 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking. | OpenAI Privacy Filter | Q8_0 | 2.4 GB | 22 ms | Runs great |
| 80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking. | GLiNER2.5 Decide | Q8_0 | 1.2 GB | 178 ms | Runs well |
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3.5 | Q8_0 | 1.7 GB | 407 ms | Slow |
| 70Great quality (A) · 70 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking. | GTE Reranker ModernBERT Base | Q8_0 | 0.8 GB | 110 ms | Runs great |
| 74Great quality (A) · 74 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking. | GLiClass ModernBERT Large v3 | Q8_0 | 1.1 GB | 146 ms | Runs well |
| 68Good quality (B) · 68 of 100: how capable the model is at F16, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking. | Llama Prompt Guard 2 22M | F16 | 0.8 GB | 62 ms | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3 | Q8_0 | 1.7 GB | 407 ms | Slow |
| 68Good quality (B) · 68 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. | Granite Embedding Reranker English R2 | Q8_0 | 0.8 GB | 110 ms | Runs great |
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.