
Hardware · Apple Silicon
What AI models can the Apple M4 Pro (24 GB) run?
- Unified memory
- 24.0 GB
- Usable for models
- 16.1 GB
- Memory bandwidth
- 273 GB/s
- FP16 compute
- 9.2 TFLOPS
- Released
- 2024
macOS lets the GPU use roughly two-thirds to three-quarters of unified memory by default, so we plan around that figure rather than the full 24.0 GB.
More about this hardware
| Maker | Apple Silicon |
|---|---|
| Type | Apple silicon (system on a chip) |
| Chip | Apple M4 Pro |
Apps that run models well on the Apple M4 Pro (24 GB)
3 products with the Apple M4 Pro (24 GB)
Best LLMs for the Apple M4 Pro (24 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 77Great quality (A) · 77 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking. | Gemma 4 26B-A4B | Q3_K_M | 14.9 GB | 74.5 tok/s | Runs welltight fit |
| 73Great quality (A) · 73 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking. | Raon-1 mini Preview (30B-A4B) | Q3_K_M | 16.1 GB | 67.7 tok/s | Runs welltight fit |
| 78Great quality (A) · 78 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. | Gemma 4 12B | Q4_K_M | 9.9 GB | 24.1 tok/s | Runs well |
| 69Good quality (B) · 69 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. | Mellum2.1 Thinking (12B-A2.5B) | Q6_K | 12.0 GB | 62.1 tok/s | Runs great |
| 70Great quality (A) · 70 of 100: how capable the model is at MXFP4, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking. | gpt-oss 20B | MXFP4 | 14.0 GB | 66.6 tok/s | Runs welltight fit |
| 76Great quality (A) · 76 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. | K2 Horizon 7B | Q4_K_M | 8.6 GB | 32.1 tok/s | Runs great |
| 66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | ERNIE 4.5 21B-A3B Thinking | Q4_K_M | 15.7 GB | 72.7 tok/s | Runs welltight fit |
| 66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | Maple Preview (20B-A1B) | Q4_K_M | 14.3 GB | 117 tok/s | Runs welltight fit |
| 80Great quality (A) · 80 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.8 27B | Q3_K_M | 16.0 GB | 13.4 tok/s | Runs welltight fit |
| 69Good quality (B) · 69 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | Nemotron 3.5 Bolt E4B | Q6_K | 8.6 GB | 44.5 tok/s | Runs great |
| 65Good quality (B) · 65 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | DiffusionGemma 26B-A4B IT | Q3_K_M | 14.9 GB | 71.6 tok/s | Runs welltight fit |
| 78Great quality (A) · 78 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.6 27B | Q3_K_M | 16.0 GB | 13.4 tok/s | Runs welltight fit |
Best Image models for the Apple M4 Pro (24 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 76Great quality (A) · 76 of 100: how capable the model is at FP8, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 4B | FP8 | 10.2 GB | 8.9 s | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at FP8, whatever it runs on. Match score 87/100 (quality, fit, speed and memory use) sets the ranking. | Z-Image Turbo | FP8 | 12.6 GB | 22 s | Runs well |
| 89Excellent quality (A+) · 89 of 100: how capable the model is at FP8, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. | FLUX 3 Image Klein | FP8 | 12.4 GB | 51 s | Slow |
| 83Great quality (A) · 83 of 100: how capable the model is at FP8, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. | ERNIE-Image Turbo | FP8 | 14.5 GB | 28 s | Runs welltight fit |
| 82Great quality (A) · 82 of 100: how capable the model is at FP8, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | FLUX.2 [klein] 9B | FP8 | 11.7 GB | 17 s | Runs wellencoder unloaded after use |
| 80Great quality (A) · 80 of 100: how capable the model is at FP8, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. | Z-Image | FP8 | 12.6 GB | 2.5 min | Very slow |
Best Video models for the Apple M4 Pro (24 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 49Fair quality (C) · 49 of 100: how capable the model is at FP8, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | LTX-Video 2B | FP8 | 10.8 GB | 3.7 min | Runs great |
| 53Fair quality (C) · 53 of 100: how capable the model is at FP8, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. | Wan 2.1 T2V 1.3B | FP8 | 12.8 GB | 35.5 min | Slow |
| 44Fair quality (C) · 44 of 100: how capable the model is at FP8, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. | CogVideoX 2B | FP8 | 11.0 GB | 8.9 min | Runs well |
| 53Fair quality (C) · 53 of 100: how capable the model is at FP8, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking. | CogVideoX 5B | FP8 | 14.3 GB | 26.6 min | Slowtight fit |
| 53Fair quality (C) · 53 of 100: how capable the model is at FP8, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking. | CogVideoX 5B I2V | FP8 | 14.9 GB | 26.6 min | Slowtight fit |
Best Decision models for the Apple M4 Pro (24 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 86Excellent quality (A+) · 86 of 100: how capable the model is at F16, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3.5 | F16 | 3.3 GB | 67 ms | Runs great |
| 84Great quality (A) · 84 of 100: how capable the model is at F16, whatever it runs on. Match score 92/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3 | F16 | 3.3 GB | 67 ms | Runs great |
| 80Great quality (A) · 80 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | FRIDA-Decisions | F16 | 2.4 GB | 50 ms | Runs great |
| 80Great quality (A) · 80 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | GLiNER2.5 Decide | F16 | 1.7 GB | 31 ms | Runs great |
| 80Great quality (A) · 80 of 100: how capable the model is at F16, whatever it runs on. Match score 91/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3 Reranker 0.6B | F16 | 3.3 GB | 67 ms | Runs great |
| 76Great quality (A) · 76 of 100: how capable the model is at F16, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | Llama Prompt Guard 2 86M | F16 | 1.2 GB | 35 ms | Runs great |
| 76Great quality (A) · 76 of 100: how capable the model is at F16, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | mxbai-rerank-base v2 | F16 | 2.9 GB | 55 ms | Runs great |
| 82Great quality (A) · 82 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | mxbai-rerank-large v2 | Q8_0 | 3.6 GB | 153 ms | Runs well |
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.


