LLMs · MiniMax
MiniMax M3 (427B)
- Parameters
- 427B (25.0B active)
- Architecture
- Mixture of experts
- Max context
- 1,024K tokens
- License
- minimax-community
- Released
- 2026-06
How to run it
On a mobile device
MiniMax M3 (427B) is too big for a device like yours: it needs more memory than the device has. Models that run on mobile devices.
Ollama
Ollama offers this only as a cloud model (it runs on Ollama’s servers, not your machine). To run it locally, use the GGUF files below.
Quantized files · GGUF
Works in LM Studio, llama.cpp, Jan and Ollama. No sign-in needed.
huggingface.co/unsloth/MiniMax-M3-GGUF (opens in a new tab)
ollama run hf.co/unsloth/MiniMax-M3-GGUFOriginal weights · Hugging Face
Full-precision files from MiniMax, for fine-tuning, vLLM, Transformers.
Official repo · GitHub
Reference code, inference scripts and docs from MiniMax. The weights themselves download from Hugging Face.
github.com/MiniMax-AI/MiniMax-M3 (opens in a new tab)
git clone https://github.com/MiniMax-AI/MiniMax-M3Apps that run MiniMax M3 (427B)
Our pick for each kind of computer, assuming the model fits in its memory. Pick your own GPU or device in the Model Finder for an exact answer.
| App | Type | Opens it as | Systems | Engine | Start |
|---|---|---|---|---|---|
| LM Studio | Desktop app | GGUF or MLX | macOSWindowsLinux | Open in LM Studio | |
| Ollama | CLI + API | GGUF from Hugging Face | macOSWindowsLinux |
|
|
| llama.cpp | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Jan | Desktop app | GGUF or MLX | macOSWindowsLinux | Open in Jan | |
| MLX LM | CLI + API | MLX | macOS |
|
|
| vLLM | Server | Original weights | WSLWindowsLinux |
|
|
| SGLang | Server | Original weights | WSLWindowsLinux |
|
|
| Docker Model Runner | CLI + API | GGUF | macOSWindowsLinux |
|
|
| Lemonade | Desktop app | GGUF | macOSWindowsLinux |
|
|
| Unsloth Desktop | Desktop app | GGUF or MLX | macOSWindowsLinux | Open in Unsloth Desktop | |
| Atomic Chat | Desktop app | GGUF or MLX | macOSWindowsLinux | Open in Atomic Chat | |
| Pi | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Hermes Agent | Assistant | GGUF or MLX | macOSWSLWindowsLinux | ||
| OpenClaw | Assistant | GGUF or MLX | macOSWSLWindowsLinux | ||
| OpenCode | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Codex CLI | Coding agent | GGUF or MLX | macOSWSLWindowsLinux | ||
| OpenHands | Coding agent | GGUF or MLX | macOSWSLWindowsLinux | ||
| Zed | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Cline | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Open Interpreter | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Goose | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Aider | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Crush | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Qwen Code | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Kilo Code | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| Open WebUI | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| Khoj | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| Letta | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| KoboldCpp | Desktop app | GGUF | macOSWindowsLinux | Get KoboldCpp | |
| Text Generation WebUI | Desktop app | GGUF | macOSWindowsLinux | Get Text Generation WebUI | |
| llamafile | CLI + API | GGUF | macOSWindowsLinux | Get llamafile | |
| Msty Studio | Desktop app | GGUF or MLX | macOSWindowsLinux | Open in Msty Studio | |
| Llama (macOS) | Desktop app | GGUF | macOS | Open in Llama (macOS) | |
| RecurseChat | Desktop app | GGUF | macOS | Open in RecurseChat | |
| Inferencer | Desktop app | MLX | macOS | Get Inferencer | |
| node-llama-cpp | Library | GGUF | macOSWindowsLinux | Get node-llama-cpp | |
| exo | Server | MLX | macOSLinux | Get exo | |
| Continue | Coding agent | GGUF or MLX | macOSWindowsLinux | ||
| SillyTavern | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| LibreChat | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| Cherry Studio | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| Chatbox | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| PrivateGPT | Assistant | GGUF or MLX | macOSWindowsLinux | ||
| PocketPal AI | Mobile app | GGUF | iOSAndroid | App Store Google Play | |
| ChatterUI | Mobile app | GGUF | Android | Download the APK | |
| LLM Farm | Mobile app | GGUF | iOS |
Memory needed
Weights plus KV cache and runtime overhead. Leave a little extra free for the operating system and other apps. Try another context length.
| Quantization | Quality | Weights | Total at 8K context | Total at 32K context | Download |
|---|---|---|---|---|---|
Q2_K |
Low | 171 GB | 172 GB | 175 GB | GGUF (UD-Q2_K_XL) · folder (opens in a new tab) |
Q3_K_M |
Low | 209 GB | 211 GB | 214 GB | GGUF · folder (opens in a new tab) |
Q4_K_M |
Good | 260 GB | 262 GB | 265 GB | GGUF · folder (opens in a new tab) |
Q5_K_M |
High | 303 GB | 305 GB | 308 GB | GGUF · folder (opens in a new tab) |
Q6_K |
High | 350 GB | 352 GB | 355 GB | GGUF · folder (opens in a new tab) |
Q8_0 |
Very high | 453 GB | 454 GB | 457 GB | GGUF · folder (opens in a new tab) |
F16 |
Full | 854 GB | 856 GB | 859 GB | GGUF · folder (opens in a new tab) Original weights (opens in a new tab) |
Best hardware for MiniMax M3 (427B)
| Quality | Hardware | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 93/100 (quality, fit, speed and memory use) sets the ranking. | Apple M3 Ultra (512 GB) |
Q4_K_M | 293 GB / 384 GB | 31.0 tok/s | Runs great |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | Apple M3 Ultra (256 GB) |
Q2_K | 188 GB / 192 GB | 48.3 tok/s | Runs welltight fit |
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 95/100 (quality, fit, speed and memory use) sets the ranking. | Apple M5 Ultra (512 GB) |
Q4_K_M | 293 GB / 384 GB | 43.3 tok/s | Runs great |
| 90Excellent quality (A+) · 90 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 94/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI350X |
Q4_K_M | 277 GB / 288 GB | 158 tok/s | Runs welltight fit |
| 79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI325X |
Q3_K_M | 224 GB / 256 GB | 159 tok/s | Runs welltight fit |
| 79Great quality (A) · 79 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 89/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA GB300 Grace Blackwell Ultra Desktop Superchip |
Q3_K_M | 223 GB / 252 GB | 183 tok/s | Runs welltight fit |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | AMD Instinct MI300X |
Q2_K | 182 GB / 192 GB | 171 tok/s | Runs welltight fit |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. | Apple M5 Ultra (256 GB) |
Q2_K | 188 GB / 192 GB | 66.1 tok/s | Runs welltight fit |
| 66Good quality (B) · 66 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking. | NVIDIA B200 |
Q2_K | 181 GB / 180 GB | 161 tok/s | Runs welloffloads to RAM |
| 93Excellent quality (A+) · 93 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. | AMD EPYC 7002 / 7003 series NAS (512 GB) |
Q6_K | 389 GB / 471 GB | 3.8 tok/s | Slow |
Run it on a cluster
Devices that can’t run MiniMax M3 (427B) alone can run it together. These example clusters do:
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.







