Kimi K3.1 Pro (2.8T) on AMD Ryzen Embedded V1780B NAS (16 GB)
Can the AMD Ryzen Embedded V1780B NAS (16 GB) run Kimi K3.1 Pro (2.8T)?
No, it doesn’t fit
No. Kimi K3.1 Pro (2.8T) needs about 1,114 GB even at Q2_K; the AMD Ryzen Embedded V1780B NAS (16 GB) has 12.0 GB usable.
Download Kimi K3.1 Pro (2.8T)
Ollama
Ollama offers this only as a cloud model (it runs on Ollama’s servers, not your machine). No GGUF build was available yet, so to run it locally use the original weights with vLLM or SGLang.
Original weights · Hugging Face
Full-precision files from Moonshot AI, for fine-tuning, vLLM, Transformers.
huggingface.co/moonshotai/Kimi-K3.1-Pro (opens in a new tab)
How it’s rated
Match score
To order lists, each result also gets a match score out of 100 from four parts. It favors the most capable model that still runs well.
| Model quality | 9.4 / 45 | |
|---|---|---|
| Memory fit | 0.0 / 25 | |
| Speed | 0.0 / 15 | |
| Memory use | 0.0 / 15 | |
| Match score | 9.4 / 100 |
Every quantization on the AMD Ryzen Embedded V1780B NAS (16 GB)
| Quant | Memory needed | Available | Speed | Runs | Quality | Download |
|---|---|---|---|---|---|---|
Q2_K | 1,114 GB | 12.0 GB | — | Won't run | 69Good quality (B) · 69 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 9/100 (quality, fit, speed and memory use) sets the ranking. | All files (opens in a new tab) |
Q3_K_M | 1,364 GB | 12.0 GB | — | Won't run | 83Great quality (A) · 83 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 11/100 (quality, fit, speed and memory use) sets the ranking. | All files (opens in a new tab) |
Q4_K_M | 1,698 GB | 12.0 GB | — | Won't run | 94Excellent quality (A+) · 94 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 12/100 (quality, fit, speed and memory use) sets the ranking. | All files (opens in a new tab) |
Q5_K_M | 1,976 GB | 12.0 GB | — | Won't run | 96Excellent quality (A+) · 96 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 13/100 (quality, fit, speed and memory use) sets the ranking. | All files (opens in a new tab) |
Q6_K | 2,281 GB | 12.0 GB | — | Won't run | 98Excellent quality (A+) · 98 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 13/100 (quality, fit, speed and memory use) sets the ranking. | All files (opens in a new tab) |
Q8_0 | 2,949 GB | 12.0 GB | — | Won't run | 99Excellent quality (A+) · 99 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 13/100 (quality, fit, speed and memory use) sets the ranking. | All files (opens in a new tab) |
F16 | 5,562 GB | 12.0 GB | — | Won't run | 99Excellent quality (A+) · 99 of 100: how capable the model is at F16, whatever it runs on. Match score 13/100 (quality, fit, speed and memory use) sets the ranking. | Original weights (opens in a new tab) |
Memory figures assume 8K of context. Longer conversations or documents grow the KV cache.
Hardware that can run it
None. No single GPU or device in our catalog runs this model on its own; it needs several GPUs working together.
Models that do run on the AMD Ryzen Embedded V1780B NAS (16 GB)
- 58Good quality (B) · 58 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Maple Preview (20B-A1B)
- 69Good quality (B) · 69 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Nemotron 3.5 Bolt E4B
- 67Good quality (B) · 67 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. Gemma 4 E4B
- 58Good quality (B) · 58 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. Mellum2.1 Thinking (12B-A2.5B)
- 67Good quality (B) · 67 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking. K2 Horizon 7B
Quick answers
How much memory does Kimi K3.1 Pro (2.8T) need on the AMD Ryzen Embedded V1780B NAS 16GB?
Even at Q2_K it needs about 1,114 GB; the AMD Ryzen Embedded V1780B NAS 16GB has 12.0 GB usable.
What can the AMD Ryzen Embedded V1780B NAS 16GB run instead?
Maple Preview (20B-A1B), Nemotron 3.5 Bolt E4B and Gemma 4 E4B run best on it; the page lists more, each with its speed.
What hardware can run Kimi K3.1 Pro (2.8T)?
No single GPU or device in our catalog runs it on its own; it needs several GPUs working together.
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.