Hardware · Rockchip
What AI models can the Rockchip RK3568 NAS (4 GB) run?
- RAM
- 4.0 GB
- Usable for models
- 2.0 GB
- Memory bandwidth
- 13 GB/s
- Runs models on
- CPU cores
- Released
- 2021
A NAS with this chip runs models on its processor cores, so memory speed sets the pace: small models (about 1-4B) answer at a usable speed, bigger ones are slow. We plan around 2.0 GB for models, what is left after the NAS system and its storage services. Models run in a container (Docker) or the maker’s app store, and speeds assume the NAS isn’t busy with storage work.
More about this hardware
| Maker | Rockchip |
|---|---|
| Type | NAS (network attached storage) processor |
| Share of memory for models | 50% (what the NAS system and its storage services typically leave free at this size) |
| Chip | Rockchip RK3568 |
| AI accelerator | None. Models run on the processor cores. |
| NAS models with this chip | QNAP TS-433 · QNAP TS-216G · QNAP QBoat-300 · QNAP TS-433eU |
| Memory type | System RAM, shared with the NAS operating system and its storage services |
| Bandwidth figure | 12.8 GB/s, estimated, see the note below |
| Note | One profile for every NAS built on this chip. Memory speed is an estimate from the chip’s supported memory in a typical NAS fitting; a unit with one memory module runs slower than one with two. Speed assumes the NAS is not busy with storage work. |
| Specifications | www.qnap.com |
Apps that run models well on the Rockchip RK3568 NAS (4 GB)
4 products with the Rockchip RK3568 NAS (4 GB)
Best LLMs for the Rockchip RK3568 NAS (4 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 47Fair quality (C) · 47 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 64/100 (quality, fit, speed and memory use) sets the ranking. | LFM3 1.7B | Q3_K_M | 1.7 GB | 3.3 tok/s | Slowtight fit |
| 39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking. | PaddleOCR-VL 1.6 0.9B | Q4_K_M | 1.5 GB | 4.5 tok/s | Slow |
| 39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking. | MiniCPM-OCR 1.0 1.3B | Q4_K_M | 1.7 GB | 3.4 tok/s | Slow |
| 35Basic quality (D) · 35 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking. | LFM3-VL 2B | Q2_K | 1.6 GB | 3.7 tok/s | Slow |
| 34Basic quality (D) · 34 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking. | MiniCPM5 1B | Q4_K_M | 1.6 GB | 4.0 tok/s | Slow |
| 33Basic quality (D) · 33 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 59/100 (quality, fit, speed and memory use) sets the ranking. | MiniCPM-V 4.7 1B | Q3_K_M | 1.6 GB | 3.6 tok/s | Slow |
| 30Basic quality (D) · 30 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking. | LFM2.5 1.2B Instruct | Q4_K_M | 1.6 GB | 3.7 tok/s | Slow |
| 33Basic quality (D) · 33 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking. | TMax 2B | Q3_K_M | 1.8 GB | 3.0 tok/s | Slowtight fit |
| 30Basic quality (D) · 30 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking. | LFM2.5 2.6B | Q2_K | 2.0 GB | 2.7 tok/s | Very slowtight fit |
| 24Basic quality (D) · 24 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.5 0.8B | Q4_K_M | 1.4 GB | 5.0 tok/s | Slow |
| 29Basic quality (D) · 29 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking. | Jamba2 3B | Q2_K | 2.0 GB | 2.4 tok/s | Very slowtight fit |
| 28Basic quality (D) · 28 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 55/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3.5 2B | Q2_K | 1.8 GB | 3.2 tok/s | Slowtight fit |
Best Image models for the Rockchip RK3568 NAS (4 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 39Basic quality (D) · 39 of 100: how capable the model is at FP8, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking. | SDXL Turbo | FP8 | 1.6 GB | 63 s | SlowCPU offload |
| 42Fair quality (C) · 42 of 100: how capable the model is at FP16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking. | Realistic Vision V5.1 | FP16 | 1.3 GB | 9.4 min | Very slowCPU offload |
| 28Basic quality (D) · 28 of 100: how capable the model is at FP16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking. | SD Turbo | FP16 | 1.3 GB | 38 s | Runs wellCPU offload |
| 40Fair quality (C) · 40 of 100: how capable the model is at FP16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking. | DreamShaper 8 | FP16 | 1.3 GB | 9.4 min | Very slowCPU offload |
| 30Basic quality (D) · 30 of 100: how capable the model is at FP16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking. | LCM DreamShaper v7 | FP16 | 1.3 GB | 2.0 min | SlowCPU offload |
| 35Basic quality (D) · 35 of 100: how capable the model is at FP16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking. | Stable Diffusion 1.5 | FP16 | 1.3 GB | 9.4 min | Very slowCPU offload |
Best Video models for the Rockchip RK3568 NAS (4 GB)
None of the video models in our catalog fit in this much memory.
Best Decision models for the Rockchip RK3568 NAS (4 GB)
| Quality | Model | Quant | Memory | Speed | Runs |
|---|---|---|---|---|---|
| 86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3.5 | Q8_0 | 1.6 GB | 25.9 s | Very slow |
| 84Great quality (A) · 84 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. | Jina Reranker v3 | Q8_0 | 1.6 GB | 25.9 s | Very slow |
| 80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. | GLiNER2.5 Decide | Q8_0 | 1.2 GB | 11.4 s | Very slow |
| 80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. | FRIDA-Decisions | Q8_0 | 1.7 GB | 19.0 s | Very slow |
| 80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. | Qwen3 Reranker 0.6B | Q8_0 | 1.6 GB | 25.9 s | Very slow |
| 76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | Llama Prompt Guard 2 86M | Q8_0 | 1.0 GB | 13.0 s | Very slow |
| 79Great quality (A) · 79 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | mxbai-rerank-large v2 | Q5_K_M | 1.9 GB | 66.1 s | Very slowtight fit |
| 76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. | mxbai-rerank-base v2 | Q8_0 | 1.3 GB | 21.1 s | Very slow |
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.