Orange Pi 5 Plus

Products · · Board

Orange Pi 5 Plus

Chip
Rockchip RK3588
Unified memory
4, 8, 16 or 32 GB
Released
2023

Product page (opens in a new tab) Full AI report

Configurations

Pick one to see which models it runs. More memory lets larger models fit; bandwidth sets how fast they answer.

Configuration Memory Usable for AI Bandwidth LLMs that run well Launch price
Rockchip RK3588 4.0 GB 2.8 GB 34 GB/s 115 of 622 —
Rockchip RK3588 8.0 GB 6.4 GB 34 GB/s 155 of 622 —
Rockchip RK3588 16.0 GB 13.6 GB 34 GB/s 184 of 622 —
Rockchip RK3588 32.0 GB 28.8 GB 34 GB/s 203 of 622 —

Specifications 16.0 GB configuration

MakerOrange Pi
TypeBoard
ChipRockchip RK3588 / RK3588S (16 GB)
Unified memory16.0 GB
Usable for AI models13.6 GB
Memory bandwidth34 GB/s
FP16 compute0.2 TFLOPS
NotesRK3588 with LPDDR4X. Orange Pi publishes no US list price; it sells through Amazon, AliExpress and distributors (the 32 GB version is $499 at OrangePi.net).
Product pagewww.orangepi.org (opens in a new tab)

Best LLMs for the Orange Pi 5 Plus 16.0 GB

Quality Model Quant Memory Speed Runs
77Great quality (A) · 77 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. K2 Horizon 7BInstitute of Foundation Models Q5_K_M 9.3 GB 3.2 tok/s Slow
66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. Mellum2.1 Thinking (12B-A2.5B)JetBrains Q4_K_M 9.2 GB 13.2 tok/s Runs well
58Good quality (B) · 58 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. Maple Preview (20B-A1B)DeepGrove Q3_K_M 11.7 GB 27.3 tok/s Runs welltight fit
75Great quality (A) · 75 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. MiMo V2.6 Distill Qwen 9BXiaomi Q5_K_M 8.6 GB 3.0 tok/s Slow
64Good quality (B) · 64 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. Gemma 4 26B-A4BGoogle Q2_K 12.4 GB 14.3 tok/s Runs welltight fit
74Great quality (A) · 74 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. SenseNova Loop 9B PreviewSenseTime Q4_K_M 8.1 GB 3.6 tok/s Slow
73Great quality (A) · 73 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Ornith 1.5 9BDeepReinforce Q4_K_M 7.8 GB 3.6 tok/s Slow
71Great quality (A) · 71 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. TMax 9BAi2 Q5_K_M 8.3 GB 3.2 tok/s Slow
72Great quality (A) · 72 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Qwen3.5 9BAlibaba Q4_K_M 7.8 GB 3.6 tok/s Slow
61Good quality (B) · 61 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Raon-1 mini Preview (30B-A4B)KRAFTON Q2_K 13.3 GB 12.7 tok/s Runs welltight fit

Best Image models for the Orange Pi 5 Plus 16.0 GB

Quality Model Quant Memory Speed Runs
90Excellent quality (A+) · 90 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. FLUX 3 Image KleinBlack Forest Labs Q8 GGUF 12.8 GB 16.0 min Very slowtight fit
76Great quality (A) · 76 of 100: how capable the model is at FP8, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. FLUX.2 [klein] 4BBlack Forest Labs FP8 10.2 GB 2.2 min Slow
83Great quality (A) · 83 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. Z-Image TurboAlibaba (Tongyi) Q8 GGUF 13.0 GB 7.0 min Very slowtight fit
79Great quality (A) · 79 of 100: how capable the model is at Q4 GGUF, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. ERNIE-Image TurboBaidu Q4 GGUF 11.3 GB 9.4 min Very slow
81Great quality (A) · 81 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Z-ImageAlibaba (Tongyi) Q8 GGUF 13.0 GB 47.8 min Very slowtight fit
87Excellent quality (A+) · 87 of 100: how capable the model is at Q8 GGUF, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. ERNIE-ImageBaidu Q8 GGUF 11.2 GB 64.9 min Very slowencoder unloaded after use

Best Video models for the Orange Pi 5 Plus 16.0 GB

Quality Model Quant Memory Speed Runs
49Fair quality (C) · 49 of 100: how capable the model is at FP8, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking. LTX-Video 2BLightricks FP8 10.8 GB 55.0 min Very slow
83Great quality (A) · 83 of 100: how capable the model is at FP8, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking. Bernini-R A14B (video generation + editing)ByteDance FP8 10.7 GB 34.3 h Very slowCPU offload
53Fair quality (C) · 53 of 100: how capable the model is at FP8, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking. Wan 2.1 T2V 1.3BAlibaba FP8 12.8 GB 8.8 h Very slowtight fit
44Fair quality (C) · 44 of 100: how capable the model is at FP8, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking. CogVideoX 2BZhipu AI FP8 11.0 GB 2.2 h Very slow
76Great quality (A) · 76 of 100: how capable the model is at FP16, whatever it runs on. Match score 61/100 (quality, fit, speed and memory use) sets the ranking. HY-OmniWeaving (8.3B, unified video)Tencent FP16 10.7 GB 28.1 h Very slowCPU offload

Best Decision models for the Orange Pi 5 Plus 16.0 GB

Quality Model Quant Memory Speed Runs
78Great quality (A) · 78 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 86/100 (quality, fit, speed and memory use) sets the ranking. OpenAI Privacy FilterOpenAI Q8_0 2.4 GB 120 ms Runs great
86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking. Jina Reranker v3.5Jina AI Q8_0 2.6 GB 2.6 s Very slow
90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking. Qwen3 Reranker 4BAlibaba Q8_0 6.3 GB 17.4 s Very slow
90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking. Qwen3 Reranker 8BAlibaba Q8_0 10.7 GB 35.4 s Very slow
90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking. Skywork Reward V2 Llama 3.1 8BSkywork Q8_0 10.4 GB 69.6 s Very slow
84Great quality (A) · 84 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. Jina Reranker v3Jina AI Q8_0 2.6 GB 2.6 s Very slow
88Excellent quality (A+) · 88 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. zerank-2ZeroEntropy Q8_0 6.3 GB 17.4 s Very slow
80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. GLiNER2.5 DecideFastino Q8_0 1.2 GB 1.1 s Slow

Other products with the Rockchip RK3588 / RK3588S (16 GB)

Spec sources

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?