QNAP QAI-16700

Products · · NAS

QNAP QAI-16700

Processor
AMD Ryzen 7000 series (desktop, incl. PRO 7645 / 7745)
Memory (RAM)
32 or 192 GB
Released
2026

Product page (opens in a new tab) Full AI report

Configurations

Pick one to see which models it runs. More memory lets larger models fit; bandwidth sets how fast they answer.

Configuration Memory Usable for AI Bandwidth LLMs that run well Launch price
AMD Ryzen 7000 series (desktop, incl. PRO 7645 / 7745) 32.0 GB 26.2 GB 83 GB/s 365 of 622 —
AMD Ryzen 7000 series (desktop, incl. PRO 7645 / 7745) · upgraded to the maker's maximum 192 GB 173 GB 83 GB/s 400 of 622 —

Specifications 192 GB configuration

MakerQNAP
TypeNAS
ProcessorAMD Ryzen 7000 series (desktop, incl. PRO 7645 / 7745) NAS (192 GB) · upgraded to the maker's maximum
Memory (RAM)192 GB
Usable for AI models173 GB
Memory bandwidth83 GB/s
FP16 compute0.7 TFLOPS
Runs models onCPU cores
Drive bays12 x 3.5-inch SATA 6Gb/s, 3Gb/s + 4 x 2.5-inch U.2 NVMe Gen4 x2 slots
NAS systemQuTS hero
Containers (Docker)Yes
Virtual machinesYes
Memory upgradeUDIMM DDR5 · 4 slots · up to 192 GB per the maker · ECC
Graphics card optionsPCIe: 3 Slot 1: Gen 4 x 8 or Gen 4 x 4. Maker-supported graphics cards: NVIDIA RTX PRO 6000 Blackwell 96 GB, RTX PRO 5000 Blackwell 48 GB, RTX PRO 4500 Blackwell 32 GB, RTX PRO 4000 Blackwell 24 GB, RTX PRO 2000 Blackwell SFF 16 GB; Intel Arc Pro B70 32 GB listed as….
NotesAMD Ryzen 9 7900 (12-core/24-thread, up to 5.4 GHz). QNAP itself positions this model for on-premises LLM inference with NVIDIA RTX GPUs. x86-64 Ryzen 9 7000 series CPU, up to 192 GB RAM, Container Station (Docker) and Virtualization Station.
Product pagewww.qnap.com (opens in a new tab)

Running AI on the QNAP QAI-16700

Yes, it runs AI models on the NAS itself. Models run on its CPU cores, and this configuration leaves about 173 GB for them after the NAS system and its storage services. The grades below assume the NAS isn’t busy with backups or media work at the same time. More memory is the upgrade that matters most: see the configurations.

Apps you can install to run models

AppHow it installs
Ollama + Open WebUI In a container (Docker)
Ollama In a container (Docker)
Open WebUI In a container (Docker)
AnythingLLM In a container (Docker)
RAGFlow In a container (Docker)

Apps that run LLMs on a NAS, with their container images

AI features from QNAP

FeatureWhat it doesWhere the AI runs
Qsirch RAG Search (cloud LLM mode) Natural-language search and Q&A over NAS files; retrieval runs on the NAS but the LLM is a cloud API (Gemini, OpenAI, Azure OpenAI or OpenAI-compatible). Cloud service or another computer
Qsirch with RAG (on-premises GPU) Qsirch full-text search plus RAG linked to a local LLM, with search and generation both on the NAS (maker product page). Needs an NVIDIA GPU in the PCIe slot; the spec-sheet SKU QAI-16700-R9-32G lists no bundled GPU. On the NAS
Container Station AI templates (Ollama, Open WebUI, AnythingLLM, RAGFlow, Dify, Flowise… One-click local LLM, RAG, image-generation, speech and code-assistant stacks on the built-in GPU. On the NAS
QuMagie + QNAP AI Core Photo management with on-device face, object and scene recognition (QNAP AI Core image-recognition engine). On the NAS
Qsirch AI Semantic Search Natural-language/semantic file and image search computed locally; QNAP requires a 64-bit x86 NAS with at least 8 GB RAM. On the NAS
Qsirch on-premises RAG / LLM Core Runs open models (DeepSeek R1, Gemma 3, gpt-oss 20B, Mistral 7B, Phi-4) locally for RAG search. Requires an NVIDIA GPU assigned to Container Station; QNAP states CPU-only is not supported. Needs QuTS hero h5.2.1+ and Qsirch 6.0.0+. On the NAS

Best LLMs for the QNAP QAI-16700 192 GB

Quality Model Quant Memory Speed Runs
93Excellent quality (A+) · 93 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 90/100 (quality, fit, speed and memory use) sets the ranking. Qwen3.8 Flash Next (125B-A6B)Alibaba Q5_K_M 142 GB 11.6 tok/s Runs well
86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. Kolibri 1 (78B-A3.5B)Aleph Alpha Q4_K_M 62.2 GB 23.4 tok/s Runs well
84Great quality (A) · 84 of 100: how capable the model is at MXFP4, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. gpt-oss 120BOpenAI MXFP4 81.3 GB 17.4 tok/s Runs well
78Great quality (A) · 78 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. MiniMax M2.7 (230B-A10B)MiniMax Q3_K_M 129 GB 11.0 tok/s Runs well
85Excellent quality (A+) · 85 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. Solar Open 2 250BUpstage Q4_K_M 169 GB 5.7 tok/s Slowtight fit
78Great quality (A) · 78 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. Step 3.7 Flash (198B-A11B)StepFun Q3_K_M 114 GB 10.0 tok/s Runs well
77Great quality (A) · 77 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. MiniMax M2.5 (230B-A10B)MiniMax Q3_K_M 129 GB 11.0 tok/s Runs well
86Excellent quality (A+) · 86 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. Qwen3 235B-A22B Thinking 2507Alibaba Q4_K_M 159 GB 3.9 tok/s Slowtight fit
81Great quality (A) · 81 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. Qwen3-Next 80B-A3B ThinkingAlibaba Q4_K_M 64.2 GB 26.7 tok/s Runs well
81Great quality (A) · 81 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. Qwen3 Coder Next (80B-A3B)Alibaba Q4_K_M 63.2 GB 26.7 tok/s Runs well

Best Image models for the QNAP QAI-16700 192 GB

Quality Model Quant Memory Speed Runs
93Excellent quality (A+) · 93 of 100: how capable the model is at FP16, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. MiniMax H3 ImageMiniMax FP16 138 GB 9.0 min Very slow
92Excellent quality (A+) · 92 of 100: how capable the model is at FP16, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. FLUX.2 [dev]Black Forest Labs FP16 116 GB 32.2 min Very slow
92Excellent quality (A+) · 92 of 100: how capable the model is at FP16, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. Cosmos3-Super Text2Image (64B)NVIDIA FP16 133 GB 35.8 min Very slow
88Excellent quality (A+) · 88 of 100: how capable the model is at FP8, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. HunyuanImage 3.0 (80B-A13B)Tencent FP8 86.9 GB 48.3 min Very slow
92Excellent quality (A+) · 92 of 100: how capable the model is at FP16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Ideogram 4Ideogram FP16 57.3 GB 22.4 min Very slow
93Excellent quality (A+) · 93 of 100: how capable the model is at FP16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Qwen-Image 2.1Alibaba FP16 57.0 GB 53.7 min Very slow

Best Video models for the QNAP QAI-16700 192 GB

Quality Model Quant Memory Speed Runs
90Excellent quality (A+) · 90 of 100: how capable the model is at FP16, whatever it runs on. Match score 81/100 (quality, fit, speed and memory use) sets the ranking. MiniMax H3 (33B, video + audio)MiniMax FP16 113 GB 15.5 h Very slow
88Excellent quality (A+) · 88 of 100: how capable the model is at FP16, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. Cosmos3-Super Image2Video (64B)NVIDIA FP16 139 GB 33.6 h Very slow
88Excellent quality (A+) · 88 of 100: how capable the model is at FP16, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. LTX-2.5 (22B, video + audio)Lightricks FP16 82.5 GB 81.5 min Very slow
88Excellent quality (A+) · 88 of 100: how capable the model is at FP16, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. Kandinsky 6.0 Pro (29B, video + audio)Sber AI FP16 85.4 GB 43.9 h Very slow
86Excellent quality (A+) · 86 of 100: how capable the model is at FP16, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. LTX-2.3Lightricks FP16 75.4 GB 6.0 h Very slow

Best Decision models for the QNAP QAI-16700 192 GB

Quality Model Quant Memory Speed Runs
78Great quality (A) · 78 of 100: how capable the model is at F16, whatever it runs on. Match score 88/100 (quality, fit, speed and memory use) sets the ranking. OpenAI Privacy FilterOpenAI F16 3.8 GB 41 ms Runs great
68Good quality (B) · 68 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 85/100 (quality, fit, speed and memory use) sets the ranking. Llama Prompt Guard 2 22MMeta Q8_0 0.7 GB 95 ms Runs great
80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. GLiNER2.5 DecideFastino Q8_0 1.2 GB 318 ms Runs well
86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 84/100 (quality, fit, speed and memory use) sets the ranking. Jina Reranker v3.5Jina AI Q8_0 15.3 GB 725 ms Slow
84Great quality (A) · 84 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. Jina Reranker v3Jina AI Q8_0 15.3 GB 725 ms Slow
66Good quality (B) · 66 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 83/100 (quality, fit, speed and memory use) sets the ranking. GLiClass Base v3Knowledgator Q8_0 0.8 GB 126 ms Runs great
90Excellent quality (A+) · 90 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. Qwen3 Reranker 4BAlibaba Q8_0 19.0 GB 4.8 s Very slow
74Great quality (A) · 74 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 82/100 (quality, fit, speed and memory use) sets the ranking. GLiClass ModernBERT Large v3Knowledgator Q8_0 1.1 GB 260 ms Runs well

Other products with the AMD Ryzen 7000 series (desktop, incl. PRO 7645 / 7745) NAS (192 GB)

Spec sources

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?