QNAP TS-632X

Hardware · Annapurna Labs (Amazon)

What AI models can the Annapurna Labs Alpine AL524 NAS (4 GB) run?

RAM
4.0 GB
Usable for models
2.0 GB
Memory bandwidth
13 GB/s
Runs models on
CPU cores
Released
2021

A NAS with this chip runs models on its processor cores, so memory speed sets the pace: small models (about 1-4B) answer at a usable speed, bigger ones are slow. We plan around 2.0 GB for models, what is left after the NAS system and its storage services. Models run in a container (Docker) or the maker’s app store, and speeds assume the NAS isn’t busy with storage work.

More about this hardware

MakerAnnapurna Labs (Amazon)
TypeNAS (network attached storage) processor
Share of memory for models50% (what the NAS system and its storage services typically leave free at this size)
ChipAnnapurna Labs Alpine AL524
AI acceleratorNone. Models run on the processor cores.
NAS models with this chipQNAP TS-632X · QNAP TS-432X
Memory typeSystem RAM, shared with the NAS operating system and its storage services
Bandwidth figure12.8 GB/s, estimated, see the note below
NoteOne profile for every NAS built on this chip. Memory speed is an estimate from the chip’s supported memory in a typical NAS fitting; a unit with one memory module runs slower than one with two. Speed assumes the NAS is not busy with storage work.
Specificationswww.qnap.com

Apps that run models well on the Annapurna Labs Alpine AL524 NAS (4 GB)

For a typical model that fits in memory. Each model page picks the best app for that model on this hardware. All apps

2 products with the Annapurna Labs Alpine AL524 NAS (4 GB)

Best LLMs for the Annapurna Labs Alpine AL524 NAS (4 GB)

Quality Model Quant Memory Speed Runs
53Fair quality (C) · 53 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 67/100 (quality, fit, speed and memory use) sets the ranking. LFM3 1.7BLiquid AI Q4_K_M 1.9 GB 3.2 tok/s Slowtight fit
39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 63/100 (quality, fit, speed and memory use) sets the ranking. PaddleOCR-VL 1.6 0.9BBaidu Q4_K_M 1.5 GB 5.7 tok/s Slow
39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking. MiniCPM-OCR 1.0 1.3BOpenBMB Q4_K_M 1.7 GB 4.2 tok/s Slow
42Fair quality (C) · 42 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 62/100 (quality, fit, speed and memory use) sets the ranking. LFM3-VL 2BLiquid AI Q3_K_M 1.8 GB 3.7 tok/s Slowtight fit
34Basic quality (D) · 34 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking. MiniCPM5 1BOpenBMB Q4_K_M 1.6 GB 5.1 tok/s Slow
38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 60/100 (quality, fit, speed and memory use) sets the ranking. MiniCPM-V 4.7 1BOpenBMB Q4_K_M 1.8 GB 3.5 tok/s Slowtight fit
30Basic quality (D) · 30 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking. LFM2.5 1.2B InstructLiquid AI Q4_K_M 1.6 GB 4.7 tok/s Slow
33Basic quality (D) · 33 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking. TMax 2BAi2 Q3_K_M 1.8 GB 3.8 tok/s Slowtight fit
33Basic quality (D) · 33 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 58/100 (quality, fit, speed and memory use) sets the ranking. Qwen3.5 2BAlibaba Q3_K_M 2.0 GB 3.1 tok/s Slowtight fit
30Basic quality (D) · 30 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 57/100 (quality, fit, speed and memory use) sets the ranking. LFM2.5 2.6BLiquid AI Q2_K 2.0 GB 3.3 tok/s Slowtight fit
29Basic quality (D) · 29 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking. Jamba2 3BAI21 Labs Q2_K 2.0 GB 3.0 tok/s Very slowtight fit
24Basic quality (D) · 24 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 56/100 (quality, fit, speed and memory use) sets the ranking. LFM2 1.2BLiquid AI Q4_K_M 1.6 GB 4.7 tok/s Slow

Best Image models for the Annapurna Labs Alpine AL524 NAS (4 GB)

Quality Model Quant Memory Speed Runs
39Basic quality (D) · 39 of 100: how capable the model is at FP8, whatever it runs on. Match score 50/100 (quality, fit, speed and memory use) sets the ranking. SDXL TurboStability AI FP8 1.6 GB 73 s SlowCPU offload
42Fair quality (C) · 42 of 100: how capable the model is at FP16, whatever it runs on. Match score 47/100 (quality, fit, speed and memory use) sets the ranking. Realistic Vision V5.1SG161222 FP16 1.3 GB 10.8 min Very slowCPU offload
28Basic quality (D) · 28 of 100: how capable the model is at FP16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking. SD TurboStability AI FP16 1.3 GB 43 s SlowCPU offload
40Fair quality (C) · 40 of 100: how capable the model is at FP16, whatever it runs on. Match score 46/100 (quality, fit, speed and memory use) sets the ranking. DreamShaper 8Lykon FP16 1.3 GB 10.8 min Very slowCPU offload
35Basic quality (D) · 35 of 100: how capable the model is at FP16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking. Stable Diffusion 1.5Stability AI / Runway FP16 1.3 GB 10.8 min Very slowCPU offload
30Basic quality (D) · 30 of 100: how capable the model is at FP16, whatever it runs on. Match score 44/100 (quality, fit, speed and memory use) sets the ranking. LCM DreamShaper v7Tsinghua (LCM) FP16 1.3 GB 2.2 min Very slowCPU offload

Best Video models for the Annapurna Labs Alpine AL524 NAS (4 GB)

None of the video models in our catalog fit in this much memory.

Best Decision models for the Annapurna Labs Alpine AL524 NAS (4 GB)

Quality Model Quant Memory Speed Runs
86Excellent quality (A+) · 86 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. Jina Reranker v3.5Jina AI Q8_0 1.6 GB 24.8 s Very slow
84Great quality (A) · 84 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. Jina Reranker v3Jina AI Q8_0 1.6 GB 24.8 s Very slow
80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. GLiNER2.5 DecideFastino Q8_0 1.2 GB 10.9 s Very slow
80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. FRIDA-DecisionsSber AI Q8_0 1.7 GB 18.3 s Very slow
80Great quality (A) · 80 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. Qwen3 Reranker 0.6BAlibaba Q8_0 1.6 GB 24.8 s Very slow
76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Llama Prompt Guard 2 86MMeta Q8_0 1.0 GB 12.5 s Very slow
79Great quality (A) · 79 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. mxbai-rerank-large v2Mixedbread Q5_K_M 1.9 GB 63.4 s Very slowtight fit
76Great quality (A) · 76 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. mxbai-rerank-base v2Mixedbread Q8_0 1.3 GB 20.3 s Very slow

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?