Hardware · Android

What AI models can the Other Android device (6 GB RAM) run?

RAM
6.0 GB
One app can use
3.0 GB
Memory bandwidth
34 GB/s
FP16 compute
1.0 TFLOPS
Released
2022

A model runs in RAM (the 6.0 GB here), not in storage. Storage only keeps the downloaded files, and even the smallest size has room for several. Android lets one app hold only part of the RAM before it closes the app, so we plan around 3.0 GB; a model bigger than that won’t run. Phone apps such as PocketPal AI download a model once, then run it with no connection.

More about this hardware

MakerAndroid
TypeMobile device (system on a chip)
App share of memory50% (what one app can typically hold before the system closes it)
ChipMid-range Android chip
Bandwidth figure34.1 GB/s, estimated, see the note below

Apps that run models well on the Other Android device (6 GB RAM)

For a typical model that fits in memory. Each model page picks the best app for that model on this hardware. All apps

Best LLMs for the Other Android device (6 GB RAM)

Quality Model Quant Memory Speed Runs
57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking. MiniCPM5 2BOpenBMB Q4_K_M 2.5 GB 12.2 tok/s Runs well
53Fair quality (C) · 53 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking. LFM3 1.7BLiquid AI Q4_K_M 1.8 GB 17.8 tok/s Runs well
36Basic quality (D) · 36 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking. Unlimited OCR 2 (3B-A0.6B)Baidu Q3_K_M 2.7 GB 54.6 tok/s Runs welltight fit
47Fair quality (C) · 47 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 70/100 (quality, fit, speed and memory use) sets the ranking. LFM3-VL 2BLiquid AI Q4_K_M 1.9 GB 16.0 tok/s Runs well
43Fair quality (C) · 43 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking. Gemma 4 E2BGoogle Q2_K 2.7 GB 22.0 tok/s Runs welltight fit
33Basic quality (D) · 33 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking. Unlimited OCR (3B-A0.6B)Baidu Q3_K_M 2.7 GB 54.6 tok/s Runs welltight fit
46Fair quality (C) · 46 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking. Spark-X2.6 4BSparkLLM Q2_K 2.5 GB 12.3 tok/s Runs well
47Fair quality (C) · 47 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. Nemotron Labs Dory 1.0 4BNVIDIA Q2_K 2.7 GB 12.7 tok/s Runs welltight fit
38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 68/100 (quality, fit, speed and memory use) sets the ranking. TeleOCRXingChen-AGI Q4_K_M 2.4 GB 21.7 tok/s Runs well
41Fair quality (C) · 41 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking. LFM2.5 2.6BLiquid AI Q4_K_M 2.4 GB 11.4 tok/s Runs well
39Basic quality (D) · 39 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking. PaddleOCR-VL 1.6 0.9BBaidu Q4_K_M 1.3 GB 32.1 tok/s Runs great
42Fair quality (C) · 42 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 66/100 (quality, fit, speed and memory use) sets the ranking. TMax 4BAi2 Q2_K 2.6 GB 12.0 tok/s Runs welltight fit

Best Image models for the Other Android device (6 GB RAM)

None of the image models in our catalog fit in this much memory.

Best Video models for the Other Android device (6 GB RAM)

None of the video models in our catalog fit in this much memory.

Best Decision models for the Other Android device (6 GB RAM)

None of the decision models in our catalog fit in this much memory.

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?