Hardware · Android

What AI models can the Other Android device with Snapdragon 8 Gen 3 (12 GB RAM) run?

RAM
12.0 GB
One app can use
7.2 GB
Memory bandwidth
77 GB/s
FP16 compute
2.8 TFLOPS
Released
2023
292 / 621 LLMs run Best: Ling 3.0 Tiny (8B-A1.3B) 0 / 61 Image models run No Android app 0 / 43 Video models run No Android app 0 / 70 Decision models run No Android app

A model runs in RAM (the 12.0 GB here), not in storage. Storage only keeps the downloaded files, and even the smallest size has room for several. Android lets one app hold only part of the RAM before it closes the app, so we plan around 7.2 GB; a model bigger than that won’t run. Phone apps such as PocketPal AI download a model once, then run it with no connection.

More about this hardware

MakerAndroid
TypeMobile device (system on a chip)
App share of memory60% (what one app can typically hold before the system closes it)
ChipSnapdragon 8 Gen 3
Bandwidth figure76.8 GB/s, estimated, see the note below

Apps that run models well on the Other Android device with Snapdragon 8 Gen 3 (12 GB RAM)

Android

  1. PocketPal AIRuns the model on the device itself, offline: download it once in the app.
  2. ChatterUIRuns the model on the device itself, offline: download it once in the app.

For a typical model that fits in memory. Each model page picks the best app for that model on this hardware. All apps

Best LLMs for the Other Android device with Snapdragon 8 Gen 3 (12 GB RAM)

Quality Model Quant Memory Speed Runs
57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 80/100 (quality, fit, speed and memory use) sets the ranking. Ling 3.0 Tiny (8B-A1.3B)Ant Group (inclusionAI) Q4_K_M 5.6 GB 45.3 tok/s Runs great
66Good quality (B) · 66 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 79/100 (quality, fit, speed and memory use) sets the ranking. Nemotron 3.5 Bolt E4BNVIDIA Q4_K_M 5.6 GB 15.4 tok/s Runs well
58Good quality (B) · 58 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. Mellum2.1 Thinking (12B-A2.5B)JetBrains Q3_K_M 6.7 GB 32.1 tok/s Runs welltight fit
64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. Nanbeige4.2 3BBOSS Zhipin (Nanbeige) Q4_K_M 4.6 GB 16.6 tok/s Runs well
64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 78/100 (quality, fit, speed and memory use) sets the ranking. Gemma 4 E4BGoogle Q4_K_M 5.6 GB 15.4 tok/s Runs well
49Fair quality (C) · 49 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 77/100 (quality, fit, speed and memory use) sets the ranking. LFM2.5 8B-A1BLiquid AI Q4_K_M 5.9 GB 40.0 tok/s Runs great
69Good quality (B) · 69 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. Gemma 4 12BGoogle Q3_K_M 7.1 GB 7.5 tok/s Slowtight fit
58Good quality (B) · 58 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 76/100 (quality, fit, speed and memory use) sets the ranking. Gemma 4 E2BGoogle Q4_K_M 3.8 GB 30.2 tok/s Runs great
62Good quality (B) · 62 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. TMax 9BAi2 Q3_K_M 5.3 GB 10.0 tok/s Runs well
64Good quality (B) · 64 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 75/100 (quality, fit, speed and memory use) sets the ranking. Nemotron Labs Dory 1.0 4BNVIDIA Q4_K_M 3.5 GB 17.4 tok/s Runs well
57Good quality (B) · 57 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. Mage-VL-Cowork 4.7BMicrosoft Q4_K_M 4.7 GB 14.6 tok/s Runs well
44Fair quality (C) · 44 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 74/100 (quality, fit, speed and memory use) sets the ranking. Unlimited OCR 2 (3B-A0.6B)Baidu Q8_0 4.6 GB 48.1 tok/s Runs great

Best Image models for the Other Android device with Snapdragon 8 Gen 3 (12 GB RAM)

None of the image models in our catalog fit in this much memory.

Best Video models for the Other Android device with Snapdragon 8 Gen 3 (12 GB RAM)

None of the video models in our catalog fit in this much memory.

Best Decision models for the Other Android device with Snapdragon 8 Gen 3 (12 GB RAM)

None of the decision models in our catalog fit in this much memory.

Best LLMs by task on this hardware Open in Model Finder

Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.

Was this page helpful?