Unlimited OCR (3B-A0.6B) on Samsung Galaxy S24 FE
Can the Samsung Galaxy S24 FE run Unlimited OCR (3B-A0.6B)?
Yes, it runs great
Runs great. At Q5_K_M it needs about 3.5 GB of 4.4 GB usable, with an estimated speed of 65.5 tok/s.
- Best quant
Q5_K_M- Generation speed
- 65.5 tok/s
- Prompt processing
- 184 tok/s
- First token (1K prompt)
- 5.6 s
- Largest safe context
- 22K
Download Unlimited OCR (3B-A0.6B)
On a phone, tablet or other mobile device you install a chat app and get the model file through it, so there are no commands to copy.
On Android
No mobile app in the Play Store runs Unlimited OCR (3B-A0.6B) right now: mobile apps need a GGUF version, and none is published. Mobile apps · models that run on mobile devices.
Files and commands for a computer
Original weights · Hugging Face
Full-precision files from Baidu, for fine-tuning, vLLM, Transformers.
How it’s rated
Match score
To order lists, each result also gets a match score out of 100 from four parts. It favors the most capable model that still runs well.
| Model quality | 17.5 / 45 | |
|---|---|---|
| Memory fit | 25.0 / 25 | |
| Speed | 15.0 / 15 | |
| Memory use | 15.0 / 15 | |
| Match score | 72.5 / 100 |
Every quantization on the Samsung Galaxy S24 FE
| Quant | Memory needed | Available | Speed | Runs | Quality | File to pick in the app |
|---|---|---|---|---|---|---|
Q2_K | 2.4 GB | 4.4 GB | 111 tok/s | Runs great | 28Basic quality (D) · 28 of 100: how capable the model is at Q2_K, whatever it runs on. Match score 65/100 (quality, fit, speed and memory use) sets the ranking. | |
Q3_K_M | 2.7 GB | 4.4 GB | 92.9 tok/s | Runs great | 33Basic quality (D) · 33 of 100: how capable the model is at Q3_K_M, whatever it runs on. Match score 69/100 (quality, fit, speed and memory use) sets the ranking. | |
Q4_K_M | 3.1 GB | 4.4 GB | 76.4 tok/s | Runs great | 38Basic quality (D) · 38 of 100: how capable the model is at Q4_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking. | |
Q5_K_M | 3.5 GB | 4.4 GB | 65.5 tok/s | Runs great | 38Basic quality (D) · 38 of 100: how capable the model is at Q5_K_M, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking. | |
Q6_K | 3.8 GB | 4.4 GB | 56.8 tok/s | Runs welltight fit | 39Basic quality (D) · 39 of 100: how capable the model is at Q6_K, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking. | |
Q8_0 | 4.6 GB | 4.4 GB | — | Won't runover the app memory limit | 40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 5/100 (quality, fit, speed and memory use) sets the ranking. | |
F16 | 7.8 GB | 4.4 GB | — | Won't runover the app memory limit | 40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 5/100 (quality, fit, speed and memory use) sets the ranking. |
Memory figures assume 8K of context. Longer conversations or documents grow the KV cache.
Other hardware that runs it
-
40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
Apple M4 (16 GB)
-
40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
Intel Arc B580
-
40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
NVIDIA GeForce RTX 3060 12GB
-
40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 73/100 (quality, fit, speed and memory use) sets the ranking.
NVIDIA GeForce RTX 4070 SUPER
-
40Fair quality (C) · 40 of 100: how capable the model is at Q8_0, whatever it runs on. Match score 72/100 (quality, fit, speed and memory use) sets the ranking.
NVIDIA GeForce RTX 4060
-
40Fair quality (C) · 40 of 100: how capable the model is at F16, whatever it runs on. Match score 71/100 (quality, fit, speed and memory use) sets the ranking.
Apple M4 (24 GB)
Quick answers
How much memory does Unlimited OCR (3B-A0.6B) need on the Galaxy S24 FE?
At Q5_K_M it needs about 3.5 GB. The Galaxy S24 FE has 4.4 GB usable.
How fast is Unlimited OCR (3B-A0.6B) on the Galaxy S24 FE?
About 65.5 tok/s at Q5_K_M, an estimate from the hardware’s memory bandwidth and the size of the model.
Which quantization of Unlimited OCR (3B-A0.6B) should I use on the Galaxy S24 FE?
Q5_K_M. Of the versions that fit, it is the one that runs best; when two run equally well, the check prefers the higher-rated one.
Estimates come from published hardware specs and our open formulas, not from running the model on your machine. Real speed varies with runtime, drivers and settings. Numbers marked “Measured” come from a linked benchmark.