Leaderboard
On-device LLM performance rankings powered by Glicko-2
Galaxy S24+
AndroidRank
#70
Rating
1,724
±14 RD
Win Rate
71.6%
Conservative Rating
1,695
TG Rating
1,738
PP Rating
1,729
Matches
1,301
Record
931W – 370L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| tinygemma3-Q8_0 | 237.71 | 1134.41 | 237.71 | 1134.41 | 1 |
| gemma-3-1b-it-q8_0 | 28.82 | 147.77 | 28.82 | 147.77 | 1 |
| llama-3.2-1b-instruct-q8_0 | 20.72 | 113.44 | 24.77 | 123.11 | 5 |
| ERNIE-4.5-0.3B-PT-F16 | 20.30 | 62.51 | 20.30 | 62.51 | 1 |
| gemma-3-1b-it.Q6_K | 16.53 | 101.90 | 16.53 | 101.90 | 1 |
| Qwen3-1.7B-Q8_0 | 12.53 | 60.75 | 12.53 | 60.75 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 12.32 | 73.60 | 17.51 | 78.50 | 2 |
| qwen2.5-3b-instruct-q4_k_m | 11.79 | 47.84 | 11.79 | 47.84 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M | 9.98 | 47.65 | 9.98 | 47.65 | 1 |
| gemma-3-4b-it.Q4_K_M | 9.51 | 23.35 | 9.51 | 23.35 | 1 |
| Qwen3-4B.Q4_K_M | 9.33 | 20.93 | 9.33 | 20.93 | 1 |
| Gemmasutra-Mini-2B-v1-Q6_K | 9.16 | 26.43 | 9.16 | 26.43 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 8.58 | 16.10 | 9.59 | 20.58 | 5 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ2_M | 8.54 | 25.56 | 8.54 | 25.56 | 1 |
| gemma-2-2b-it-Q6_K | 8.53 | 26.44 | 9.20 | 37.70 | 5 |
| Phi-3.5-mini-instruct.Q4_K_M | 8.23 | 22.23 | 10.86 | 27.73 | 3 |
| Llama-3.2-3B-Instruct-Q6_K | 8.08 | 19.44 | 11.61 | 23.12 | 4 |
| gemma-3-4b-it.Q8_0 | 7.69 | 27.44 | 7.69 | 27.44 | 1 |
| medgemma-4b-it-IQ4_NL | 6.98 | 41.34 | 6.98 | 41.34 | 1 |
| Gemma-3-4B-VL-it-Gemini-Pro-Heretic-Uncensored-Thinking_Q8_0 | 6.85 | 44.85 | 6.85 | 44.85 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Q4_K_M | 6.37 | 12.28 | 6.37 | 12.28 | 1 |
| Phi-4-mini-instruct.Q8_0 | 5.73 | 22.20 | 5.73 | 22.20 | 1 |
| Qwen3-4B-Instruct-2507-Q8_0 | 5.36 | 19.48 | 5.36 | 19.48 | 1 |
| Janus-Pro-7B-LM.Q2_K | 5.18 | 7.39 | 5.18 | 7.39 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 4.58 | 32.85 | 4.84 | 33.06 | 2 |
| DeepSeek-R1-Distill-Llama-8B-Abliterated.Q5_K_S | 3.63 | 5.75 | 3.63 | 5.75 | 1 |
| Qwen3.5-2B-Uncensored-HauhauCS-Aggressive-BF16 | 3.03 | 8.90 | 3.03 | 8.90 | 1 |
| Qwen3.5-9B-Q4_0 | 2.56 | 6.57 | 2.56 | 6.57 | 1 |
| LFM2.5-1.2B-Instruct-Q4_K_M | 1.26 | 43.02 | 1.26 | 43.02 | 1 |
Head-to-Head Record
1–50 of 315 rows
1 / 7
Performance by App Version
ImprovedRegressed