Leaderboard
On-device LLM performance rankings powered by Glicko-2
Pixel 6
AndroidRank
#158
Rating
1,428
±14 RD
Win Rate
43.1%
Conservative Rating
1,401
TG Rating
1,434
PP Rating
1,356
Matches
1,440
Record
620W – 820L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| gemma-3-270m-it-Q4_K_M | 16.34 | 199.99 | 16.34 | 199.99 | 1 |
| agentica-org_DeepScaleR-1.5B-Preview-Q4_K_M | 12.43 | 29.61 | 12.43 | 29.61 | 1 |
| gemma-3-1b-it-Q4_K_M | 9.78 | 40.49 | 9.78 | 40.49 | 1 |
| Qwen3-0.6B-Q4_K_M | 8.64 | 55.60 | 8.64 | 55.60 | 1 |
| Qwen3-0.6B-Q8_0 | 8.40 | 50.04 | 10.82 | 59.45 | 2 |
| gemma-3-1b-it-Q2_K | 7.89 | 47.10 | 7.89 | 47.10 | 1 |
| llama-3.2-1b-instruct-q8_0 | 7.17 | 38.62 | 9.89 | 41.66 | 4 |
| qwen2.5-1.5b-instruct-q8_0 | 7.01 | 26.71 | 9.03 | 32.12 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_M | 6.51 | 17.73 | 6.51 | 17.73 | 1 |
| gemma-3-1b-it-Q4_0 | 6.21 | 32.62 | 6.21 | 32.62 | 1 |
| gemma-3-1b-it-Q8_0 | 5.66 | 38.36 | 5.66 | 38.36 | 1 |
| Gemmasutra-Mini-2B-v1-Q6_K | 5.60 | 14.70 | 5.60 | 14.70 | 1 |
| gemma-3-1b-it.Q4_K_M | 5.48 | 29.08 | 5.54 | 29.60 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ2_M | 5.36 | 9.60 | 5.36 | 9.60 | 1 |
| Qwen3-1.7B.Q4_K_M | 5.02 | 17.93 | 5.02 | 17.93 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 4.99 | 18.21 | 6.45 | 20.83 | 2 |
| gemma-2-2b-it-Q6_K | 4.87 | 13.59 | 4.98 | 14.24 | 2 |
| qwen2.5-3b-instruct-q5_k_m | 4.85 | 10.06 | 5.52 | 10.44 | 4 |
| gemma-2-2b-it-Q8_0 | 4.59 | 29.04 | 4.59 | 29.04 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 4.39 | 6.79 | 6.33 | 11.81 | 3 |
| Qwen3.5-0.8B-Q4_K_M | 4.38 | 50.86 | 4.38 | 50.86 | 1 |
| gemma-3n-E2B-it-Q4_K_M | 4.14 | 14.74 | 4.14 | 14.74 | 1 |
| mistralai_Ministral-3-3B-Reasoning-2512-Q4_K_M | 3.89 | 13.75 | 3.89 | 13.75 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 3.64 | 7.34 | 3.82 | 9.30 | 3 |
| gemma-3-4b-it.Q4_K_M | 3.22 | 10.52 | 3.58 | 10.65 | 3 |
| Llama-3.2-3B-Instruct-uncensored-Q8_0 | 2.88 | 20.69 | 2.88 | 20.69 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Q4_K_M | 2.86 | 4.72 | 2.86 | 4.72 | 1 |
| Qwen3-4B-Instruct-2507-Q4_K_M | 2.86 | 9.61 | 2.86 | 9.61 | 1 |
| gemma-3n-E4B-it-Q3_K_M | 2.60 | 5.81 | 2.60 | 5.81 | 1 |
| Qwen3-4B.Q4_K_M | 2.45 | 6.93 | 2.45 | 6.93 | 1 |
| gemma-3-4b-it-q4_0 | 2.04 | 11.49 | 2.04 | 11.49 | 1 |
| gemma-3n-E4B-it-Q4_K_M | 1.99 | 6.50 | 2.12 | 6.73 | 2 |
| Llama-3.3-8B-Stheno-Maid-v2.IQ4_XS | 1.91 | 3.75 | 1.91 | 3.75 | 1 |
| Mistral-7B-Instruct-v0.3.Q4_K_M | 1.75 | 4.13 | 1.75 | 4.13 | 1 |
| gemma-3-1b-it-BF16 | 1.36 | 4.36 | 1.36 | 4.36 | 1 |
Head-to-Head Record
1–50 of 336 rows
1 / 7
Performance by App Version
ImprovedRegressed