Leaderboard
On-device LLM performance rankings powered by Glicko-2
Pixel 6a
AndroidRank
#152
Rating
1,449
±18 RD
Win Rate
45.0%
Conservative Rating
1,413
TG Rating
1,452
PP Rating
1,377
Matches
866
Record
390W – 476L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| gemma-3-270m-it-Q4_0 | 32.99 | 310.21 | 35.31 | 396.14 | 3 |
| gemma-3-1b-it-Q4_0 | 15.34 | 94.49 | 18.79 | 118.05 | 3 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M | 13.68 | 35.16 | 14.18 | 40.46 | 3 |
| llama-3.2-1b-instruct-q8_0 | 11.42 | 43.97 | 12.66 | 51.57 | 4 |
| gemma-3-270m-it-F16 | 10.39 | 80.04 | 13.60 | 87.62 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ4_XS | 9.95 | 28.54 | 9.95 | 28.54 | 1 |
| Qwen3-0.6B-UD-Q5_K_XL | 9.76 | 50.72 | 9.76 | 50.72 | 1 |
| qwen2.5-1.5b-instruct-q8_0 | 6.66 | 27.75 | 8.39 | 56.45 | 3 |
| SmolLM2-1.7B-Instruct-Q8_0 | 5.53 | 18.12 | 5.53 | 18.12 | 1 |
| gemma-3n-E2B-it-IQ4_XS | 4.50 | 12.36 | 4.50 | 12.36 | 1 |
| gemma-2-2b-it-Q6_K | 4.21 | 10.56 | 4.63 | 16.10 | 5 |
| Llama-3.2-3B-Instruct-Q6_K | 3.79 | 7.04 | 3.79 | 7.04 | 1 |
| granite-4.0-micro-Q4_0 | 2.04 | 10.79 | 2.04 | 10.79 | 1 |
Head-to-Head Record
1–50 of 210 rows
1 / 5
Performance by App Version
ImprovedRegressed