Leaderboard
On-device LLM performance rankings powered by Glicko-2
Pixel 8a
AndroidRank
#124
Rating
1,542
±18 RD
Win Rate
54.1%
Conservative Rating
1,506
TG Rating
1,544
PP Rating
1,618
Matches
793
Record
429W – 364L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| tinygemma3-Q8_0 | 28.51 | 994.87 | 240.92 | 1227.00 | 3 |
| LFM2.5-1.2B-Instruct-Q8_0 | 18.49 | 137.78 | 18.49 | 137.78 | 1 |
| google_gemma-3-1b-it-qat-Q4_K_M | 9.68 | 56.13 | 9.68 | 56.13 | 1 |
| tinyswallow-1.5b-instruct-q5_k_m | 8.25 | 32.90 | 8.25 | 32.90 | 1 |
| llama-3.2-1b-instruct-q8_0 | 7.98 | 63.94 | 13.43 | 75.27 | 4 |
| gemma-3-1b-it-UD-Q4_K_XL | 7.72 | 29.78 | 7.72 | 29.78 | 1 |
| Qwen3-1.7B-UD-Q6_K_XL | 7.21 | 22.33 | 7.21 | 22.33 | 1 |
| gemma-2-2b-jpn-it-translate-IQ4_XS | 5.68 | 21.91 | 5.68 | 21.91 | 1 |
| Ministral-3-3B-Instruct-2512-Q8_0 | 5.33 | 22.78 | 5.33 | 22.78 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 4.59 | 11.90 | 4.91 | 12.69 | 2 |
| gemma-2-2b-it-Q6_K | 4.56 | 18.94 | 6.04 | 24.49 | 3 |
| gemma-3-4B-it-QAT-Q4_0 | 4.05 | 18.64 | 4.05 | 18.64 | 1 |
| Gemmasutra-Mini-2B-v1-Q6_K | 3.95 | 23.05 | 3.95 | 23.05 | 1 |
| amoral-gemma3-4b-v2-qat-q4_0 | 3.46 | 21.33 | 3.46 | 21.33 | 1 |
| suzume-llama-3-8B-japanese.IQ4_XS | 3.32 | 7.22 | 3.32 | 7.22 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-IQ2_M | 1.89 | 2.96 | 1.89 | 2.96 | 1 |
Head-to-Head Record
1–50 of 192 rows
1 / 4
Performance by App Version
ImprovedRegressed