Leaderboard
On-device LLM performance rankings powered by Glicko-2
Pixel 9 Pro XL
AndroidRank
#155
Rating
1,434
±14 RD
Win Rate
43.6%
Conservative Rating
1,405
TG Rating
1,400
PP Rating
1,642
Matches
1,337
Record
583W – 754L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| Vintern-1B-v3_5-Q8_0 | 12.17 | 177.16 | 12.17 | 177.16 | 1 |
| gemma-3-270m-it-F16 | 9.82 | 115.28 | 9.82 | 115.28 | 1 |
| gemma-3-1b-it-Q4_K_M | 8.45 | 59.76 | 8.45 | 59.76 | 1 |
| qwen2.5-1.5b-instruct-q8_0 | 7.01 | 60.35 | 7.01 | 60.35 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ4_XS | 6.70 | 37.66 | 6.82 | 40.53 | 2 |
| llama-3.2-1b-instruct-q8_0 | 6.20 | 68.89 | 8.29 | 89.21 | 4 |
| qwen2.5-0.5b-instruct-fp16 | 5.97 | 17.57 | 5.97 | 17.57 | 1 |
| Qwen3-4B-Q5_K_M | 5.46 | 12.90 | 5.46 | 12.90 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 5.39 | 43.58 | 7.39 | 52.73 | 2 |
| LFM2.5-1.2B-Thinking-BF16 | 5.08 | 10.17 | 5.08 | 10.17 | 1 |
| gemma-2-2b-it-Q6_K | 5.06 | 22.79 | 5.33 | 25.88 | 4 |
| Llama-3.2-3B-Instruct-Q6_K | 4.09 | 11.41 | 4.09 | 11.41 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 3.72 | 11.36 | 5.27 | 25.83 | 6 |
| Gemmasutra-Mini-2B-v1-Q6_K | 3.27 | 17.08 | 3.72 | 19.25 | 2 |
| Qwen3-4B.Q2_K | 3.18 | 8.42 | 3.18 | 8.42 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 3.04 | 14.46 | 5.23 | 15.30 | 3 |
| Gemmasutra-Mini-2B-v1-Q3_K_L | 2.85 | 12.74 | 2.85 | 12.74 | 1 |
| Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.Q6_K | 2.47 | 9.28 | 2.47 | 9.28 | 1 |
| dolphin-llama3-zh-cn-uncensored-unsloth.Q4_K_M | 2.44 | 10.05 | 2.44 | 10.05 | 1 |
| Llama-3.1_OpenScholar-8B-IQ4_XS | 1.87 | 6.19 | 1.87 | 6.19 | 1 |
| Qwen3-30B-A3B-UD-IQ1_S | 1.81 | 4.68 | 1.81 | 4.68 | 1 |
| EXAONE-3.5-7.8B-Instruct-Q4_K_M | 1.76 | 7.42 | 1.76 | 7.42 | 1 |
| L3.2-8X3B-MOE-Dark-Champion-Inst-18.4B-uncen-ablit_D_AU-IQ4_XS | 1.64 | 5.49 | 1.64 | 5.49 | 1 |
| gemma-3-12B-it-QAT-Q4_0 | 1.61 | 8.94 | 1.61 | 8.94 | 1 |
| Llama-3.1_OpenScholar-8B-IQ2_M | 1.44 | 2.82 | 1.44 | 2.82 | 1 |
| gemma-2-9b-it-Q5_K_L | 1.39 | 3.88 | 1.39 | 3.88 | 1 |
| dolphin-llama3-zh-cn-uncensored-unsloth.Q8_0 | 1.30 | 7.36 | 1.30 | 7.36 | 1 |
| Dirty-Muse-Writer-v01-Uncensored-Erotica-NSFW.i1-Q6_K | 1.24 | 4.71 | 1.24 | 4.71 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Uncensored.i1-Q6_K | 0.91 | 5.89 | 0.91 | 5.89 | 1 |
| L3.2-8X3B-MOE-Dark-Champion-Inst-18.4B-uncen-ablit_D_AU-Q4_k_s | 0.81 | 4.11 | 0.81 | 4.11 | 1 |
| gemma-3-12b-it-Q4_K_M | 0.25 | 3.66 | 0.25 | 3.66 | 1 |
| Mistral-Small-3.2-24B-Instruct-2506-Q2_K_L | 0.08 | 1.31 | 0.08 | 1.31 | 1 |
Head-to-Head Record
1–50 of 324 rows
1 / 7
Performance by App Version
ImprovedRegressed