Leaderboard
On-device LLM performance rankings powered by Glicko-2
OnePlus 12
AndroidRank
#49
Rating
1,797
±15 RD
Win Rate
78.7%
Conservative Rating
1,766
TG Rating
1,796
PP Rating
1,765
Matches
1,130
Record
889W – 241L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| olmoe-1b-7b-0924-instruct-q4_k_m | 40.19 | 81.45 | 40.19 | 81.45 | 1 |
| LFM2-VL-1.6B-Q4_0 | 32.48 | 239.78 | 32.48 | 239.78 | 1 |
| smollm2-135m-instruct-iq3_xxs-imat | 28.60 | 314.15 | 28.60 | 314.15 | 1 |
| gemma-3-1b-it.Q4_K_S | 26.26 | 84.53 | 26.51 | 84.88 | 2 |
| llama-3.2-1b-instruct-q8_0 | 25.67 | 588.85 | 25.67 | 588.85 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q2_K | 23.59 | 45.38 | 23.59 | 45.38 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M | 21.96 | 65.75 | 21.96 | 65.75 | 1 |
| gemma-3-1b-it.Q8_0 | 19.02 | 127.90 | 23.27 | 134.44 | 2 |
| Qwen3-4B-Q4_0 | 13.64 | 46.00 | 13.64 | 46.00 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 12.54 | 68.37 | 12.54 | 68.37 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 11.67 | 20.44 | 11.96 | 26.67 | 5 |
| Qwen3-4B-Instruct-2507-IQ4_XS | 11.22 | 15.88 | 11.22 | 15.88 | 1 |
| gemma-3n-E2B-it-Q4_K_S | 10.73 | 33.37 | 10.73 | 33.37 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 10.32 | 19.17 | 10.51 | 20.46 | 2 |
| qwen2.5-3b-instruct-q5_k_m | 10.14 | 18.84 | 12.27 | 21.69 | 3 |
| gemma-3-1b-it.fp16 | 9.40 | 21.21 | 9.40 | 21.21 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.Q5_K_M | 9.29 | 40.16 | 9.29 | 40.16 | 1 |
| Llama-3.2-1B-Instruct-F16 | 8.24 | 13.22 | 8.24 | 13.22 | 1 |
| gemma-2-2b-it-Q6_K | 7.65 | 44.93 | 11.56 | 68.76 | 4 |
| Meta-Llama-3.1-8B-Instruct.Q4_K_M | 7.57 | 12.87 | 7.57 | 12.87 | 1 |
| internlm3-8b-instruct-q4_0 | 7.34 | 36.01 | 7.34 | 36.01 | 1 |
| gemma-3-4B-it-QAT-Q4_0 | 5.71 | 48.48 | 5.71 | 48.48 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Q3_K_L | 5.48 | 8.94 | 5.48 | 8.94 | 1 |
| gemma-3-1b-it-BF16 | 4.52 | 8.24 | 4.52 | 8.24 | 1 |
| Deepseek-R1-Distill-NSFW-RPv1.Q8_0 | 4.10 | 12.31 | 4.10 | 12.31 | 1 |
| Tifa-DeepsexV2-7b-Q8 | 3.14 | 10.91 | 3.14 | 10.91 | 1 |
| qwen2.5-7b-instruct-q2_k | 2.68 | 9.51 | 2.68 | 9.51 | 1 |
| DeepSeek-R1-Distill-Llama-8B-Uncensored.Q8_0 | 2.58 | 9.21 | 2.58 | 9.21 | 1 |
| DeepSeek-R1-0528-Qwen3-8B-IQ4_NL | 2.18 | 21.62 | 2.18 | 21.62 | 1 |
Head-to-Head Record
1–50 of 276 rows
1 / 6
Performance by App Version
ImprovedRegressed