Leaderboard
On-device LLM performance rankings powered by Glicko-2
REDMAGIC 10 Pro
AndroidRank
#35
Rating
1,860
±16 RD
Win Rate
84.7%
Conservative Rating
1,829
TG Rating
1,887
PP Rating
1,825
Matches
1,099
Record
931W – 168L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| ERNIE-4.5-0.3B-PT-Q8_0 | 119.72 | 471.86 | 119.72 | 471.86 | 1 |
| Qwen2-0.5B-Instruct-Q8_0 | 69.93 | 489.25 | 70.56 | 493.56 | 2 |
| rwkv7-goose-world2.8-0.1b-F16 | 51.46 | 524.35 | 51.46 | 524.35 | 1 |
| olmoe-1b-7b-0924-instruct-q4_k_m | 45.85 | 98.66 | 46.15 | 99.36 | 2 |
| granite-3.1-3b-a800m-instruct-Q8_0 | 38.91 | 131.20 | 39.00 | 131.32 | 2 |
| llama-3.2-1b-instruct-q8_0 | 29.17 | 192.72 | 34.51 | 200.02 | 4 |
| gemma-3-1b-it.Q4_K_M | 28.13 | 154.10 | 28.13 | 154.10 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 26.05 | 111.91 | 26.07 | 112.71 | 2 |
| qwen2.5-3b-instruct-q5_k_m | 19.69 | 34.29 | 20.86 | 34.98 | 5 |
| gpt-oss-20b-MXFP4 | 15.66 | 56.56 | 15.66 | 56.56 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 14.25 | 87.65 | 14.25 | 87.65 | 1 |
| Qwen2.5-1.5B-Instruct.fp16 | 14.24 | 42.10 | 14.68 | 42.91 | 3 |
| GLM-4.7-Flash-UD-Q4_K_XL | 14.14 | 32.60 | 14.14 | 32.60 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 12.61 | 17.19 | 13.59 | 32.50 | 5 |
| Llama-3.2-3B-Instruct-Q6_K | 11.89 | 24.94 | 14.03 | 33.10 | 4 |
| gemma-2-2b-it-Q6_K | 11.60 | 23.16 | 12.40 | 32.65 | 3 |
| Llama3-8B-1.58-100B-tokens-TQ1_0-F16 | 11.20 | 18.39 | 11.20 | 18.39 | 1 |
| Llama-3SOME-8B-v2-Q4_K_M | 9.78 | 23.38 | 9.78 | 23.38 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-f32 | 9.16 | 34.26 | 9.33 | 36.80 | 3 |
| gemma-3-4b-it.Q8_0 | 8.95 | 49.84 | 8.95 | 49.84 | 1 |
| GLM-4.7-Flash.q3_k_l | 7.66 | 11.14 | 7.66 | 11.14 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Q8_0 | 7.52 | 27.64 | 7.52 | 33.09 | 2 |
| gemma-3-4b-it-IQ4_NL | 6.62 | 70.26 | 6.62 | 70.26 | 1 |
| gemma-3n-E4B-it-UD-Q8_K_XL | 6.41 | 14.87 | 6.41 | 14.87 | 1 |
| gemma-2-9b-it.Q2_K | 5.44 | 7.37 | 5.44 | 7.37 | 1 |
| gemma-3-12b-it.Q4_K_M | 4.67 | 8.01 | 4.67 | 8.01 | 1 |
| Qwen2.5-7B-Instruct.Q4_K_M | 4.02 | 12.71 | 4.02 | 12.71 | 1 |
| Qwen3-8B-f16 | 3.53 | 6.62 | 3.53 | 6.62 | 1 |
| DeepSeek-R1-Distill-Qwen-14B-Q8_0 | 3.32 | 8.61 | 3.32 | 8.61 | 1 |
| gpt-oss-20b-F16 | 3.32 | 9.14 | 3.32 | 9.14 | 1 |
| Qwen2.5-7B-Instruct.fp16 | 3.12 | 6.16 | 3.12 | 6.16 | 1 |
| Qwen2.5-14B-Instruct-Q8_0 | 2.92 | 11.79 | 2.92 | 11.79 | 1 |
| gemma-3-4b-it-qat-UD-Q8_K_XL | 2.89 | 9.48 | 2.89 | 9.48 | 1 |
| cognitivecomputations_Dolphin3.0-R1-Mistral-24B-Q6_K_L | 1.61 | 2.93 | 1.61 | 2.93 | 1 |
| gemma-3-27b-it.Q3_K_S | 1.32 | 1.61 | 1.32 | 1.61 | 1 |
Head-to-Head Record
1–50 of 285 rows
1 / 6
Performance by App Version
ImprovedRegressed