Leaderboard
On-device LLM performance rankings powered by Glicko-2
Galaxy S24
AndroidRank
#67
Rating
1,733
±14 RD
Win Rate
72.5%
Conservative Rating
1,705
TG Rating
1,747
PP Rating
1,674
Matches
1,324
Record
960W – 364L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| FuadeAI-50M.Q4_K_S | 276.36 | 1435.03 | 276.36 | 1435.03 | 1 |
| zephyr-smol_llama-100m-sft-full.q3_k_m | 235.57 | 771.59 | 235.57 | 771.59 | 1 |
| LFM2.5-1.2B-Instruct-Q4_K_M | 35.79 | 100.57 | 35.79 | 100.57 | 1 |
| gemma-3-1b-it-abliterated.i1-Q4_K_M | 26.59 | 68.76 | 26.59 | 68.76 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo.Q6_K | 20.56 | 37.35 | 20.56 | 37.35 | 1 |
| Qwen3-0.6B.Q4_K_M | 19.65 | 135.43 | 19.65 | 135.43 | 1 |
| gemma-3-1b-it.Q8_0 | 18.94 | 123.46 | 18.94 | 123.46 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 18.76 | 68.09 | 18.76 | 68.09 | 1 |
| Qwen3-1.7B-Q5_K_S | 18.58 | 40.49 | 18.58 | 40.49 | 1 |
| llama-3.2-1b-instruct-q8_0 | 17.41 | 99.39 | 25.13 | 164.52 | 5 |
| Qwen3-1.7B.Q4_K_M | 17.00 | 47.65 | 17.00 | 47.65 | 1 |
| qwen2.5-1.5b-instruct-q8_0 | 16.02 | 68.37 | 19.08 | 75.15 | 2 |
| gemma-3-1B-it-QAT-Q4_0 | 15.95 | 168.09 | 15.95 | 168.09 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 14.10 | 243.36 | 14.10 | 243.36 | 1 |
| Qwen3-1.7B.Q6_K | 13.25 | 26.60 | 13.25 | 26.60 | 1 |
| unsloth-Phi-3.5-mini-instruct.Q4_K | 10.62 | 22.73 | 10.62 | 22.73 | 1 |
| Qwen3-4B-Q2_K_L | 10.52 | 13.37 | 10.52 | 13.37 | 1 |
| gemma-2-2b-it-Q6_K | 9.26 | 24.68 | 13.67 | 31.21 | 4 |
| qwen2.5-3b-instruct-q5_k_m | 8.85 | 15.73 | 10.04 | 16.22 | 4 |
| gemma-3-4b-it.Q5_K_M | 8.61 | 15.39 | 8.61 | 15.39 | 1 |
| gemma-3-1b-it-UD-Q8_K_XL | 8.07 | 48.80 | 8.07 | 48.80 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 7.91 | 17.04 | 8.24 | 18.46 | 2 |
| gemma-3-4b-it.Q4_K_M | 7.75 | 17.87 | 7.75 | 17.87 | 1 |
| Qwen3-4B.Q4_K_M | 7.20 | 13.02 | 7.20 | 13.02 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 6.53 | 14.17 | 7.72 | 14.63 | 2 |
| Phi-4-mini-instruct.Q5_K_M | 5.77 | 14.65 | 5.77 | 14.65 | 1 |
| Deepseek-R1-Distill-NSFW-RPv1.Q2_K | 3.58 | 5.33 | 3.58 | 5.33 | 1 |
| huihui-ai_gemma-3-1b-it-abliterated-bf16 | 3.57 | 6.71 | 3.57 | 6.71 | 1 |
| Llama-3.2-3B-Instruct-uncensored-IQ3_M | 3.01 | 5.83 | 3.01 | 5.83 | 1 |
| mistral-7b-instruct-v0.2.Q4_K_M | 0.11 | 7.58 | 0.11 | 7.58 | 1 |
Head-to-Head Record
1–50 of 315 rows
1 / 7
Performance by App Version
ImprovedRegressed