Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPhone 14 Pro
iOSRank
#20
Rating
1,925
±16 RD
Win Rate
91.0%
Conservative Rating
1,892
TG Rating
1,909
PP Rating
1,919
Matches
1,007
Record
916W – 91L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| tinygemma3-Q8_0 | 352.43 | 935.71 | 352.43 | 935.71 | 1 |
| gemma-3-270m-it-Q2_K | 112.69 | 334.74 | 112.69 | 334.74 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-uncensored.f16 | 103.81 | 3213.70 | 103.81 | 3213.70 | 1 |
| SmolLM2-135M-Instruct-Q8_0 | 100.22 | 3026.39 | 100.22 | 3026.39 | 1 |
| Qwen3-0.6B.Q2_K | 76.92 | 1003.69 | 76.92 | 1003.69 | 1 |
| Falcon-H1-Tiny-90M-Instruct-IQ4_XS | 67.31 | 1807.96 | 67.31 | 1807.96 | 1 |
| gemma-3-270m-it-F16 | 63.07 | 3723.90 | 63.07 | 3723.90 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M | 33.13 | 414.30 | 33.13 | 414.30 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-uncensored.Q4_K_S | 32.77 | 395.42 | 32.77 | 395.42 | 1 |
| llama-3.2-1b-instruct-q8_0 | 32.46 | 318.59 | 32.95 | 651.65 | 4 |
| gemma-3-1b-it-Q4_K_M | 32.41 | 728.28 | 32.41 | 728.28 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ2_M | 27.81 | 384.66 | 27.81 | 384.66 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-uncensored.Q4_K_M | 26.32 | 39.22 | 26.32 | 39.22 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 24.64 | 443.86 | 24.64 | 443.86 | 1 |
| DeepScaleR-1.5B-Preview-Q8_0 | 23.89 | 412.33 | 23.89 | 412.33 | 1 |
| gemma-3-1b-it-Q4_1 | 23.85 | 34.04 | 23.85 | 34.04 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ4_NL | 22.89 | 32.95 | 22.89 | 32.95 | 1 |
| qwen2.5-1.5b-instruct-q8_0 | 22.75 | 42.65 | 23.34 | 46.41 | 2 |
| gemma-3n-E2B-it-Q2_K | 22.64 | 202.45 | 22.64 | 202.45 | 1 |
| gemma-2-2b-it-IQ4_XS | 21.86 | 253.60 | 21.86 | 253.60 | 1 |
| Hermes-3-Llama-3.2-3B.Q4_K_S | 20.20 | 186.37 | 20.20 | 186.37 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_XL | 19.98 | 27.18 | 19.98 | 27.18 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_L | 19.11 | 27.71 | 19.11 | 27.71 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 19.09 | 38.76 | 20.61 | 40.66 | 2 |
| Phi-3.5-mini-instruct.Q2_K | 18.89 | 140.58 | 18.89 | 140.58 | 1 |
| gemma-3n-E2B-it-Q4_K_M | 17.86 | 193.09 | 17.86 | 193.09 | 1 |
| Qwen3-4B-Q4_K_M | 15.70 | 137.67 | 15.70 | 137.67 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 15.01 | 170.23 | 16.64 | 180.42 | 5 |
| Qwen3.5-0.8B-BF16 | 14.42 | 415.04 | 14.68 | 416.78 | 2 |
| gemma-2-2b-it-Q6_K | 13.96 | 124.36 | 18.07 | 250.49 | 8 |
| gemma-3-4b-it-Q3_K_L | 11.66 | 151.91 | 11.66 | 151.91 | 1 |
| Qwen3.5-2B-UD-Q3_K_XL | 9.79 | 27.62 | 9.79 | 27.62 | 1 |
| Qwen3-4B-Instruct-2507-IQ4_NL | 8.89 | 11.16 | 8.89 | 11.16 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 8.64 | 13.05 | 16.20 | 199.83 | 7 |
| DeepSeek-R1-Distill-Qwen-7B-Q2_K | 8.62 | 83.53 | 8.62 | 83.53 | 1 |
| gemma-3-4B-it-QAT-Q4_0 | 6.69 | 98.08 | 6.69 | 98.08 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-IQ2_M | 6.33 | 71.03 | 6.33 | 71.03 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 3.48 | 10.73 | 4.67 | 11.21 | 2 |
Head-to-Head Record
1–50 of 314 rows
1 / 7
Performance by App Version
ImprovedRegressed