Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPad Air 11-inch 7th Gen
iOSRank
#14
Rating
1,989
±36 RD
Win Rate
97.6%
Conservative Rating
1,917
TG Rating
1,989
PP Rating
1,999
Matches
206
Record
201W – 5L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| SmolLM2-135M-Instruct-Q2_K | 224.93 | 5861.34 | 263.42 | 5902.43 | 2 |
| qwen2.5-1.5b-instruct-q8_0 | 44.24 | 94.49 | 44.99 | 95.17 | 2 |
| Qwen3-4B-Instruct-2507-Q4_K_M | 25.05 | 303.55 | 25.05 | 303.55 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 24.68 | 204.62 | 33.37 | 382.51 | 2 |
| Mistral-7B-Instruct-v0.3.Q3_K_M | 14.62 | 161.04 | 14.62 | 161.04 | 1 |
| Qwen3.5-4B-Q4_K_M | 10.52 | 178.18 | 10.52 | 178.18 | 1 |
| gemma-3n-E4B-it-Q5_K_M | 6.56 | 13.89 | 6.56 | 13.89 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 6.54 | 13.89 | 6.54 | 13.89 | 1 |
Head-to-Head Record
1–50 of 142 rows
1 / 3
Performance by App Version
ImprovedRegressed