Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPad Air 5th Gen
iOSRank
#15
Rating
1,964
±24 RD
Win Rate
94.9%
Conservative Rating
1,915
TG Rating
1,952
PP Rating
1,971
Matches
449
Record
426W – 23L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| Qwen3-8B-Q4_K_M | 1683.70 | 55308.42 | 1683.70 | 55308.42 | 1 |
| Nix2.6.Q8_0 | 32.82 | 669.66 | 32.82 | 669.66 | 1 |
| Qwen3.5-0.8B-Q4_K_M | 31.22 | 603.02 | 31.22 | 603.02 | 1 |
| gemma-2-2b-it-Q6_K | 24.85 | 376.75 | 25.64 | 377.79 | 2 |
| Qwen3-4B.Q3_K_M | 21.67 | 215.02 | 21.67 | 215.02 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ2_M | 19.62 | 26.97 | 19.62 | 26.97 | 1 |
| gemma-3-4b-it.Q4_K_M | 19.47 | 249.23 | 19.47 | 249.23 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 17.67 | 217.50 | 17.67 | 217.50 | 1 |
| Qwen3-4B-Q6_K | 16.09 | 201.02 | 16.09 | 201.02 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-uncensored.f16 | 15.86 | 31.53 | 15.86 | 31.53 | 1 |
| SmolLM2-1.7B-Instruct-Q8_0 | 14.36 | 29.75 | 14.36 | 29.75 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 12.91 | 18.19 | 12.91 | 18.19 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 10.65 | 16.27 | 10.65 | 16.27 | 1 |
| Llama-3-ELYZA-JP-8B-q4_k_m | 4.90 | 8.02 | 4.90 | 8.02 | 1 |
| gemma-3n-E4B-it-IQ4_NL | 4.76 | 9.65 | 4.76 | 9.65 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-IQ3_XS | 2.84 | 3.58 | 2.84 | 3.58 | 1 |
Head-to-Head Record
1–50 of 242 rows
1 / 5
Performance by App Version
ImprovedRegressed