Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPad Air 13 inch 6th Gen
iOSRank
#8
Rating
1,995
±25 RD
Win Rate
97.9%
Conservative Rating
1,946
TG Rating
2,000
PP Rating
1,995
Matches
436
Record
427W – 9L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| gemma-3-1b-it.Q8_0 | 49.39 | 152.47 | 49.39 | 152.47 | 1 |
| SmolLM3-Q4_K_M | 38.42 | 356.02 | 38.42 | 356.02 | 1 |
| gemma-3n-E2B-it-Q4_K_M | 38.36 | 371.64 | 38.38 | 372.58 | 2 |
| Llama-3.2-3B-Instruct-uncensored-Q4_K_M | 38.19 | 347.30 | 38.19 | 347.30 | 1 |
| gemma-3n-E2B-it-UD-Q4_K_XL | 35.94 | 364.18 | 36.31 | 373.22 | 3 |
| Phi-3.5-mini-instruct.Q4_K_M | 32.80 | 267.42 | 32.80 | 267.42 | 1 |
| gemma-3-4b-it-UD-Q4_K_XL | 28.32 | 302.58 | 28.32 | 302.58 | 1 |
| gemma-2-2b-it-Q6_K | 26.95 | 250.77 | 34.30 | 466.34 | 2 |
| Llama-3.2-3B-Instruct-Q8_0 | 22.30 | 409.22 | 22.30 | 409.22 | 1 |
| tokyotech-llm-Llama-3.1-Swallow-8B-Instruct-v0.2-IQ4_NL | 18.67 | 160.43 | 18.67 | 160.43 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 14.55 | 22.94 | 14.55 | 22.94 | 1 |
| Meta-Llama-3.1-8B-Instruct-Q3_K_S | 14.07 | 145.38 | 14.11 | 146.06 | 2 |
| Qwen3-4B-Q4_K_M | 11.73 | 18.43 | 11.73 | 18.43 | 1 |
Head-to-Head Record
1–50 of 178 rows
1 / 4
Performance by App Version
ImprovedRegressed