Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPhone 16 Plus
iOSRank
#27
Rating
1,930
±32 RD
Win Rate
91.8%
Conservative Rating
1,866
TG Rating
1,934
PP Rating
1,934
Matches
256
Record
235W – 21L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| SmolLM2-135M-Instruct-Q4_0 | 154.60 | 3160.46 | 158.26 | 3200.71 | 3 |
| qwen2.5-0.5b-instruct-q4_0 | 80.69 | 1343.12 | 80.69 | 1343.12 | 1 |
| Nano-Vlm-Processor-494M-F16 | 50.77 | 1748.37 | 50.77 | 1748.37 | 1 |
| qwen2.5-1.5b-instruct-q4_k_m | 37.87 | 436.26 | 37.87 | 436.26 | 1 |
| gemma-2-2b-it-Q6_K | 15.34 | 136.90 | 21.85 | 306.26 | 6 |
| gemma-2-2b-it.Q5_K_M | 13.75 | 22.28 | 13.75 | 22.28 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-IQ2_M | 9.59 | 78.50 | 11.28 | 90.48 | 2 |
| gemma-3-4b-it-Q6_K | 8.61 | 126.72 | 8.61 | 126.72 | 1 |
| DeepSeek-R1-Distill-Qwen-14B-IQ2_S | 1.18 | 2.01 | 1.18 | 2.01 | 1 |
Head-to-Head Record
| Opponent | Shared Models | W | L | D | Win Rate |
|---|---|---|---|---|---|
| iPhone 15 Pro Maxvs | 5 | 2 | 3 | 0 | 40% |
| iPhone 13 Provs | 3 | 2 | 1 | 0 | 67% |
| iPhone 16 Provs | 3 | 1 | 2 | 0 | 33% |
| iPhone 16vs | 3 | 3 | 0 | 0 | 100% |
| iPhone 15 Provs | 3 | 2 | 1 | 0 | 67% |
| Pixel 9vs | 2 | 2 | 0 | 0 | 100% |
| Galaxy S25vs | 2 | 1 | 1 | 0 | 50% |
| Pixel 7vs | 2 | 2 | 0 | 0 | 100% |
| iPhone 14 Pro Maxvs | 2 | 1 | 1 | 0 | 50% |
| iPhone 14 Provs | 2 | 2 | 0 | 0 | 100% |
| Pixel 8avs | 2 | 2 | 0 | 0 | 100% |
| iPhone 16 Pro Maxvs | 2 | 0 | 2 | 0 | 0% |
| iPad Pro 11 inch 4th Genvs | 2 | 0 | 2 | 0 | 0% |
| iPad Pro 11 inch 5th Genvs | 2 | 1 | 1 | 0 | 50% |
| Pixel 8 Provs | 2 | 2 | 0 | 0 | 100% |
| Xiaomi 15vs | 2 | 2 | 0 | 0 | 100% |
| iPhone 14vs | 2 | 2 | 0 | 0 | 100% |
| Galaxy S20 FEvs | 2 | 2 | 0 | 0 | 100% |
| iPad Pro 12.9 inch 7th Genvs | 2 | 0 | 2 | 0 | 0% |
Performance by App Version
ImprovedRegressed