Leaderboard
On-device LLM performance rankings powered by Glicko-2
I2219
AndroidRank
#199
Rating
1,321
±31 RD
Win Rate
32.6%
Conservative Rating
1,258
TG Rating
1,283
PP Rating
1,500
Matches
270
Record
88W – 182L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| tinygemma3-Q8_0 | 44.43 | 742.45 | 44.43 | 742.45 | 1 |
| gemma-3-270m-it-F16 | 13.89 | 96.00 | 13.89 | 96.00 | 1 |
| Qwen3-1.7B.Q2_K | 7.77 | 22.28 | 7.77 | 22.28 | 1 |
| tinyllama-1.1b-chat-v1.0.Q8_0 | 7.31 | 43.87 | 7.31 | 43.87 | 1 |
| llama-3.2-1b-instruct-q8_0 | 6.38 | 41.52 | 6.38 | 41.52 | 1 |
| granite-4.0-h-tiny-Q4_K_S | 6.03 | 15.79 | 6.03 | 15.79 | 1 |
| Qwen3-30B-A3B-Instruct-2507-Q2_K | 3.17 | 9.08 | 3.17 | 9.08 | 1 |
| Qwen3-4B-Thinking-2507-IQ4_NL | 2.29 | 9.90 | 2.29 | 9.90 | 1 |
| Nemotron-Research-Reasoning-Qwen-1.5B-bf16 | 1.63 | 3.59 | 1.63 | 3.59 | 1 |
| nvidia_Orchestrator-8B-IQ3_XXS | 1.39 | 2.20 | 1.39 | 2.20 | 1 |
| Qwen3-8B-DeepSeek-v3.2-Speciale-Distill.iq3_xs | 1.15 | 1.85 | 1.15 | 1.85 | 1 |
Head-to-Head Record
| Opponent | Shared Models | W | L | D | Win Rate |
|---|---|---|---|---|---|
| Galaxy S25 Ultravs | 3 | 0 | 3 | 0 | 0% |
| iPhone 14 Provs | 3 | 0 | 3 | 0 | 0% |
| iPhone 13 Provs | 3 | 0 | 3 | 0 | 0% |
| realme P1 Pro 5Gvs | 2 | 0 | 2 | 0 | 0% |
| Galaxy M53 5Gvs | 2 | 0 | 2 | 0 | 0% |
| Pixel 10 Pro XLvs | 2 | 0 | 2 | 0 | 0% |
| iPhone 11vs | 2 | 0 | 2 | 0 | 0% |
| iPhone 13 Pro Maxvs | 2 | 0 | 2 | 0 | 0% |
| POCO F6vs | 2 | 0 | 2 | 0 | 0% |
| Pixel 9 Pro XLvs | 2 | 1 | 1 | 0 | 50% |
| Pixel 6avs | 2 | 1 | 1 | 0 | 50% |
| X200 Provs | 2 | 0 | 2 | 0 | 0% |
| Redmi Note 9 Provs | 2 | 2 | 0 | 0 | 100% |
| iPhone 15 Provs | 2 | 0 | 2 | 0 | 0% |
| Nothing Phone (1)vs | 2 | 0 | 2 | 0 | 0% |
| iPhone 16 Provs | 2 | 0 | 2 | 0 | 0% |
| Xiaomi 14T Provs | 2 | 0 | 2 | 0 | 0% |
| iPhone 15vs | 2 | 0 | 2 | 0 | 0% |
| iPad Pro 11 inch 5th Genvs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S23 Ultravs | 2 | 0 | 2 | 0 | 0% |
| Pixel 7 Provs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S21 Ultra 5Gvs | 2 | 0 | 2 | 0 | 0% |
| iPhone 14vs | 2 | 0 | 2 | 0 | 0% |
| iPhone 15 Pro Maxvs | 2 | 0 | 2 | 0 | 0% |
| OnePlus 13vs | 2 | 0 | 2 | 0 | 0% |
| POCO F3vs | 2 | 0 | 2 | 0 | 0% |
| ZenFone 7 / 7 Pro (ZS670KS/ZS671KS)vs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S23vs | 2 | 0 | 2 | 0 | 0% |
| moto g54 5Gvs | 2 | 0 | 2 | 0 | 0% |
| iPhone 14 Pro Maxvs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S24+vs | 2 | 0 | 2 | 0 | 0% |
| Galaxy Z Fold6vs | 2 | 0 | 2 | 0 | 0% |
| moto e13vs | 2 | 2 | 0 | 0 | 100% |
| Pixel 8avs | 2 | 0 | 2 | 0 | 0% |
| iPhone 16 Pro Maxvs | 2 | 0 | 2 | 0 | 0% |
| HONOR Magic V2vs | 2 | 0 | 2 | 0 | 0% |
| Galaxy Z Fold7vs | 2 | 0 | 2 | 0 | 0% |
| NX799Jvs | 2 | 0 | 2 | 0 | 0% |
| iPhone 11 Provs | 2 | 0 | 2 | 0 | 0% |
| Redmi Note 14vs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S23 FEvs | 2 | 1 | 1 | 0 | 50% |