Leaderboard
On-device LLM performance rankings powered by Glicko-2
Galaxy Note8
AndroidRank
#222
Rating
1,239
±34 RD
Win Rate
24.7%
Conservative Rating
1,171
TG Rating
1,284
PP Rating
1,115
Matches
231
Record
57W – 174L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| qwen1_5-0_5b-chat-q2_k | 7.49 | 30.52 | 7.49 | 30.52 | 1 |
| llama-3.2-1b-instruct-q8_0 | 6.37 | 15.96 | 6.37 | 15.96 | 1 |
| Qwen3-0.6B.Q4_K_M | 6.13 | 18.74 | 6.13 | 18.74 | 1 |
| Qwen2.5-0.5B-Instruct-Q4_K_M | 5.64 | 26.32 | 5.64 | 26.32 | 1 |
| Llama-3.2-1B-Instruct-IQ4_XS | 3.75 | 12.39 | 3.75 | 12.39 | 1 |
| Llama-3.2-1B-Instruct-Q4_K_M | 3.52 | 11.55 | 3.84 | 13.26 | 4 |
| Llama-3.2-1B-Instruct-Q4_K_M | 3.45 | 11.28 | 3.45 | 11.28 | 1 |
| Llama-3.2-1B-Instruct-Q4_0 | 3.38 | 11.33 | 3.82 | 11.86 | 3 |
| Llama-3.2-1B-Instruct-Q4_K_L | 2.84 | 9.19 | 2.84 | 9.19 | 1 |
| Llama-3.2-1B-Instruct-Q3_K_L | 2.78 | 7.90 | 2.78 | 7.90 | 1 |
| Llama-3.2-1B-Instruct-Q4_K_S | 2.54 | 9.43 | 2.54 | 9.43 | 1 |
| Llama-3.2-1B-Instruct-IQ3_M | 2.07 | 4.42 | 2.07 | 4.42 | 1 |
Head-to-Head Record
| Opponent | Shared Models | W | L | D | Win Rate |
|---|---|---|---|---|---|
| iPad 9th Genvs | 3 | 0 | 3 | 0 | 0% |
| Galaxy A05vs | 2 | 1 | 1 | 0 | 50% |
| Galaxy A54 5Gvs | 2 | 1 | 1 | 0 | 50% |
| Galaxy S25vs | 2 | 0 | 2 | 0 | 0% |
| Redmi Note 13 Pro 5Gvs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S24vs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S23vs | 2 | 0 | 2 | 0 | 0% |
| Galaxy S23 Ultravs | 2 | 0 | 2 | 0 | 0% |
| iPhone 15 Provs | 2 | 0 | 2 | 0 | 0% |
| POCO M5svs | 2 | 0 | 2 | 0 | 0% |
| iPhone 11vs | 2 | 0 | 2 | 0 | 0% |
| iPhone 14vs | 2 | 0 | 2 | 0 | 0% |
| Redmi Note 12vs | 2 | 1 | 1 | 0 | 50% |
| iPhone SE 3rd Genvs | 2 | 0 | 2 | 0 | 0% |
Performance by App Version
ImprovedRegressed