Leaderboard

On-device LLM performance rankings powered by Glicko-2

Pixel 9a

Android

Rank

#179

Rating

1,352

±18 RD

Win Rate

35.7%

Conservative Rating

1,316

TG Rating

1,312

PP Rating

1,555

Matches

857

Record

306W – 551L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
LFM2.5-1.2B-Instruct-Q4_K_M19.8890.3819.8890.381
qwen2.5-1.5b-instruct-q8_012.3291.4012.7396.832
Qwen3-1.7B-Q4_09.5552.479.5552.471
Qwen3-1.7B.Q6_K5.4124.815.4124.811
gemma-2-2b-it-Q6_K4.1520.934.1520.931
Gemmasutra-Mini-2B-v1-Q6_K3.9714.433.9714.431
Qwen3-4B-Instruct-2507-Q4_03.8720.024.4421.306
Llama-3.2-3B-Instruct-Q6_K3.5115.033.5115.031
qwen2.5-3b-instruct-q5_k_m3.2911.983.2911.981
Huihui-gemma-3n-E4B-it-abliterated.Q5_K_S1.256.231.256.231

Head-to-Head Record

Compare With