Leaderboard

On-device LLM performance rankings powered by Glicko-2

Xiaomi 14T

Android

Rank

#141

Rating

1,483

±18 RD

Win Rate

48.4%

Conservative Rating

1,447

TG Rating

1,476

PP Rating

1,543

Matches

835

Record

404W – 431L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
Gemmasutra-Mini-2B-v1-Q6_K6.2617.276.2617.271
qwen2.5-3b-instruct-q5_k_m6.1414.588.0717.203
qwen2.5-1.5b-instruct-q8_05.3534.555.3534.551
Phi-3.5-mini-instruct.Q4_K_M4.8811.735.6612.382
gemma-2-2b-it-Q6_K4.7719.965.1820.712
Qwen3-4B-Instruct-2507-Q4_K_M4.1615.794.1615.791
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL1.627.411.627.411

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With