Leaderboard

On-device LLM performance rankings powered by Glicko-2

ThinkPhone by Motorola

Android

Rank

#94

Rating

1,669

±27 RD

Win Rate

66.4%

Conservative Rating

1,616

TG Rating

1,699

PP Rating

1,564

Matches

381

Record

253W – 128L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
qwen2.5-1.5b-instruct-q8_014.7147.8714.7147.871
SmolLM2-1.7B-Instruct-Q8_013.5235.9013.5235.901
DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_M12.8225.2212.8225.221
Phi-3.5-mini-instruct.Q4_K_M8.0212.538.2512.872

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With