Leaderboard

On-device LLM performance rankings powered by Glicko-2

Galaxy S23 FE

Android

Rank

#190

Rating

1,314

±16 RD

Win Rate

32.1%

Conservative Rating

1,282

TG Rating

1,311

PP Rating

1,419

Matches

1,044

Record

335W – 709L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
tinygemma3-Q8_033.07587.8733.07587.871
LFM2-VL-1.6B-Q8_015.0567.5915.0567.591
gemma-3-1b-it-Q4_013.4979.1513.4979.151
LiquidAI_LFM2-VL-1.6B-IQ4_NL12.0391.0512.0391.051
llama-3.2-1b-instruct-q8_08.5356.218.5356.211
LFM2-2.6B-Q4_08.0446.258.0446.251
Phi-3.5-mini-instruct.Q4_K_M6.0412.306.0412.301
SmolLM2-1.7B-Instruct-Q8_05.9933.685.9933.681
gemma-2-2b-it-Q6_K5.6615.335.6615.331
LFM2-2.6B-Q6_K5.4316.405.4316.401
Qwen3-4B-Instruct-2507-Q4_05.2025.475.2025.471
qwen2.5-1.5b-instruct-q8_03.2230.233.2230.231
Llama-3.2-3B-Instruct-Q6_K3.157.963.157.961
qwen2.5-3b-instruct-q5_k_m2.8411.532.8411.531

Head-to-Head Record

Compare With