Leaderboard

On-device LLM performance rankings powered by Glicko-2

Galaxy A54 5G

Android

Rank

#237

Rating

1,127

±16 RD

Win Rate

14.0%

Conservative Rating

1,095

TG Rating

1,108

PP Rating

1,324

Matches

1,058

Record

148W – 910L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
ggml-model-q4_012.1762.5912.1762.591
smollm-360M-instruct-add-basics.Q8_08.3381.978.3381.971
Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_Q8_06.9170.627.0274.332
Llama-3.2-1B-Instruct-Q3_K_M6.1427.976.1427.971
tinyllama-1.1b-chat-v1.0.Q4_05.2538.965.2538.961
gemma-3-1b-it-IQ4_NL5.0155.075.0155.071
Llama-3.2-1B-Instruct-Q4_04.3333.534.3333.531
qwen2.5-1.5b-instruct-q8_04.3236.894.3236.891
DAN-Qwen3-1.7B.i1-IQ4_NL3.8930.403.8930.401
deepseek-ai.DeepSeek-R1-Distill-Qwen-1.5B.Q8_03.8526.293.8526.291
llama-3.2-1b-instruct-q8_03.8336.093.9637.432
Gemma-3-1b-it-MAX-NEO-D_AU-Q6_K-imat3.6539.903.6539.901
Dolphin3.0-Llama3.2-3B-Q4_K_M2.7210.692.7210.691
gemma-3n-E4B-it-UD-IQ2_XXS2.705.602.705.601
Gemmasutra-Mini-2B-v1-Q6_K2.6911.252.6911.251
gemma-2-2b-it-Q6_K2.4511.482.4511.481
Phi-3.5-mini-instruct.Q4_K_M2.199.042.489.162
google_gemma-3-4b-it-Q4_02.0225.962.0225.961
Llama-3.2-3B-Instruct-Q6_K1.918.482.839.785
gemma-3-4b-it-Q8_01.2212.471.2212.471

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With