Leaderboard

On-device LLM performance rankings powered by Glicko-2

Nothing Phone (1)

Android

Rank

#160

Rating

1,420

±14 RD

Win Rate

42.3%

Conservative Rating

1,392

TG Rating

1,426

PP Rating

1,455

Matches

1,353

Record

572W – 781L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
SmolLM2-135M-Instruct-Q4_K_M43.34193.5143.34193.511
gemma-3-270m-it-F1620.0488.7020.0488.701
LFM2.5-1.2B-Instruct-Q4_K_M15.4460.8715.4460.871
DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M9.7936.379.7936.371
llama-3.2-1b-instruct-q8_08.2947.708.2947.701
qwen2.5-1.5b-instruct-q8_06.8336.477.1736.712
SmolLM2-1.7B-Instruct-Q8_06.2024.226.2024.221
qwen2.5-3b-instruct-q5_k_m5.1612.485.1612.481
gemma-2-2b-it-Q6_K4.9215.285.1215.695
Phi-3.5-mini-instruct.Q4_K_M4.8212.074.8212.071
Gemmasutra-Mini-2B-v1-Q6_K4.1211.455.0114.012
Qwen3-4B-Instruct-2507-IQ2_S-2.34bpw3.727.073.727.071
gemma-3-4b-it-q4_03.0015.853.0015.851
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M2.237.202.237.201
Llama-3.2-3B-Instruct-Q6_K2.026.403.8310.322
gemma-3n-E4B-it-Q4_K_M1.946.131.946.131

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With