Leaderboard

On-device LLM performance rankings powered by Glicko-2

iPhone 13 Mini

iOS

Rank

#76

Rating

1,864

±89 RD

Win Rate

87.5%

Conservative Rating

1,687

TG Rating

1,834

PP Rating

1,864

Matches

32

Record

28W – 4L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
gemma-3-270m-it-qat-Q4_0106.13417.51106.13417.511
gemma-3-270m-it-UD-Q8_K_XL62.78405.6062.78405.601
qwen2.5-0.5b-instruct-q6_k48.16108.8448.16108.841
gemma-3-1b-it-Q4_K_M28.64512.0428.64512.041
DeepSeek-R1-Distill-Qwen-1.5B-Q4_124.57360.9125.04363.512
llama-3.2-1b-instruct-q8_020.0545.7722.60511.283
totob-1.5B19.76288.2219.76288.221
DeepSeek-R1-Distill-Qwen-1.5B-Q2_K17.4023.8017.4023.801
minithinky-v2-1b-llama-3.2-q8_016.86403.6016.86403.601
SmolLM2-1.7B-Instruct-Q4_K_L13.84151.7013.84151.701
DeepSeek-R1-Distill-Qwen-1.5B-IQ2_M11.99190.7811.99190.781
granite-3.2-2b-instruct-Q3_K_L10.23105.0710.23105.071
Llama-3.2-3B-Instruct-Q3_K_L2.175.042.175.041
DeepSeek-R1-Distill-Qwen-1.5B-Q8_00.4125.640.4125.641
Phi-3.5-mini-instruct.Q4_K_M0.207.520.207.521

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With