Leaderboard

On-device LLM performance rankings powered by Glicko-2

Galaxy Note10+

Android

Rank

#180

Rating

1,357

±20 RD

Win Rate

36.2%

Conservative Rating

1,316

TG Rating

1,368

PP Rating

1,271

Matches

650

Record

235W – 415L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
gemma-3-1b-it-q4_010.5555.0010.5555.001
gemma-3-1b-it-Q8_010.3344.2610.3344.261
llama-3.2-1b-instruct-q8_09.9031.9710.7139.188
gemma-3-1b-it-f166.0912.256.0912.251
qwen2.5-3b-instruct-q8_04.1711.364.1711.361
Llama-3.2-3B-Instruct-Q8_04.1211.764.1211.761
gemma-2-2b-it-Q6_K3.9811.614.6222.153
Gemma-3-it-4B-Uncensored-D_AU-IQ4_NL3.8311.603.8311.601
gemma-3-4b-it-q4_03.5814.803.5814.801
gemma-3-4b-it-Q8_03.4310.773.4310.771
Llama-3.2-3B-Instruct-Q6_K2.015.292.045.372
Meta-Llama-3-8B-Instruct.Q8_01.633.651.633.651
qwen2.5-3b-instruct-q5_k_m1.284.902.487.192
saiga_nemo_12b.Q2_K1.192.661.192.661
gemma-3-12b-it-q4_01.064.601.064.601
GigaChat-20B-A3B-instruct-v1.5.Q2_K0.994.700.994.701
saiga_gemma3_12b.Q4_K_M0.692.950.692.951
saiga_yandexgpt_8b.Q6_K0.573.020.573.021

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With