Catalog

Every benchmark we ever ran — 125 total · 4 flagship · 8 standard · 10 archive-only · 103 legacy

Use the directories below to browse by axis (hardware, model, family, suite, archive source) or scroll to see every run grouped by site-grade.

By hardware

vps50

50 runs

mac

50 runs

pavilion

15 runs

predator

9 runs

pavilion-predator-cross-machine

1 run

By model

qwen2-5-coder-0-5b

26 runs

unknown

21 runs

qwen2-5-coder-1-5b

17 runs

qwen3-5-9b

10 runs

qwen2-5-3b

10 runs

qwen2-5-coder-3b

9 runs

qwen3-5-4b

7 runs

qwen3-30b-a3b-iq2m

6 runs

qwen3-30b-a3b

5 runs

qwen3-14b

4 runs

phi-4

4 runs

gemma-4-26b-a4b

4 runs

qwen2-5-72b

4 runs

qwen3-30b-a3b-iq2xxs

4 runs

qwen2-5-coder-14b

4 runs

qwen3-5-0-8b

3 runs

gemma-4-e4b

2 runs

hf-chinchilla-mix

2 runs

qwen3-5-35b-a3b-uncensored

2 runs

qwen3-5-35b-a3b-iq2s

2 runs

qwen3-5-9b-q6k

2 runs

qwen3-5-2b

2 runs

qwen3-8b

2 runs

qwen3-4b

2 runs

qwen3-5-4b-mlx

2 runs

qwen2-5-14b

2 runs

gemma4-e4b

1 run

gemma4-e2b

1 run

qwen35-0-8b

1 run

qwen35-2b

1 run

qwen35-4b

1 run

qwen35-9b

1 run

qwen3-30b-a3b-iq2m-moe-cuda-ngl999-n-cpu-moe35

1 run

qwen3-30b-a3b-iq2m-moe-vulkan-ngl999-n-cpu-moe35

1 run

gemma-4-26b-a4b-it

1 run

granite-4-1-8b

1 run

gemma-4-e4b-it

1 run

codellama-34b

1 run

codestral-22b

1 run

llama3-2-3b

1 run

phi-3-mini

1 run

phind-codellama-34b

1 run

smollm2-135m

1 run

smollm2-1-7b

1 run

smollm2-360m

1 run

By family

qwen2-5-coder

48 runs

unknown

21 runs

qwen3-5

14 runs

qwen3

11 runs

qwen2-5

10 runs

gemma-phi-qwen2-5-qwen3

4 runs

smollm2

3 runs

gemma

2 runs

chinchilla

2 runs

qwen2-5-qwen2-5-coder-qwen3-qwen3-5

2 runs

llama

2 runs

phi

2 runs

gemma-qwen3

1 run

qwen3-qwen3-5

1 run

gemma-granite-qwen3-5

1 run

codestral

1 run

By suite

concurrency

21 runs

small-model-manual

9 runs

python-task-20q-v1

8 runs

hello-check

8 runs

python-task-10q-v2

7 runs

long-context

3 runs

mac-vs-vps

3 runs

benchmark-report

3 runs

chinchilla

2 runs

parallel

2 runs

python-overnight

2 runs

vs-standard

1 run

progress

1 run

coverage-audit

1 run

ladder

1 run

By source

vps81-telemetry

90 runs

pavilion

9 runs

mac

4 runs

All runs

Flagship   Flagship (4)

TitleDateHardwareEngineModelsCallsHeadline
Flagship A3B cross-machine — Pavilion side 2026-05-04 pavilion llamacpp qwen3:30b-a3b-iq2xxs 14 5.9 tok/s
Flagship A3B cross-machine — Predator side 2026-05-04 predator llamacpp qwen3:30b-a3b-iq2m 14 3.9 tok/s
Flagship Predator Qwen rerun matrix 2026-05-04 predator llamacpp qwen3.5:9b, qwen3:14b 36 14.2 tok/s
Flagship Predator trio bench 2026-05-04 predator llamacpp granite-4.1:8b, gemma-4:e4b-it, qwen3.5:9b 42 13.5 tok/s

Standard   Standard (8)

TitleDateHardwareEngineModelsCallsHeadline
Standard Pascal Vulkan-vs-CUDA Cross-Machine Benchmark — 2026-05-06 2026-05-06 pavilion+predator (cross-machine) llamacpp gemma4-e4b, gemma4-e2b, qwen35-0.8b, qwen35-2b, qwen35-4b, qwen35-9b, qwen3-14b, qwen3-30b-a3b-iq2m-moe:cuda:ngl999:n-cpu-moe35, qwen3-30b-a3b-iq2m-moe:vulkan:ngl999:n-cpu-moe35 26 —
Standard vps50-cpu-matrix-1 — gemma/phi/qwen2.5/qwen3 on vps50 2026-05-05 vps50 llamacpp phi-4, gemma-4-26b-a4b, qwen3-30b-a3b, qwen2.5-72b, gemma-4-26b-a4b-it 2 —
Standard predator-a3b-ngl6-ctx-1 — qwen3 on predator 2026-05-05 predator llamacpp qwen3:30b-a3b-iq2m 45 5.4 tok/s
Standard predator-a3b-ngl-ctx-2d-1 — qwen3 on predator 2026-05-05 predator llamacpp qwen3:30b-a3b-iq2m 90 5.5 tok/s
Standard vps50-cpu-matrix-1 — gemma/phi/qwen2.5/qwen3 on vps50 2026-05-05 vps50 llamacpp phi-4, gemma-4-26b-a4b, qwen3-30b-a3b, qwen2.5-72b 6 0.0 tok/s
Standard predator-a3b-ctx-sweep-1 — qwen3 on predator 2026-05-04 predator llamacpp qwen3:30b-a3b-iq2m 45 4.7 tok/s
Standard predator-a3b-ngl-matrix-1 — qwen3 on predator 2026-05-04 predator llamacpp qwen3:30b-a3b-iq2m 42 5.0 tok/s
Standard predator-a3b-1 — qwen3 on predator 2026-05-04 predator llamacpp qwen3:30b-a3b 2 —

Archive   Archive-only (10)
TitleDateHardwareEngineModelsCallsHeadline
Archive vps50-cpu-matrix-1 — gemma/phi/qwen2.5/qwen3 on vps50 2026-05-05 vps50 llamacpp phi-4, gemma-4-26b-a4b, qwen3-30b-a3b, qwen2.5-72b 0 —
Archive vps50-gemma-e4b-1 — gemma on vps50 2026-05-05 vps50 llamacpp gemma-4-e4b 0 —
Archive vps50-gemma-e4b-1 — gemma on vps50 2026-05-04 vps50 llamacpp gemma-4-e4b 0 —
Archive vps50-cpu-matrix-1 — gemma/phi/qwen2.5/qwen3 on vps50 2026-05-04 vps50 llamacpp phi-4, gemma-4-26b-a4b, qwen3-30b-a3b, qwen2.5-72b 0 —
Archive Predator Qwen rerun 2026-05-04 pavilion llamacpp qwen3:30b-a3b-iq2xxs 0 —
Archive predator-a3b-1 — qwen3 on predator 2026-05-04 predator llamacpp qwen3:30b-a3b-iq2m 0 —
Archive Predator Qwen rerun 2026-05-04 pavilion llamacpp qwen3:30b-a3b-iq2xxs 0 —
Archive pavilion-a3b-1 — qwen3 on pavilion 2026-05-04 pavilion llamacpp qwen3:30b-a3b-iq2xxs 0 —
Archive pavilion-weeyuga-v3 — qwen2.5/qwen2.5-coder/qwen3/qwen3.5 on pavilion 2026-04-29 pavilion weeyuga qwen3.5:4b, qwen3.5:35b-a3b-uncensored, qwen3.5:35b-a3b-iq2s, qwen3.5:9b-q6k, qwen3.5:9b, qwen3.5:2b, qwen3.5:0.8b, qwen2.5-coder:14b, qwen2.5-coder:3b, qwen3:14b, qwen3:8b, qwen3:4b, qwen2.5:3b, qwen2.5-coder:1.5b, qwen2.5-coder:0.5b 96 (12 err) —
Archive pavilion-weeyuga-v1 — qwen2.5/qwen2.5-coder/qwen3/qwen3.5 on pavilion 2026-04-28 pavilion weeyuga qwen3.5:4b, qwen3.5:35b-a3b-uncensored, qwen3.5:35b-a3b-iq2s, qwen3.5:9b-q6k, qwen3.5:9b, qwen3.5:2b, qwen3.5:0.8b, qwen2.5-coder:14b, qwen2.5-coder:3b, qwen3:14b, qwen3:8b, qwen3:4b, qwen2.5:3b, qwen2.5-coder:1.5b, qwen2.5-coder:0.5b 17 (3 err) —

Legacy   Legacy (103)
TitleDateHardwareEngineModelsCallsHeadline
Legacy HF Chinchilla — local Mac · 2026-05-04 2026-05-04 mac mlx-or-hf hf-chinchilla-mix see report —
Legacy HF Chinchilla — local Mac · 2026-05-04 2026-05-04 mac mlx-or-hf hf-chinchilla-mix see report —
Legacy Pavilion via Weeyuga — Mission 1 Phase 1 Baseline 2026-04-29 pavilion ollama — see report —
Legacy Prompt Handoff Codegen Benchmark Report 2026-04-20 vps50 ollama — see report —
Legacy Prompt Handoff Codegen Benchmark Report 2026-04-20 vps50 ollama — see report —
Legacy Qwen3.5 0.8B - Benchmark Page 2026-04-18 vps50 ollama qwen3.5:0.8b see report —
Legacy Telemetry Report Catalog 2026-04-18 vps50 ollama — see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-16 mac ollama qwen3.5:4b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-16 mac ollama qwen3.5:4b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-16 mac ollama qwen3.5:4b see report —
Legacy Hello Check Report 2026-04-16 mac ollama qwen3.5:4b see report —
Legacy SmolVLM2 256M Video - Benchmark Page 2026-04-16 vps50 ollama — see report —
Legacy CodeLlama 34 16k - Benchmark Page 2026-04-16 vps50 ollama codellama:34b see report —
Legacy Codestral 32k - Benchmark Page 2026-04-16 vps50 ollama codestral:22b see report —
Legacy Llama 3.2 3B - Benchmark Page 2026-04-16 vps50 ollama llama3.2:3b see report —
Legacy Phi-3 Mini - Benchmark Page 2026-04-16 vps50 ollama phi-3:mini see report —
Legacy Phind 34 16k - Benchmark Page 2026-04-16 vps50 ollama phind-codellama:34b see report —
Legacy Qwen14 Coder 32k - Benchmark Page 2026-04-16 vps50 ollama — see report —
Legacy Qwen14 General 32k - Benchmark Page 2026-04-16 vps50 ollama — see report —
Legacy Qwen2.5 3B - Benchmark Page 2026-04-16 vps50 ollama — see report —
Legacy Qwen2.5 Coder 0.5B - Benchmark Page 2026-04-16 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 14B - Benchmark Page 2026-04-16 vps50 ollama qwen2.5-coder:14b see report —
Legacy Qwen2.5 Coder 1.5B - Benchmark Page 2026-04-16 vps50 ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 3B - Benchmark Page 2026-04-16 vps50 ollama qwen2.5-coder:3b see report —
Legacy Qwen32 Coder 32k - Benchmark Page 2026-04-16 vps50 ollama — see report —
Legacy Qwen3.5 4B - Benchmark Page 2026-04-16 vps50 ollama qwen3.5:4b see report —
Legacy Qwen3.5 9B - Benchmark Page 2026-04-16 vps50 ollama qwen3.5:9b see report —
Legacy SmolVLM 500M - Benchmark Page 2026-04-16 vps50 ollama — see report —
Legacy SmolLM2 135M - Benchmark Page 2026-04-16 vps50 ollama smollm2:135m see report —
Legacy SmolLM2 1.7B - Benchmark Page 2026-04-16 vps50 ollama smollm2:1.7b see report —
Legacy SmolLM2 360M - Benchmark Page 2026-04-16 vps50 ollama smollm2:360m see report —
Legacy 2026-04-16 Qwen3.5 4B MLX Local Mac Benchmark 2026-04-16 mac ollama qwen3.5:4b-mlx see report —
Legacy 2026-04-16 Qwen3.5 4B MLX vs Qwen3.5 4B Ollama 2026-04-16 mac ollama qwen3.5:4b-mlx see report —
Legacy Qwen3.5 9B Local Mac Progress 2026-04-13 mac ollama qwen3.5:9b see report —
Legacy Hello Check Report 2026-04-13 vps50 ollama qwen3.5:9b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-13 vps50 ollama qwen3.5:9b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-13 vps50 ollama qwen3.5:9b see report —
Legacy 2026-04-13 Pavilion Windows GPU Qwen3.5 0.8B Long Context 2026-04-13 pavilion ollama — see report —
Legacy 2026-04-13 Pavilion GPU lane - Qwen3.5 2B 2026-04-13 pavilion ollama — see report —
Legacy 2026-04-13 Pavilion Windows GPU Qwen3.5 Long Context 2026-04-13 pavilion ollama — see report —
Legacy Qwen2.5 Coder 0.5B Same-Model Concurrency Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 14B Local Mac Overview (Aborted) 2026-04-12 mac ollama qwen2.5-coder:14b see report —
Legacy Qwen2.5 Coder 1.5B Same-Model Concurrency Sweep 2026-04-12 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 3B Same-Model Concurrency Sweep 2026-04-12 mac ollama qwen2.5-coder:3b see report —
Legacy Hello Check Report 2026-04-12 mac ollama qwen3.5:9b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 1-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 1-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 2-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 3-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 4-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 5-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 6-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Same-Model 7-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 1.5B Same-Model 3-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 1.5B Same-Model 4-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 1.5B Same-Model 5-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 1.5B Same-Model 6-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 1.5B Same-Model 7-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 3B Same-Model 3-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:3b see report —
Legacy Qwen2.5 Coder 3B Same-Model 4-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:3b see report —
Legacy Qwen2.5 Coder 3B Same-Model 5-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:3b see report —
Legacy Qwen2.5 Coder 3B Same-Model 6-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:3b see report —
Legacy Qwen2.5 Coder 3B Same-Model 7-Up Parallel Sweep 2026-04-12 mac ollama qwen2.5-coder:3b see report —
Legacy Windows Benchmark Coverage Audit 2026-04-12 pavilion ollama — see report —
Legacy Qwen2.5 Coder 14B Windows CPU Benchmark 2026-04-12 pavilion ollama qwen2.5:14b see report —
Legacy Qwen2.5 Coder 14B Windows GPU Benchmark 2026-04-12 pavilion ollama qwen2.5:14b see report —
Legacy Mac Qwen Coder Ladder 2026-04-11 mac ollama — see report —
Legacy Local Mac Qwen Mixed-Model Parallel 20Q 2026-04-11 mac ollama — see report —
Legacy Local Mac Qwen Same-Model Parallel 20Q 2026-04-11 mac ollama — see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 mac ollama qwen2.5-coder:0.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 mac ollama qwen2.5-coder:0.5b see report —
Legacy MAC Small-Model Telemetry Manual 2026-04-11 mac ollama qwen2.5-coder:0.5b see report —
Legacy Qwen0.5B Mac vs VPS Report 2026-04-11 mac ollama qwen2.5-coder:0.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 mac ollama qwen2.5-coder:1.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 mac ollama qwen2.5-coder:1.5b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-11 mac ollama qwen2.5-coder:1.5b see report —
Legacy Qwen2.5 Coder 1.5B Mac vs VPS 2026-04-11 mac ollama qwen2.5-coder:1.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 mac ollama qwen2.5:3b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 mac ollama qwen2.5:3b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-11 mac ollama qwen2.5:3b see report —
Legacy Qwen2.5 Coder 3B Mac vs VPS 2026-04-11 mac ollama qwen2.5:3b see report —
Legacy Hello Check Report 2026-04-11 mac ollama qwen2.5-coder:0.5b see report —
Legacy Hello Check Report 2026-04-11 mac ollama qwen2.5-coder:1.5b see report —
Legacy Hello Check Report 2026-04-11 mac ollama qwen2.5:3b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 vps50 ollama qwen2.5-coder:1.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 vps50 ollama qwen2.5-coder:1.5b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-11 vps50 ollama qwen2.5-coder:1.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 vps50 ollama qwen2.5:3b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-11 vps50 ollama qwen2.5:3b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-11 vps50 ollama qwen2.5:3b see report —
Legacy Windows Pavilion qwen0.5b CPU Benchmark 2026-04-11 pavilion ollama qwen2.5-coder:0.5b see report —
Legacy Windows Pavilion qwen0.5b GPU Benchmark 2026-04-11 pavilion ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Benchmark Report 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Benchmark Report 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy Qwen2.5 Coder 0.5B Benchmark Report 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy Hello Check Report 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-10 vps50 ollama qwen2.5-coder:0.5b see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-09 vps50 ollama — see report —
Legacy vps50 Python Telemetry Mini Report 2026-04-06 vps50 ollama — see report —
Legacy Hello Check Report 2026-04-05 vps50 ollama — see report —
Legacy vps50 Small-Model Telemetry Manual 2026-04-05 vps50 ollama — see report —