CodeQwen1.5-7B base (Mercury-eval Overall Beyond, 5 samples) AI Model Benchmark Evaluation

Intelligence Index

—/ 100

Calibrated multi-domain composite

Throughput Speed

—tok/sec

Output streaming throughput

Time To First Token

—ms

Initial chunk server latency

LiveBench Contam-Free

—%

September 2026 suite score

Sourced Benchmark Evaluations (1)

Verified performance across authoritative benchmarks with provenance tracking.

Benchmark	Status	Score	Trust	Date	Source Type	Provenance
Mercury	Deprecated	47.78%	10	2024-04-18	independent	Source ↗

Local Hardware Execution (Ollama)Hardware Compatible

# 1. Pull and execute model locally with Ollama
ollama run codeqwen1-5-7b-base-mercury-eval-overall-beyond-5-samples

# 2. Or invoke via local OpenAI-compatible endpoint
curl http://localhost:11434/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "codeqwen1-5-7b-base-mercury-eval-overall-beyond-5-samples",
    "messages": [{"role": "user", "content": "Analyze reasoning chains on AIME 2026"}]
  }'

Evaluation & Sourcing Notes

Scores listed for CodeQwen1.5-7B base (Mercury-eval Overall Beyond, 5 samples) represent verified evaluations extracted from official research papers, independent evaluation suites (HELM, LMSYS, OpenCompass, LiveBench), and verified audit reports.

All benchmarks marked as saturated or deprecated reflect historical performance where the benchmark no longer provides active discriminative power.