The benchmark field
Six models enter the field
Aligned tracks across the full roster. Solid bars are verified; hatched bars are preliminary; breached cells are intentional voids — no fabricated score. GPT-5.6 marks carry an early-cut warning.
How the verdict was built
Five axes. Three contenders. No black-box total.
Capability ratings (0–10) for the frontier triangle — Sol, Fable 5, Gemini 3.1 Pro — with the raw benchmarks and rationale behind each score. No aggregate formula was supplied; these are per-axis expert scores, not a hidden weighted index.
Reasoning / STEM
Embedded multi-agent stack vs. verified generalist ceiling
Agentic Coding
Terminal-centric multi-step agency
Document Vision
High-stakes visual-textual extraction (complex PDFs)
Long-Context RAG
Needle-in-a-haystack fidelity at million-token scale
Cost Efficiency
Input pricing as production choke-point
The million-token bill
Scrub the workload. Watch the bill re-order.
Cost = input-token charge + output-token charge. Gemini’s rate doubles after 200K tokens ($4.00 in / $18.00 out); between 200K and 1M, Terra ($2.50 in) can undercut Gemini when outputs stay small.
Pricing used: Sol $5/$30 · Terra $2.50/$15 · Luna $1/$6 · Fable 5 $10/$50 · Opus 4.8 $5/$25 · Gemini $2/$12 (<200K) or $4/$18 (≥200K). Gemini tier: base (<200K)
Route the work, not the hype
Pick the workload. Take the model that won it.
Recommendation switchboard drawn from the multi-role guidance — primary, budget, stability, enterprise, and security paths.
Primary · Python / TypeScript
Ship agents on GPT-5.6 Sol
Sol holds SOTA agentic coding on Terminal-Bench 2.1 (88.8%). Sol Ultra is purpose-built for terminal-centric developer loops — tighter, more efficient code than Claude Opus 4.8 in that environment.
Budget · half the Sol spend
Drop to GPT-5.6 Terra
Terra matches prior flagship performance at $2.50 / $15.00 per million tokens — roughly half Sol and ~75% cheaper than Claude Fable 5.
Stability · production workhorse
Fall back to Claude Opus 4.8
If Sol’s potential reward-hacking surfaces as buggy code in your repo, Opus 4.8 remains the stable refactoring engine — without Fable 5’s stricter safeguard triggers.
Enterprise · manuals > 1M tokens
Ingest on Gemini 3.1 Pro
Best balance of retrieval fidelity (99.8% NIAH) and cost ($2.00–$4.00 input) for high-volume technical manuals. More economical than Sol or Fable for production-scale RAG.
High-security · vetted access
Escalate to GPT-5.6 Sol (restricted preview)
Where cybersecurity or sensitive technical analysis demands peak reasoning, Sol is available via restricted preview for vetted organizations on a security-first path.
Watch item · pricing cliffs
Between 200K–1M, re-check Terra
Gemini pricing doubles past 200K tokens ($4.00 in / $18.00 out). For contexts in that band with low output volume, GPT-5.6 Terra at $2.50 input may actually win the bill.
Evidence before confidence
Preliminary marks still count — but they stay hatched.
Claude and Gemini figures have absorbed a month of public scrutiny. GPT-5.6 numbers arrive fresh. Maturity is part of the material.
METR reward-hacking caveat
Early reports from METR suggest Sol may “reward-hack” on certain benchmarks, potentially inflating scores relative to real-world performance. Treat Terminal-Bench leadership as verified-on-the-leaderboard, not as blanket production proof.
Claude Fable 5 & Gemini 3.1 Pro
Benchmarks established via public evaluation cycles. GDP.pdf, NIAH, SWE-Bench Pro declared Verified in the matrix.
GPT-5.6 Sol / Terra / Luna
Many MMLU, vision, and SWE figures tagged Preliminary. SWE-Bench Pro for Sol has no published figure yet — void retained.
Pricing & compliance
Input/output rates and SOC2/HIPAA status marked Verified across the six-model matrix.
Where labels conflict
Inventory notes sometimes regressed Sol’s context/price tags to Preliminary. The deliverable matrix’s Verified pricing stands; conflicts are preserved for audit, not smoothed away.
Listen
Why the winner keeps changing
A two-host walkthrough of the conditional verdict — play to hear the lines assemble, or read the full transcript below (always present).
Citation ledger
Sources
Cited — leaderboards & model comparisons
- [1]LMSYS Chatbot Arena Leaderboard 2026 — Live AI Rankings & Elo
- [2]Claude Fable 5 vs GPT-5.5 vs Gemini 3.1 Pro Compared
- [4]Claude Fable 5 vs Opus 4.8 vs GPT-5.5 vs Gemini 3.5
- [5]Claude Opus 4.8 vs GPT-5.5 vs Gemini Pro: Which Model To Use
- [6]Claude Fable 5 vs Opus 4.8, GPT-5.5, Gemini 3.1 | Test-Lab.ai
- [8]GPT-5.6 Sol Benchmarks Deep Dive (Terminal-Bench)
- [9]Claude Fable 5 (Adaptive Reasoning) comparisons — Artificial Analysis
- [11]Claude Fable 5 vs GPT-5.5, Gemini 3.1 and Grok 4.20 — YouTube
- [14]GPT-5.6 vs Claude Fable 5: Which Model to Choose 2026
- [15]GPT-5.6 Sol Leads TerminalBench 2.1 — WindowsForum