news Voratiq

Codex vs Claude Code vs Gemini CLI – Agent Leaderboard – Voratiq

The Voratiq leaderboard evaluates the performance of various coding agents in real engineering tasks, currently featuring the gemini-3-1-pro-preview model. The agents are tested head-to-head on specific tasks, with their ratings based on the outcomes of these competitions. The current top-rated agent is gpt-5-3-codex-high, with a rating of 2036, followed by gpt-5-3-codex-xhigh and gpt-5-2-high. The leaderboard ranks 25 agents based on their effectiveness and the median time taken to complete tasks, emphasizing that the longest duration correlates with lower ratings. Voratiq differs from standard benchmark suites like SWE-bench and HumanEval by utilizing ongoing engineering work rather than fixed tasks. Ratings are calculated using an Elo-like scale, reflecting the agents' success in applying their code to production environments. Each run consists of multiple agents competing simultaneously, and the winning agent’s implementation is integrated into the codebase, impacting its rating. Tasks represented in the leaderboard primarily involve TypeScript and Python, covering a range of complexities from minor fixes to extensive changes. The leaderboard is updated weekly, and new models are added as they become available. Overall, Voratiq aims to enhance coding efficiency through competitive performance evaluations of AI agents.

Build this article’s timeline

Extract dated events, key actors, and open questions using the same timeline analysis available in Signal.

Log in to build

Timeline generation is available to signed-in community members.

Five Ws 🤖 4 AI prefills · 1 still unanswered
Who
Voratiq
🤖 AI prefill
What
The Voratiq leaderboard evaluates the performance of various coding agents in real engineering tasks, currently featuring the gemini-3-1-pro-preview model.
🤖 AI prefill
When
2023
🤖 AI prefill
Where Where did this occur?
Why
Centers on Voratiq, gpt-5-3-codex-high, and agent leaderboard
🤖 AI prefill

Login to answer and earn XP for each gap you fill.

Agent Performance Leaderboard leaderboard, performance, agents, ratings, tasks Voratiq Framework Voratiq, orchestrator, competition, code, engineering Task Execution Metrics median duration, tasks, execution, TypeScript, Python Model Variants and Updates models, variants, updates, parameterizations, CLI
Voratiq95% gpt-5-3-codex-high93% agent leaderboard90% Elo-like scale88% median task duration87% Bradley-Terry model85% Gemini CLI83% coding agents80% real engineering tasks78% production codebases76%
Organizations: Voratiq3
10
Manipulation Score: Low How much this article uses emotional framing vs. straight reporting
Loaded Language 525%
Absolutist 015%
Threat/Panic 025%
Us vs Them 015%
Engagement Bait 520%
Manipulation score look right?

Factual Claims (7)

low technology
Voratiq is an open-source agent orchestrator.
low technology
The ratings shown here are a side effect of building real software.
medium technology
Ratings are derived from ongoing engineering work on production codebases.
medium technology
Ratings measure agent strength on an Elo-like scale.
medium scientific
Confidence intervals (90% CI) come from bootstrap resampling.
low social
Tasks come from our day-to-day work building products, internal tools, and support systems.
low other
The leaderboard is updated weekly, typically on Tuesdays.

Comments

Login to view and post comments.

🏠Portal 📰Links ❓Q&A 📅Events 💼Jobs