Performance Benchmarks
Hydrogen is a major standalone upgrade for teams migrating from Gemini 3.8 Flash. It finishes tasks 2.5 times faster at its high default setting while more than tripling Terminal-Bench 4.1 scores, reaching 57% versus 18.2%. It also cuts fabricated claims by more than 5x.
On open-ended agentic execution, Hydrogen ranks #5 on Agent Arena, arena.ai’s live benchmark. For deep domain reasoning and analysis, it leads its class on HLE-Diamond at 58.8%, ranks #1 overall on Vals Tax Agent Bench at 52.3%, ties for #1 on the Vals Legal Research Bench at 55.8%, and leads its class on AutomationBench-AA. It outperforms other models on the new Multimodal Knowledge Agent (MKA) benchmark at 53.4% for end-to-end agentic knowledge work over complex visual files, and on Agents’ Last Exam v1.1 at 71.6% for end-to-end professional workflows.