Google reports 76.1% for Gemini 4 Hydrogen on AutomationBench-AA, citing the Artificial Analysis leaderboard.
Tasks: Artificial Analysis version of AutomationBench, as Google labels it.
Setting: Google says its results use the Gemini API at the highest thinking setting (xhigh for Hydrogen) unless noted; no numeric budget is stated.
Limits: Provider-reported: Google publishes the result for its own model; it has not been independently reproduced here. Google says this score comes from a third-party leaderboard; that leaderboard was not opened here, so its run date, harness and settings are unverified. Kept apart from the AutomationBench chart, whose Gemini scores Google sourced from Zapier's leaderboard; whether the two runs use the same tasks was not established. Google says the scores are as of November 2026 for the model it calls Gemini 4 Hydrogen; equivalence to the build now served on every surface is not established. Results under the same benchmark name can be shown together as reported scores, but unmatched settings and missing methods rule out a controlled ranking.
Google DeepMind · Google DeepMind · Google DeepMind · Google DeepMind · Google