Google's Gemini 4 Hydrogen comparison table lists 3.1% for Claude Sonnet 5.5 on SWE-sweep, taken from the official public leaderboard.
Tasks: Subtask-weighted reward, as Google reports it.
Setting: Google says it reports the maximum thinking setting available for Sonnet 5.5, or the best available result when that is not reported; no numeric budget is stated.
Limits: Third-party report: Google, a competing model maker, published this figure for Anthropic's model in its own comparison table. Who ran the leaderboard entry was not checked. Google reports this result for another maker's model in its Gemini 4 Hydrogen comparison table; it was not checked against that maker's or the leaderboard's own page. Results under the same benchmark name can be shown together as reported scores, but unmatched settings and missing methods rule out a controlled ranking.
Google DeepMind · Google DeepMind · Google DeepMind · Google DeepMind
