Google reports a 98.9% pass@4 full-solve rate for Gemini 4 Carbon on SRE-Bench, a security reverse-engineering test of 262 binaries.
Tasks: 262 binary instances across five reverse-engineering domains; full-solve rate.
Limits: Provider-reported: Google publishes the result for its own model; it has not been independently reproduced here. Google says the scores are as of October 2026 for the model it calls Gemini 4 Carbon; equivalence to the build now served on every surface is not established. Results under the same benchmark name can be shown together as reported scores, but unmatched settings and missing methods rule out a controlled ranking.
Google DeepMind
