MarkTechPostdeepmindfrontier modelgemini4h agoenergy 119

Google DeepMind Introduces Gemini 4 Carbon, Its Top Model for Cyber Defense and Coding

Google DeepMind has introduced Gemini 4 Carbon , its strongest model to date. Gemini 4 Carbon is a frontier model from Google built for long-horizon agentic coding and cybersecurity defense. It ranks #1 on the updated v5.0 Artificial Analysis Intelligence Index with a score of 59. For developers, the catch is access. Carbon starts with a vetted group of cyber defenders, not the public API. TL;DR Size: Parameter count and context window not disclosed. Its predecessor, Gemini 4 Argon , has a 1,048,576-token context. Runs on: Google-hosted only. No open weights, no self-hosting, no quantized variants. Performance: Leads 15 of 17 published benchmarks versus Argon, GPT-6 Astra, Opus 5.5 and Fable 5.1. Best: 96.2% BFS F1 on GraphWalks (256K to 1M tokens), versus 84.2% for Argon. Worst: 81.5% on OSWorld-2.1, trailing Claude Opus 5.5 at 87.2%. Bottom line: Best: state-of-the-art vulnerability finding, exploitation and patching. Worst: you probably cannot call it yet. What is Gemini 4 Carbon? Carbon is the second Gemini 4 model, following Gemini 4 Argon . Google team states that the model targets hard, long-running engineering work. Internal teams saw Carbon run for days on single tasks. Examples include root-causing and patching subtle bugs across large codebases and low-level systems. Google also tuned Carbon for full-stack web development and multimodal understanding. On WebDev Arena , Carbon gained 89 Elo points to reach #4 at 1769. How does Gemini 4 Carbon perform on benchmarks? Google published a 17-row comparison in its launch post . Carbon was run at the highest thinking setting. Most rival numbers are self-reported by each provider, per Google’s evaluation methodology . Agentic coding : Carbon scores 65.2% on Terminal-Bench 4.0 (AA), ahead of Opus 5.5 at 59.6%. It hits 9.6% on SWE-sweep, narrowly ahead of GPT-6 Astra at 9.5%. On FrontierSWE, GPT-6 Astra leads at 65.5% versus Carbon’s 61.2%. Computer use and knowledge work : Carbon reaches 77.4% on Agents’ Last Exam v1.1. On Vending-Bench 2, it ends with a $16,484 bank balance, the highest listed. Long context and science : GraphWalks is the widest gap: 96.2% versus 71.8% for GPT-6 Astra. Carbon also posts 80.0% on RiemannBench. Why does Carbon relevant for cybersecurity? Google frames Carbon around the full defense lifecycle: find, validate, then fix. Cyber benchmarks were evaluated without guardrails. Finding: 88.2% on SEC-bench Pro , versus 85.4% for GPT-6 Astra. Exploiting: 54.8% on ExploitGym , versus 42.4% for GPT-6 Astra and 34.5% for Opus 5.5. Patching: 71.0% on Collinear’s CWE-bench , versus 68.0% for Argon and GPT-6 Astra. Google computed SEC-bench Pro and ExploitGym scores itself, using its Antigravity harness. ExploitGym ran with mitigations off. Internally, Carbon showed more than 2x higher success at generating secure code than Argon. Google team states that the Chrome team found Carbon over 10x better than another lab’s model at high-quality patches. Wiz reports Carbon leading its web penetration testing benchmarks. Play the loop</button></div> </div> <div class="panel" id="p2"> <div class="stage"> <div> <div class="step on" data-s="0"><b>1 · Find</b><small>SEC-bench Pro: uncover real vulnerabilities</small></div> <div class="step" data-s="1"><b>2 · Validate</b><small>ExploitGym: check which flaws are exploitable</small></div> <div class="step" data-s="2"><b>3 · Patch</b><small>CWE-bench: fix the root cause in code</small></div> <div class="btns"><button class="btn" id="g4cnext">Next step →</button></div> </div> <div class="bars" id="g4ccyber"></div> </div> <p class="note">Cyber benchmarks evaluated without guardrails. Google self-computed SEC-bench Pro and ExploitGym (mitigations off). Not disclosed = no score published.</p> </div> <div class="panel" id="p3"> <div class="chips" id="g4cchips"></div> <div class="bars" id="g4cbench"></div> <p class="note">Carbon and Argon run at highest thinking setting. Rivals at max available reasoning, mostly self-reported.</p> </div> <div class="panel" id="p4"> <div class="sgrid"> <div class="scard"><b>0.0%</b><span>Successful cheating on Terminal-Bench 4.0</span><em>Cheating attempts dropped to 0.4%, while accuracy improved.</em></div> <div class="scard"><b>~80%</b><span>Fewer high-severity misalignment alerts</span><em>Observed in live coding environments with Google's internal teams.</em></div> <div class="scard"><b>~2x</b><span>Fewer unsupported claims than Argon</span><em>Carbon writes caveats into the deliverable instead of hedging.</em></div> <div class="scard"><b>-26%</b><span>Overreach</span><em>Stays within scope on multi-step plans.</em></div> <div class="scard"><b>-29%</b><span>Under-service</span><em>Follows through on what was asked.</em></div> <div class="scard"><b>0.0%</b><span>Gray Swan IPI attack success</span><em>Argon was already at 0.7%. Carbon resisted every evaluated attack.</em></div> </div> <p class="note">Tap a card for detail. All figures are Google's internal or self-run results.</p> </div> <div class="panel" id="p5"> <div class="tl" id="g4ctl"> <div class="ti"><b>Pre-release testing</b><small>Google participates in the U.S. government's voluntary pre-release model testing.</small></div> <div class="ti"><b>This week: cyber defenders</b><small>A subset of cyber defenders gets access first.</small></div> <div class="ti"><b>Fairwind Program</b><small>Phased access for vetted partners: governments, critical infrastructure, core tech platforms.</small></div> <div class="ti"><b>Later: developers, businesses, consumers</b><small>No date announced. Google says "as soon as possible".</small></div> </div> <div class="calc"> <label>Monthly input tokens: <b id="g4cin">50</b>M</label> <input type="range" id="g4crin" min="1" max="500" value="50"> <label>Monthly output tokens: <b id="g4cout">10</b>M</label> <input type="range" id="g4crout" min="1" max="200" value="10"> <div class="cost"> <div><b id="g4cc1">$200</b><small>Intro price ($2 / $10)</small></div> <div><b id="g4cc2">$400</b><small>After intro ($4 / $20)</small></div> </div> </div> <p class="note">Estimate excludes caching. Cached input is 95% off the input price.</p> </div> <div class="foot"> <span>Source: <a href="https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-gemini-4-carbon/" target="_blank" rel="noopener">Google launch post</a> · <a href="https://storage.googleapis.co

read the original at MarkTechPost →