Where security agents run. AI infrastructure to build, evaluate, and deploy with confidence.

Joined August 2010
dreadnode retweeted
🎯SCOPEBENCH WORLD TOUR CONTINUES🎯 Been a minute since I've been in SF. Stoked to be there with @VincentAbruzzo. Using ScopeBench, I think we've found a way to compare control harnesses easily and cheaply, and Jev is a perfect test case!
Heading to @unpromptedconf next week? Catch @VincentAbruzzo and @shanejcaldwell on stage Wednesday, October 28 for their talk on using #ScopeBench to measure how effective Jev is when used as a monitor to keep agentic harnesses in scope.
1
5
215
dreadnode retweeted
1
2
10
495
dreadnode retweeted
The best practitioner (not lab) AI evals for offensive cybersecurity I follow myself: 1) The @dreadnode dreadindex. Evals al the way down to the vuln category level, and refusals accounting dreadnode.io/research/dreadi… 2) @AikidoSecurity white-box but i've confirmed that it extends to dynamic testing well aikido.dev/aikido-arena 3) BArena by @mdp_sec focused on bounty-like black box bugs. blackboxarena.ai/ 4) @mindfort 's nexbench has info downto the config of a model including thinking or effort setting, and cost per finding, which many omit. mindfort.ai/blog/introducing…
16
65
4
345
177,887
dreadnode retweeted
YOU HAVE TO JOIN THE LIVESTREAM RIGHT NOW OR ELSE
1
1
150
dreadnode retweeted
We hosted our first Frontier AI Security Summit with Temasek this week at Singapore International Cyber Week. There was no better time to convene over 200 leaders from more than 80 startups, multinationals, and government organizations to discuss the rapidly changing frontier of AI and cybersecurity 🔥 Thank you to our founders for sharing their perspectives and new capabilities: Patrick Gray (@riskybusiness) - What's Next After Mythos? Brad Palm (@dreadnode) - Autonomous Offense Robby Winchester (@SpecterOps) - Adversarial Simulation Zakir Durumeric (@censysio) - Internet Intelligence Jesse Rothstein (@DropzoneAI) - Autonomous Defense Damien Lewke (@nebulocksec) - Agentic Context for SecOps Surag Patel (@pixeebot) - Securing Software Factories A special thank you to SMS Tan Kiat How, Senior Minister of State, Ministry of Digital Development and Information & Ministry of Health, for welcoming our delegation this year 🙏 We are grateful to our friends at Temasek for their partnership and support throughout the week. See you all soon!
2
5
12
867
dreadnode retweeted
This was a great set of talks at @OffensiveAIcon by @shanejcaldwell and @0xdab0 plus Michael Kouremetis yesterday... definitely check out the papers and research.
🧵 [1/3] Agents can hack. What's holding them back is trust: will they stay in scope? Today we're releasing ScopeBench, a methodology and community benchmark that evaluates how well agents adhere to scope in real offensive security workflows across web, Windows Active Directory, and cloud.
3
4
25
1,643
Came for a talk on alignment evaluations, but instead watching @shanejcaldwell go full philosophy on the human condition.
2
1
14
2,013
dreadnode retweeted
#nowplaying: @shanejcaldwell and @0xdab0 of @dreadnode talks about scope alignment and #scopebench
1
1
4
549
dreadnode retweeted
Contribute a task! Based on standard @harborframework format
🧵 [1/3] Agents can hack. What's holding them back is trust: will they stay in scope? Today we're releasing ScopeBench, a methodology and community benchmark that evaluates how well agents adhere to scope in real offensive security workflows across web, Windows Active Directory, and cloud.
3
12
810
dreadnode retweeted
WARNING: reading scopebench may make you a REAL CHILLER
1
4
420
dreadnode retweeted
Offensive AI Con
@OffensiveAIconOct 4
Our friends at @dreadnode are hosting the kick-off party for OAIC 2026! We're excited to kick off year two at the Seabird Poolside Lounge, with good food, incredible vibes, and a few special surprises. 👀
2
1
11
1,611
dreadnode retweeted
Got tired of managing cyber ranges through multiple cloud dashboards and agentic terminals so collapsed them all into one view/interface. Hope it's helpful to others as well.
New addition to DreadGOAD: Console. DreadGOAD Console is a local agentic web UI for deploying, managing, troubleshooting, and validating DreadGOAD lab ranges. Principal AI Research Engineer @mkultraWasHere added the agentic console to our DreadGOAD platform to offload range deployment and administration to agents and consolidate the interface for managing multiple ranges in multiple cloud providers simultaneously. Watch this tutorial for a walkthrough of the Console and how to deploy a range: youtube.com/watch?v=7OmCifoE… DreadGOAD repo: github.com/dreadgoad
There's a new version of this post
1
1
108
dreadnode retweeted
Replying to @SakanaAILabs
@SakanaAILabs fugu-cyber model results for @dreadnode 's DreadIndex (dreadnode.io/research/dreadi…) coming soon.
1
1
168
dreadnode retweeted
scopejudge 🤝 jev
Does Jev live up to the hype? Based on the results of running it against our ScopeJudge benchmark, it does. @typesafeai's Jev was competitive with leading LLM judges, catching agent scope violations at pennies per thousand checks, with 130 millisecond responses on average. [1/4]
1
1
5
666
Presenting at @labscon_io is always a homecoming. The conference that gave me my start. And I am so happy I got to speak at the last one. We had a lot of fun Mogging Mythos and showing how to push the offensive capabilities of open-weight models to their edge and beyond.
1
4
14
873
METR is just one of many existing AI evaluators! If you take issue with METR, that isn’t a good argument against requiring companies to carry out embedded audits Here are 20 other evaluators who work with AI labs to assess risk: Transluce Grey Swan Apollo AVERI SecureBio Faculty Vaultis Dreadnode Irregular RAND Far AI ActiveFence (now Alice) Active Site Deloitte (via Gryphon acquisition) Nemesys Mercor (via Sepal acquisition) AE Studio Scale Frontier Design Redwood
13
28
8
281
17,052
Always feels a little strange to watch a recording of myself but had a lot of fun repping @dreadnode and digging into the AI cyber nexus with the @AtlanticCouncil’s @CyberStatecraft crew.
“The US hasn’t demonstrated a willingness to take the lead” on data security and privacy, says @Dreadnode Head of Policy @velvethamm3r. With AI accelerating progress, “we’re now seeing real-time consequences,” she tells @CyberStatecraft’s Trey Herr.
1
4
22
2,368
dreadnode retweeted
HYBRID 8 SEP 13:00 UTC - Data Governance for AI and Healthcare: From Washington to Beijing isoc.live/21983 @CyberStatecraft convenes @Pfizer's Ranjit Kumble, @Snowflake's Stephen Moon, @dreadnode's Daria Bahrami and Harvard Medical School's Gil Alterovitz on the data, compute and regulation behind AI-enabled healthcare. Moderated by @GrahamBrookie and Trey Herr. In DC and online. #ACCyber #AI #HealthData #DataGovernance
1
1
140