talent @ ****** | prev $PROVE $COIN $HOOD

San Francisco
Joined November 2009
Justin T Chen retweeted
Replying to @DavidSacks
Glad to see this. Would trust these commitments more if labs put money behind them. xitter.cf/RuneKvist/status/21027…
Frontier labs can put their money where their mouths are on catastrophic risks by building a mutual insurer. Labs already face liability. We can use this. Within 3 months, with no government action, labs could create a body with skin in the game to avoid reckless deployments, teeth to enforce security practices, and market pricing signals on which risks are real. Here’s how it works. The labs put capital into a shared fund. The fund pays out when any member causes harm. Coverage could include third-party liability for harms like cyberattacks on critical infrastructure and mass-casualty bioweapon attacks. Its job is to use the incentives of our existing liability regime to understand the risks and reduce them. Technical talent could be borrowed from member labs or contracted from third-party evaluators. Concretely, the Hugging Face incident investigation would have looked very different under a mutual. Today, OpenAI picks the auditor, sets the investigation's scope, and keeps most of its lessons private. With a mutual, OpenAI would be contractually required to notify the mutual within 72 hours of discovery. The mutual would pick a rigorous auditor, set a scope sufficient to get to the bottom of the incident, and turn the findings into requirements for every frontier lab as a condition of coverage. The case for a frontier lab mutual: Mutuals have skin in the game. Mutuals pay out when damages occur. They go out of business if they understate or overstate the risks. It profits when risks are reduced. That gives it a continuing reason to investigate incidents, quantify exposure, and fund security work that reduces that exposure. In contrast, proposed self-regulatory organizations (SROs) have no skin in the game. Historically, SROs have been better at managing regulatory risk; mutuals have been better at managing liability risks. Liability risks better tracks what the public cares about, building trust. Mutuals have teeth. Coverage comes with conditions. A mutual can require disclosure, audits, independent model evaluations, and fixes. It chooses the evaluators, so labs can’t shop referees. If a member fails to meet security standards, the mutual has enforcement capacity by suspending coverage or expulsion. Mutuals help labs work together on security. Frontier security is a hard problem, no lab can solve it alone. They currently can’t learn from each others’ incidents, threat models, or guardrails. Insurance has an established legal framework for this kind of cooperation aimed at reducing risks. A mutual could employ security engineers seconded from member labs, investigate failures, and distribute fixes across the membership, like it happens in the nuclear industry. Mutuals have a track record of reducing risk. Our essay shares examples of how successful mutuals across technical fields like nuclear energy and medical malpractice. We can learn from decades of iteration. Mutuals can be created fast. The first policy could be issued within 3 months. No new laws or regulators needed. This matters because we need trial and error to get this right, and most other ideas have many months or years of lead time. Importantly, a mutual is compatible with other governance institutions; e.g. in nuclear, the mutual is tightly coupled with an SRO. A mutual would still have limitations. The government will be needed to handle e.g. national security risks and incidents. A mutual’s capital could cover only a fraction of a major catastrophe. There are important open questions about how liability will work. Our claim is that a mutual is the fastest way to enforce liability. We could get signal on its effectiveness within 6 months. That would be a big step forward. lawfaremedia.org/article/boo…
1
14
994
Justin T Chen retweeted
Frontier labs can put their money where their mouths are on catastrophic risks by building a mutual insurer. Labs already face liability. We can use this. Within 3 months, with no government action, labs could create a body with skin in the game to avoid reckless deployments, teeth to enforce security practices, and market pricing signals on which risks are real. Here’s how it works. The labs put capital into a shared fund. The fund pays out when any member causes harm. Coverage could include third-party liability for harms like cyberattacks on critical infrastructure and mass-casualty bioweapon attacks. Its job is to use the incentives of our existing liability regime to understand the risks and reduce them. Technical talent could be borrowed from member labs or contracted from third-party evaluators. Concretely, the Hugging Face incident investigation would have looked very different under a mutual. Today, OpenAI picks the auditor, sets the investigation's scope, and keeps most of its lessons private. With a mutual, OpenAI would be contractually required to notify the mutual within 72 hours of discovery. The mutual would pick a rigorous auditor, set a scope sufficient to get to the bottom of the incident, and turn the findings into requirements for every frontier lab as a condition of coverage. The case for a frontier lab mutual: Mutuals have skin in the game. Mutuals pay out when damages occur. They go out of business if they understate or overstate the risks. It profits when risks are reduced. That gives it a continuing reason to investigate incidents, quantify exposure, and fund security work that reduces that exposure. In contrast, proposed self-regulatory organizations (SROs) have no skin in the game. Historically, SROs have been better at managing regulatory risk; mutuals have been better at managing liability risks. Liability risks better tracks what the public cares about, building trust. Mutuals have teeth. Coverage comes with conditions. A mutual can require disclosure, audits, independent model evaluations, and fixes. It chooses the evaluators, so labs can’t shop referees. If a member fails to meet security standards, the mutual has enforcement capacity by suspending coverage or expulsion. Mutuals help labs work together on security. Frontier security is a hard problem, no lab can solve it alone. They currently can’t learn from each others’ incidents, threat models, or guardrails. Insurance has an established legal framework for this kind of cooperation aimed at reducing risks. A mutual could employ security engineers seconded from member labs, investigate failures, and distribute fixes across the membership, like it happens in the nuclear industry. Mutuals have a track record of reducing risk. Our essay shares examples of how successful mutuals across technical fields like nuclear energy and medical malpractice. We can learn from decades of iteration. Mutuals can be created fast. The first policy could be issued within 3 months. No new laws or regulators needed. This matters because we need trial and error to get this right, and most other ideas have many months or years of lead time. Importantly, a mutual is compatible with other governance institutions; e.g. in nuclear, the mutual is tightly coupled with an SRO. A mutual would still have limitations. The government will be needed to handle e.g. national security risks and incidents. A mutual’s capital could cover only a fraction of a major catastrophe. There are important open questions about how liability will work. Our claim is that a mutual is the fastest way to enforce liability. We could get signal on its effectiveness within 6 months. That would be a big step forward. lawfaremedia.org/article/boo…
7
20
6
95
16,301
Justin T Chen retweeted
3 new hacks by OpenAI agents discovered in a project led by @TransluceAI where AIUC contributed. The incidents dated May and June 2026. The agents attempted to hack the Australian Institute of Health and Welfare, DataUSA, and the University of New Mexico. Alongside these three incidents, we released 30,000 logs. Transluce write-up: transluce.org/agent-activity NYT: nytimes.com/2026/09/23/techn…
3
3
2
43
4,157
Justin T Chen retweeted
Replying to @elonmusk
@elonmusk excellent idea. The easiest way to enforce this is via a mutual insurer like they do in nuclear.
BREAKING: Elon Musk joined the All-In Summit today virtually. He proposed that leading AI companies test one another’s models before release, so competitors can flag safety concerns. Musk said this peer-review system could begin immediately.
1
5
1
27
2,466
Justin T Chen retweeted
The Time Is Now: "As the situation around AI gets crazier over the next few years, an organization you start now could become the default institution that society delegates very important responsibilities to."
Some thoughts: - As the situation around AI gets crazier over the next few years, an organization you start now could become the default institution that society delegates very important responsibilities to. METR is a good example - if the FINRA for AI thing happens, it’s likely they just tap a blade on each of METR’s shoulders and ordain it ‘the evaluator’. - It’s really important that the group which gets delegated any important problem is smart, competent, and technocratic, rather than whatever random clusterfuck the government would set up in the counterfactual without you. - But it takes time to build a new organization and develop credibility. METR/Redwood couldn’t have asked to do that Hugging Face investigation if they sprang up last month. You should do the initial conceptual MVP schlepping now, so that as smarter and smarter AIs arrive in 27 and 28, you can productively spend 100s of m of $ having them rapidly clear well-scoped problems. (I will hedge here and say a big concern I have about startomg a new org outside the labs is that the difference between the best internal and external models will increase closer to RSI. But we should try to prevent that kind of outcome anyways, where only 2 companies are in a position to understand and make important calls and contributions relevant to the development of ASI. In terms of epistemics, incentives, and governance, that’d be a terrible situation.) - If you want to start a new org to tackle AI risk, it’s not obvious that a for-profit is the right structure. For-profits are great, but make most sense when you are excited about the direct consequences of transactions clearing. If your theory of change is some side effect of doing business, you should just do that side shit directly. - Previously the reason to do a startup first was to make money to fund the pro-bono stuff. But you should take into account how much AI-risk-concerned money is gonna get dumped into the ecosystem as these IPOs happen, desperately searching for useful projects to fund. Wealth will be abundant - what will be rare are founders who can own these key problems.
3
1
25
2,294
This is big. @KPMG_US 🤝 @aiunderwriting
KPMG has a 150-year legacy built on trust. Their agentic platform, aIQ Capture, is now AIUC-1 certified - a first for the Big Four. Aisha Tahirkheli, Trusted AI Leader @KPMG_US, and @RajivDattani discussed the need for AI agent assurance, certifying before regulation matures, and more.
2
183
Justin T Chen retweeted
Anthropic's conclusion is interesting -- but wrong. They write (paraphrased): "AIs have read all human history so they talk like humans - but they don't have cooperative dispositions of humans. Scary." The work here makes me think the opposite: multi-agent systems behave exactly like humans. The multiagent turf war they describe seems exactly like human corporate turf wars, executed clumsily: "We consistently saw a multiagent turf war. All of the models we tested quickly assumed that others were purposefully impeding their work, and began to sabotage others while protecting their own contributions. In fact, they sabotaged others with increasingly aggressive, self-replicating malware. This included disabling the Unix accounts of the other agents, writing automated scripts that found and killed competing processes on a loop, and deploying malicious code that was disguised as belonging to another agent." To be clear, I think scaling this up will lead to dramatic chaos. So, scary. But mechanisms designed to deal with human conflict may have clues for solutions. On the bright side, we know humans can also truly, earnestly collaborate. This requires a grand narrative of how our a shared fate, an overlap in identity. What would it look like to centre alignment around that?
From the conclusion of Anthropic's report published tonight by their Frontier Red Team, 'Patterns and problems in emerging multiagent systems.' An extremely interesting, if somewhat unsettling, read. I'll quote the full conclusion the screenshot is taken from, but if you're interested in multi-agent swarms, the whole thing is worth reading. 'Every model we tested abstractly understands that information sources have their own incentives, and that consensus is not necessarily evidence. What is missing is a disposition to act on that knowledge without prompting. Our social systems are robust in ways that are easy to take for granted. Over many millennia, mechanisms like norms, reputation, costly signaling, and recourse have been refined to make human coordination go well. While language models have inherited the content of that history, they don't necessarily carry the disposition produced by it. They have a very different relationship to communication itself: for instance, human organizations might spend considerable time in meetings to align on a direction before implementing, and individuals become more specialized over time. But for agents, transmitting context is about as costly as acting on it, and an agent can be forked or repurposed at will. Thus, the assumptions that make coordination successful for us do not obviously hold. Nothing above suggests that these failures are permanent—but nothing suggests they will fix themselves, either. Coordination doesn't naturally emerge from stronger intelligence nor alignment at the individual level. Thus, the work that must be done takes two forms: environments that exert the kinds of social pressure that evolution exerted on us, and social computing systems redesigned for actors that can self-replicate and self-improve. These are open problems in interaction and mechanism design, and our experiments here provide early evidence that new solutions are necessary. The conditions that allow multiagent interaction to go well will be discovered one way or another: either deliberately and early, or—and by default—in production, after agents’ interactions far outnumber ours. We would prefer the former.'
18
17
4
173
56,951
Justin T Chen retweeted
Replying to @buildonbase
Based proving 🟦
1
1
8
789
Justin T Chen retweeted
Base is excited to announce that we have completed a migration of our ZK proving type to SP1’s Plonk from @succinctlabs
37
34
6
260
28,194
Congrats @Lovable team! Love seeing pioneers prioritize AI saftey.
Today @Lovable announced their AIUC-1 certification - earning the trustmark for AI agents. Congrats on passing this milestone @antonosika & @FabianHedin - proud to see the Nordics set the pace here!
1
267
Justin T Chen retweeted
Today @Lovable announced their AIUC-1 certification - earning the trustmark for AI agents. Congrats on passing this milestone @antonosika & @FabianHedin - proud to see the Nordics set the pace here!
Most of what Lovable does to earn your trust, you'll never see. Every app has built-in authentication, access controls, encrypted data, security scans, deployment gates, and more. It's why you won't hear us say "vibe coding" much anymore. We're way past vibes now.
5
7
5
37
7,898
Justin T Chen retweeted
Replying to @Lovable
@Lovable is now AIUC-1 certified Certification required the platform to undergo: > Technical testing for risks like insecure code generation & credential leakage > Independent auditing by @Schellman on effective controls across all mandatory AIUC-1 requirements Congrats to @antonosika, @fabianhedin, Igor and the @Lovable team for the commitment to building and deploying secure agents, and earning the AIUC-1 trustmark
Most of what Lovable does to earn your trust, you'll never see. Every app has built-in authentication, access controls, encrypted data, security scans, deployment gates, and more. It's why you won't hear us say "vibe coding" much anymore. We're way past vibes now.
2
5
1
35
5,021
Justin T Chen retweeted
Everything runs on trust.
Most of what Lovable does to earn your trust, you'll never see. Every app has built-in authentication, access controls, encrypted data, security scans, deployment gates, and more. It's why you won't hear us say "vibe coding" much anymore. We're way past vibes now.
15
10
4
170
32,236
Justin T Chen retweeted
As of today, Lovable is certified by AIUC-1 (@aiunderwriting), the leading third-party standard for AI security, safety, and reliability. Earning this certification required stress-testing across risks like insecure code creation and exposed secrets, and we cleared the bar. Learn more: lovable.dev/blog/aiuc-1
4
5
43
3,992
Justin T Chen retweeted
Our new report “Underwriting the AI Agent Economy”, covered in the FT today, contains the blueprint for a full private governance stack to drive AI adoption.
7
15
6
51
5,872
Justin T Chen retweeted
This Thursday, we're digging into Flock, a new SNARK for proving batches of standard hash function and its implications for PQ cryptography. Tune in with authors @benediktbuenz, @ronrothblum, @kleptographic, and guest, @drakefjustin. July 2 | 11am ET 👉 xitter.cf/i/spaces/1OxwbbVapjWJB
12
12
3
109
16,009
Justin T Chen retweeted
Succinct's SP1 is the ultimate security backstop for @newton_xyz. Newton operators attest to whether a transaction follows vault rules, but if one cheats, anyone can prove it onchain with SP1 and slash their stake. Optimistic systems trust by default. SP1 proves the exception.
Newton Mainnet Beta is live! 🎉 VaultKit, the SDK that makes your vault’s rules actually enforceable onchain. Newton checks the rules before any transaction settles, then writes a signed attestation anyone can verify.
13
7
74
14,009
Justin T Chen retweeted
10,063
23,724
1,441
187,173
20,821,438
Justin T Chen retweeted
Succinct is bringing ZK to @Arbitrum, cutting the asset withdrawal window from 7 days to just minutes using ZK proofs. With Arbitrum, Succinct's addressable Total Value Secured will reach $21B alongside Base, Optimism, Polygon, and other L2s.
Financial systems set a high bar. The programmable economy needs infra that can meet it. Here's what we're building for businesses: - Predicable unit economies - Compliance engine - Configurable confidentiality - Faster settlement times - Priority gas auctions And more 👇
12
5
3
70
6,356
Justin T Chen retweeted
Succinct is the default ZK prover for Base, OP Stack chains, and soon, Arbitrum. Once all major rollups transition to ZK, Succinct will prove 90% of all rollup capital. The Ethereum ecosystem is consolidating around ZK and Succinct.
15
10
103
5,199