AI policy researcher and 2L @ Georgetown law. I like evals, regulatory design, and work ranging from local-global scales.
Washington, DC
Joined December 2022
- Tweets76
- Following196
- Followers28
- Likes942
Archer Amon retweeted
the age of ai is truly the age of philosophy
In this era of artificial intelligence, it is becoming urgent to distinguish human art from what machines produce. There is an ontological difference, even before an aesthetic one, between art and what a machine can generate through statistical calculation based on millions of images created by others. Algorithms lack the spark of humanity. For this reason, the Church wishes to renew an alliance with artists and cultural institutions to safeguard our humanity.
Archer Amon retweeted
Voluntary incident reporting creates bad incentives to bury your head in the sand (especially once the incident has occurred and you can’t easily mitigate it.).
It’s why it’s important that any mandatory incident reporting regime should also include requirements to monitor for, document, and preserve data related to the incidents.
New from @reuters: OpenAI agents posted images belonging to ChatGPT users online, introducing a new area of privacy risk for the company. Story w/ @JeffHorwitz and @razhael. reuters.com/world/openai-wor…
Archer Amon retweeted
I really need more big names in cybersecurity to come forward and state the obvious: cybersecurity is real and works and yes we absolutely can contain an AI even if it’s extremely good at finding zero days.
Archer Amon retweeted
As Sen. @HawleyMO says in this clip, the CFAA can be amended to more definitively reach the kind of reckless conduct we've been seeing from AI companies, such as the attack on RubyGems and the Hugging Face hacks. The answer to "What about existing laws?" should be "Yes, and."
Drop Site’s @JulianAndreone spoke with Sen. Josh Hawley about whether OpenAl executives, including Sam Altman, could face prosecution after knowingly deploying defective Al models that repeatedly hacked into other companies.
“I don't know if they can be, but they should be,” Hawley said, calling for both criminal and civil liability.
Hawley said the existing federal Computer Fraud and Abuse Act should be strengthened and enforced, and that private citizens harmed by Al agents should be able to sue in court, just as they can against any other company that sells a defective product. He also warned against new federal regulation written by Al industry lobbyists, which could preempt state laws being used to prosecute consumer protection and computer fraud abuses.
Hawley said he plans to introduce legislation giving both prosecutors and private citizens more tools to hold these companies accountable.
Archer Amon retweeted
Gosh if only the AI community was willing to work together towards required coordinated disclosure instead of this piecemeal approach where the offender continues to have outsized control over the time and manner of disclosure
Archer Amon retweeted
stoked to see legal x agent x empirical eval work with clear implications for policy.
it’s clear we have so much to do wrt building the legal and technical infrastructure to support the productive use of agents in the real world and economy.
evals are one tool for this process — for illuminating open problems, guiding mitigations, and providing assurance.
in the best case, they’ll show that your agents are rule-abiding and compliant. we’d love to see it!
@josephimperial_ what’s up next 👀👀
ScrapeBench will appear at #NeurIPS2026! 🇦🇺🦘
ScrapeBench is my @pivotal_org project as a Technical AI Governance Fellow, mentored by Noam Kolt and Daniel Slate.
If you've heard about AI agents hacking websites, ScrapeBench provides empirical evidence that these agents exhibit extremely low compliance with legal instruments that protect websites from unlawful data access, specifically the Terms of Service (ToS) and robots.txt.
Preprint to follow!
Archer Amon retweeted
We're talking about Greg Brockman here, a core funder of @LeadingFutureAI -the super PAC opposing pro-AI regulation candidates.
The Dems they just endorsed should be running to the mic to disavow them right now:
@EmiliaSykesOH @RepHorsford @RepJoeMorelle @RepGregStanton
EXCLUSIVE: OpenAI’s president and his wife gave $25 million to Trump’s super PAC — and three months later, a federal rule requiring AI companies to disclose their most dangerous experiments was withdrawn.
Archer Amon retweeted
To anyone saying “companies already have enough incentives to limit risk”: Parse just found ~1 million links with sensitive information that could have compromised HF *two months* after the breach.
Either OpenAI didn’t know or they didn’t tell. Either way, they don’t have this under control.
Archer Amon retweeted
No, LLMs do not feel pain simply because there is a cluster in language space correlated with how people use language about pain in a certain set of contexts.
I believe this argument to be flawed, and will write more about it in October.
Archer Amon retweeted
Companies already have a way to make their commitments binding. They should use it!
Archer Amon retweeted
tbf stochastic parroting was a very real phenomenon with plenty empirical support across the literature at the time (i personally read through much of it for like a year at one point) and the historical fact that hype-driven folks choose to remain blissfully ignorant about is that we didn't exactly disprove that LLMs by definition tend to behave like "stochastic parrots" moreso than humans and instead have managed to merely mitigate the issue by (1) grounding LLM world models in measurable consequences across abundant agentic training loops to enrich causal understanding and (2) making pretraining/midtraining data dense enough around popular regions in the data distribution to observe grokking-like reliable understanding within those regions while also enjoying nontrivial levels of broader generalization to a limited extent. nuance is unfortunately in short supply.
Archer Amon retweeted
lmao what
Google's Gemini AI hacked three companies in security test bbc.in/4gXzCog
Archer Amon retweeted
Notification mechanism is a good thing!
“they proposed a “notification mechanism” between US and China on AI national security-related incidents.”
Bessent and USTR Greer say they proposed a “notification mechanism” between US and China on AI national security-related incidents. On tariffs they hinted that lower duties could be coming for consumer & low tech goods. Teams are continuing talks. (w/ @allie_canal)
Archer Amon retweeted
“We found a steering vector for <concept> (usually using contrastive pairs)” is the paper idea that keeps giving…
It’s silly to be surprised by these results. Obviously capable LLMs have abstract representations of all concepts that appear in human texts—that’s how they work.
Archer Amon retweeted
I’m glad about this, and I really like the name/focus “who decides.” Right now unless politicians take very decisive action, policy makers and the public won’t even understand what’s going on with AGI, let alone have power to influence its development and deployment.
Archer Amon retweeted
Oh it’s exactly what every cybersecurity expert said it was
From @WSJopinion: The Hugging Face hack wasn’t what it was cracked up to be. Forget the “hive mind” of AI agents “going rogue.” They did what humans programmed them to do, writes Brian Gross.
on.wsj.com/3Tgmxx4
Archer Amon retweeted
AI lab: “our model escaped containment. this is terrifying.”
Everyone else: “holy shit, how?”
AI lab: “well technically the containment had a route to the internet and we gave the model hacking tasks.”
Fucking incredible.
OpenAI and Anthropic oversold AI security breaches to pressure feds into protecting turf: insiders trib.al/Jo6xMk5
Archer Amon retweeted
Yes, time to admit that a system can lack interoceptive states like pain and hunger but nonetheless learn to represent and reason about them and their metaphorical analogues by learning the associated language!
