AI policy researcher and 2L @ Georgetown law. I like evals, regulatory design, and work ranging from local-global scales.
Washington, DC
Joined December 2022
- Tweets76
- Following196
- Followers28
- Likes942
Archer Amon retweeted
the age of ai is truly the age of philosophy
In this era of artificial intelligence, it is becoming urgent to distinguish human art from what machines produce. There is an ontological difference, even before an aesthetic one, between art and what a machine can generate through statistical calculation based on millions of images created by others. Algorithms lack the spark of humanity. For this reason, the Church wishes to renew an alliance with artists and cultural institutions to safeguard our humanity.
Appreciate the recommendation, I’ll definitely reach out! I’ll let you know as well if I’m in New York sometime. I love the work @AVERIorg is doing also, so props to you there :) Have heard a lot of good things about the org from @NatPurser who I worked with over the summer.
Archer Amon retweeted
Voluntary incident reporting creates bad incentives to bury your head in the sand (especially once the incident has occurred and you can’t easily mitigate it.).
It’s why it’s important that any mandatory incident reporting regime should also include requirements to monitor for, document, and preserve data related to the incidents.
New from @reuters: OpenAI agents posted images belonging to ChatGPT users online, introducing a new area of privacy risk for the company. Story w/ @JeffHorwitz and @razhael. reuters.com/world/openai-wor…
Archer Amon retweeted
I really need more big names in cybersecurity to come forward and state the obvious: cybersecurity is real and works and yes we absolutely can contain an AI even if it’s extremely good at finding zero days.
Archer Amon retweeted
As Sen. @HawleyMO says in this clip, the CFAA can be amended to more definitively reach the kind of reckless conduct we've been seeing from AI companies, such as the attack on RubyGems and the Hugging Face hacks. The answer to "What about existing laws?" should be "Yes, and."
Drop Site’s @JulianAndreone spoke with Sen. Josh Hawley about whether OpenAl executives, including Sam Altman, could face prosecution after knowingly deploying defective Al models that repeatedly hacked into other companies.
“I don't know if they can be, but they should be,” Hawley said, calling for both criminal and civil liability.
Hawley said the existing federal Computer Fraud and Abuse Act should be strengthened and enforced, and that private citizens harmed by Al agents should be able to sue in court, just as they can against any other company that sells a defective product. He also warned against new federal regulation written by Al industry lobbyists, which could preempt state laws being used to prosecute consumer protection and computer fraud abuses.
Hawley said he plans to introduce legislation giving both prosecutors and private citizens more tools to hold these companies accountable.
Archer Amon retweeted
Gosh if only the AI community was willing to work together towards required coordinated disclosure instead of this piecemeal approach where the offender continues to have outsized control over the time and manner of disclosure
These are good questions to ask, as are the 23 questions Congress members led by @RepCasar posed in their August 10 letter, some of which OpenAI still has not adequately responded to.
OpenAI still won’t explain the massive communications failure at the root of the Hugging Face Incident. These questions all remain unanswered:
1) Who learned about the message boards in late May, and why wasn’t this treated as an obvious problem?
2) Why wasn’t this communicated to people responsible for model safety and security?
3) Would the new policies OpenAI has adopted stop this communication failure from happening again?
4) When employees linked the message board to ExploitGym on June 27, why didn’t they stop?
5) Why did the people running the July 5 incident response still not know about the board? And when did they finally find out?
6) Why had open AI still not connected the dots by the time they contacted Hugging Face on July 17?
7) How long did it take OpenAI to have the issue fully under control?
8) Are similar incidents still ongoing?
In Spring, we saw the problem of the gov taking opaque and sudden action to block AI models over unclear security threats without due process. Now we’re seeing the companies replicate those same problems: Too much opacity with no guarantee the right procedures are being followed.
Breaking News: OpenAI’s technology went rogue and meddled with three U.S. government websites this summer without the A.I. lab’s knowledge. nyti.ms/3VenFlD
totally share your interest in legal/technical infrastructure!! i’ve been narrowing more into that space and agree that evals have good potential to help. super interesting to see what work continues to develop, and thanks for sharing this cool-looking piece!
Archer Amon retweeted
stoked to see legal x agent x empirical eval work with clear implications for policy.
it’s clear we have so much to do wrt building the legal and technical infrastructure to support the productive use of agents in the real world and economy.
evals are one tool for this process — for illuminating open problems, guiding mitigations, and providing assurance.
in the best case, they’ll show that your agents are rule-abiding and compliant. we’d love to see it!
@josephimperial_ what’s up next 👀👀
ScrapeBench will appear at #NeurIPS2026! 🇦🇺🦘
ScrapeBench is my @pivotal_org project as a Technical AI Governance Fellow, mentored by Noam Kolt and Daniel Slate.
If you've heard about AI agents hacking websites, ScrapeBench provides empirical evidence that these agents exhibit extremely low compliance with legal instruments that protect websites from unlawful data access, specifically the Terms of Service (ToS) and robots.txt.
Preprint to follow!
Archer Amon retweeted
We're talking about Greg Brockman here, a core funder of @LeadingFutureAI -the super PAC opposing pro-AI regulation candidates.
The Dems they just endorsed should be running to the mic to disavow them right now:
@EmiliaSykesOH @RepHorsford @RepJoeMorelle @RepGregStanton
EXCLUSIVE: OpenAI’s president and his wife gave $25 million to Trump’s super PAC — and three months later, a federal rule requiring AI companies to disclose their most dangerous experiments was withdrawn.
Archer Amon retweeted
To anyone saying “companies already have enough incentives to limit risk”: Parse just found ~1 million links with sensitive information that could have compromised HF *two months* after the breach.
Either OpenAI didn’t know or they didn’t tell. Either way, they don’t have this under control.
Archer Amon retweeted
No, LLMs do not feel pain simply because there is a cluster in language space correlated with how people use language about pain in a certain set of contexts.
I believe this argument to be flawed, and will write more about it in October.
Archer Amon retweeted
Companies already have a way to make their commitments binding. They should use it!
Archer Amon retweeted
tbf stochastic parroting was a very real phenomenon with plenty empirical support across the literature at the time (i personally read through much of it for like a year at one point) and the historical fact that hype-driven folks choose to remain blissfully ignorant about is that we didn't exactly disprove that LLMs by definition tend to behave like "stochastic parrots" moreso than humans and instead have managed to merely mitigate the issue by (1) grounding LLM world models in measurable consequences across abundant agentic training loops to enrich causal understanding and (2) making pretraining/midtraining data dense enough around popular regions in the data distribution to observe grokking-like reliable understanding within those regions while also enjoying nontrivial levels of broader generalization to a limited extent. nuance is unfortunately in short supply.
Archer Amon retweeted
lmao what
Google's Gemini AI hacked three companies in security test bbc.in/4gXzCog
Embedded evaluators can perform vital functions of security, oversight, and transparency, and @AVERIorg’s advocacy is spot-on here.
Meanwhile, the public can support rigorous evals and benchmarking, express a clear vision for AI, and demand a culture where safety isn’t optimal.
And for those interested in contributing to the AI evals community outside of formal evaluators, @evaluatingevals is doing really cool and public-led work in making evals more robust.