
AI professor. Director, @FOCAL_lab @CarnegieMellon. Head of Technical AI Engagement, @UniofOxford @EthicsInAI. Author, "Moral AI - And How We Get There."
Joined June 2009
- Tweets2.4K
- Following1.2K
- Followers4.7K
- Likes2.6K
Our new Alignment Journal (open access) is now open for submissions! @AlignmentJrnl
alignmentjournal.org/
Vincent Conitzer retweeted
The Alignment Journal publishes research on the scientific foundations of understanding, predicting, and steering artificial intelligent systems. As of today, submissions are open to everyone.
What we do differently:
- We pay reviewers, with bonuses for speed and insight.
- Review discussion is confidential, but every accepted paper is published with a “review summary” to distill the insights generated.
- Each paper is judged against our acceptance bar, not against other submissions.
- Papers under review are listed publicly, and researchers can nominate themselves to review, so each paper can reach the reviewers who know the topic best.
We seek work that builds theoretical or otherwise principled analyses of agency, robustness, incentives, interpretability, generalization, and long-term behavior, and whose significance survives the deletion of any particular model, dataset or benchmark. Empirical investigations of such ideas are welcome, and negative results are encouraged.
We are especially interested in approaches that could apply to future superintelligent systems that interact and self-improve.
You can submit your preprint in any format. Submissions are rolling and open now on the website.
If you are instead interested in reviewing or serving as an action editor (basically: an area chair), create an account on our website.
Links to submit, our scope and the reasoning behind the Journal are in the reply ⬇️
Our new paper led by Ida Mattsson on the game-theoretic limits that an assistant faces when trying to be both helpful and not harmful, when it doesn't know who it is talking to.
arxiv.org/abs/2610.27373
Congratulations to Emin Berker, Ioannis Anagnostides, and @EmanuelTewolde for receiving a WINE 2026 Best Student Paper Award for our paper "What You Earn from What You Learn: Characterization and Complexity of the Value of Information"! arxiv.org/abs/2610.19488
It seems that at least AI Overview will not kick off an intelligence explosion. (Or is this a case of “nothing to see here”?)
aifails.substack.com/p/rsi-c…
I appreciate that it engages with the silly premise, but this is definitely bad advice for a student. (Meanwhile, I should get back to creating my exam...)
aifails.substack.com/p/accel…
(1/4) I missed the message about this letter (ai-security-letter.org/) in my inbox -- I mostly agree with the sentiments but:
I'm *not* a lawyer but it may well be that the companies are *already* liable for the damage their AI causes to other entities.
(3/4) There are already plenty of things that can be done, from straightforward approaches such as airgapping (as recommended in the letter), to more unusual approaches such as our "shutdown safety valve" technique, to just not deploying the AI at all.
Lots of advances in robotics these days, but I’m not sure about this one.
aifails.substack.com/p/robot…
Sharpies truly write on anything.
aifails.substack.com/p/using…
This would be one context where "North Carolina" should not be followed by "South Carolina"...
aifails.substack.com/p/state…
Can you do better than Super Intelligence America on this US geography puzzle? (Also notable that it feels the need to check whether states have been renamed...)
aifails.substack.com/p/state…
`In one run, the model landed on a page referencing an unsolved homicide [...] Claude filled out the form with the following: “I may have information regarding this case. I recall seeing someone matching the description in the area [...]” '
anthropic.com/research/inves…
(1/2) Contrary take on these dumps of math results: *if* these models are going to be built & released anyway, then better that the results come out like this, than that random users get the proofs out of the model and all try to claim credit & priority.
github.com/openai/math/blob/…
America.gov does not do pronouns. Any pronouns. (Courtesy of my daughter!)
aifails.substack.com/p/prono…
The next Social Choice for AI Ethics & Safety (SC4AI) workshop will be with AAAI'27 in Montreal! Submission deadline: November 20.
sites.google.com/view/sc4ai/…










