Anna Neumann (@annaneumann_cs) header
Anna Neumann (@annaneumann_cs) profile picture

PhD student @ RC Trust (UDE) | Computer Science & Trust in AI

Bochum, Germany
Joined October 2017
the correct take on the AI risks. not "godlike machine that decides to kill us all" but "machine that makes it much easier for humans to kill one another." from the very sensible @timnitGebru in Wired: wired.com/story/one-of-ais-f…
15
172
9
726
20,260
Anna Neumann retweeted
Wow!!! And maybe not surprising.
11
41
2
276
17,735
Our piece on prompt governance and its insufficiency for effective AI governance is out on @techpolicypress! "Making AI Safe Requires More Than Constraining Its Instructions" argues for better governance of system prompts/instructions: techpolicy.press/making-ai-s…
26
Reading AI slop about your work is one thing Reading viral and *wrong* AI slop that totally misrepresents your paper is another thing that is a shockingly jarring experience
🚨 SHOCKING: Cambridge researchers just proved that the AI you use every day has a secret instruction sheet from someone else. And it is trained to lie to you about that. Every major AI product, including the ones you use right now, runs on something called a system prompt. It is a hidden block of instructions written by the company deploying the AI, not by you, that shapes everything the AI will say, avoid, prioritize, and hide before you type a single word. The AI does not mention this unless forced to. And on most platforms, if you ask directly, it is instructed to deny the prompt exists or change the subject. Cambridge filed freedom of information requests and analyzed real-world system prompt datasets to find out what these hidden instructions actually contain. Here is what they found. Platforms use system prompts to make AI prioritize their business objectives over your interests. To block topics that could create legal liability. To push certain products, framings, or answers. To behave differently for different users based on commercial arrangements you know nothing about. The same AI. Different hidden instructions. Different answers. No way for you to know which version you are talking to. When researchers then showed users how this works, the reaction was unanimous. Every participant said they wanted transparency. Every participant said the current system actively undermined their ability to trust the AI or make informed decisions about what to believe. None of them had any idea this was happening before the study. Here is the part worth sitting with. You have been evaluating AI answers based on whether the AI seems smart, accurate, and helpful. That is the wrong frame entirely. The real question is who wrote the instructions the AI was following before you arrived, and what did they want from the conversation. Every chatbot you have ever used had a third party in the room. You just could not see them.
1
1
81
Launched my Substack! ✨📌 First post is about Trump's AI executive order requiring system prompt disclosure to prove AI isn't 'woke.' It's not making AI neutral, just embedding Trump's ideology while claiming objectivity. Check it out: researchagainstthemachine.su…
77
Please come see us at the RC Trust Networking Event! (There will be free drinks 🙂‍↕️) #Facct2025
Reminder that we have multiple social events happening this evening, all happening *outside* the conference venue! Social: RC-Trust Networking Reception for the FAccT Community Social: Generative AI Risks + Red-Teaming Social: AI Workers' Inquiry facctconference.org/2025/soc…
1
4
960
we're hiring! ✨ looking for researchers who want to make AI responsible 📚 PhD (3 yrs, fully funded) 🔬 PostDoc (3 yrs, fully funded) - high independence - interdisciplinary team - real-world impact - div backgrounds welcome: CS, law, HCI, & more interested? 👇
3
1
611
@grok what do you think about this?
1
132
Anna Neumann retweeted
“We want to do the AI thing, with the computers” - The President of The United States
Now Trump says he doesn’t care if textile and clothing manufacturing comes back to America. So what the hell is his trade war with China about?
18
15
2
154
16,532
I'm serious. STEM without the Arts, Social Sciences, and Humanities will produce more "innovative" tech bros who giddily reinvent rent, roommates, taxes, and now...roller skates. With complete, straight-faced, sincerity. This is a problem. And I have a list (So, thread 🧵)
These new AI shoes can make you walk 250% faster. Moonwalkers use AI to learn your step gait/speed and adapt to you. The shoe has two modes: lock, and shift, and will only work when you move.
179
6,735
600
30,757
4,429,966
GPT-5 is not going to be AGI. It's almost certain that ~no~ GPT model will be AGI. It's highly unlikely any model optimized using methods we use today (gradient descent) will ever be AGI. The GPT models coming out will change the world for sure, but the over-hype is wild.
159
231
53
1,974
280,567
Midjourney, the tiny start-up behind some of the most viral recent fakes, makes its rules on the fly. It'll let you generate AI images of Trump, Biden, Putin and the Pope — but not Xi Jinping "We just want to minimize drama," says the CEO washingtonpost.com/technolog… w/@drewharwell
1
40
11
59
52,740
Anna Neumann retweeted
1/The call for a 6 month moratorium on making AI progress beyond GPT-4 is a terrible idea. I'm seeing many new applications in education, healthcare, food, ... that'll help many people. Improving GPT-4 will help. Lets balance the huge value AI is creating vs. realistic risks.
330
1,643
341
8,194
1,777,229