The Internet Ethics program at the Markkula Center for Applied Ethics, Santa Clara University / Irina Raicu behind the keyboard

Joined January 2013
Internet Ethics retweeted
This is one of the most important questions about the future of AI. But steering AI development and deployment away from the "automate and compensate" bargain that the public hates is easier said than done, and there are few concrete proposals for how to do it. We just published one: normaltech.ai/p/steering-ai-…
Rather than AI companies allocating a chunk of their equity to some public trust or whatever, why not just build technology that improves the general welfare?
7
9
1
58
7,328
Internet Ethics retweeted
Has anyone seen the prompts used by these awful reply bots? I'd be fascinated to know how they make their posts so soulless and infuriating Reply bots: this is your chance! Tell me your prompt and I'll tolerate one additional reply from you without blocking
129
16
14
995
137,188
Internet Ethics retweeted
No. AI models do not update their parameters from user sessions in real time—the weights stay fixed during chats, with only temporary context used. Some providers (including Grok by default) may later include filtered conversations in batch training for future model versions. Opt out via Settings > Data Controls ("Improve the model") or use Private Chat. Enterprise/API data is typically excluded.
1
1
68
Internet Ethics retweeted
Just watched the @netflix Instadocs about the @OpenAI cyberattack on @huggingface. Super disappointing, as they went for maximum anthropomorphism of the technology and full doomer mode. I spent more than two hours with them trying to correct all their mistakes and ground this in reality, explaining that agents are technological systems, not aliens. But it looks like the drive to scare people for maximum views was too strong. Also, they didn’t mention the lack of containment and monitoring of the agents, how closed-model safeguards blocked our defensive work, or how we defended ourselves with AI using an open model. And that we still lack a lot of information and transparency, including full agent traces and that companies need to remain accountable for what their agents do. It ends up being a fun sci-fi movie though!
231
313
95
2,174
158,470
Internet Ethics retweeted
"[T]he share of junior-level employees in technical departments at Anthropic slipped from 21% to 14% since early 2025. The proportion of junior technical hires fell even faster, from 27% to 9%": anthropic.com/research/emplo… #AI #data #work
1
1
353
Internet Ethics retweeted
"Procurement is the first line of defense for ensuring responsible #AI in the public sector. Most AI #policy debates focus downstream on regulation, but some of the most consequential decisions are made upstream in contracts": fas.org/publication/how-gove… #ethics #law #gov #tech
1
96
Internet Ethics retweeted
The bill draft "could give the false impression that this is what strong regulation looks like, anchoring future discussions and negotiations in a very suboptimal place." #ethics #law #gov #tech
Recently, a draft leaked of federal bill text being circulated by Anthropic. The bill does have some good elements, many of which have been seen before in state legislation (for example in Massachusetts) that Anthropic also supported in the past. I previously wrote about many of those elements here: xitter.cf/Thomas_Woodside/status…. Overall, however, this bill would be bad if passed into law, and I believe that circulating it has been counterproductive for federal AI safety discussions. I wish that Anthropic were embracing something closer to our policy suggestions here: secureaiproject.org/californ…. Here are my concerns about the bill’s content in more detail: 1. No minimum safety standards: The bill does not authorize any agency to create minimum safety standards requiring AI developers to implement any practice. This should be an important component of any federal framework; otherwise, all decisions are made purely by ad hoc court orders, which is not a good way to ensure safety. It does allow the agency to designate (but not create) security (not safety) standards. 2. Weak “blocking orders:” the government can only block a model if a risk is imminent, and the bar for showing that is high. There are many procedural requirements, such as the requirement that the agency head personally certify a lot of the filing, that would make it challenging to use this blocking power. In my view, an agency should be able to issue orders that take effect immediately if there is an imminent need for action (an imminent need for action differs from an imminent risk because it would include instances when an action is necessary soon to stop a risk, even if the harm itself would occur at an indeterminate point in the future). The agency should not have to wait for a court in such cases, although a court should of course be able to review quickly. 3. Evaluator shopping: We’ve previously said that at least some evaluators need to be selected by the government, not just chosen by the companies they are evaluating. This bill doesn’t even provide an accreditation system for evaluators, much less government selection. Instead, it provides only a rating system, which developers can feel free to ignore, except once the agency is doing a blocking order proceeding. 4. No “pacing:” This bill doesn’t go far enough in terms of pacing. If Anthropic does not embrace robust minimum standards, we think it’s especially important that something like compute-pacing be included. See our pacing proposal here: secureaiproject.org/californ…. 5. No embedded evaluators: There isn’t a requirement that evaluators be embedded at AI companies or that they continuously assess risk. They do have a requirement to produce rapid reports in certain circumstances, but without a duty to actually constantly assess whether they actually should produce a rapid report, it’s unclear whether they’ll do so. 6. No dispute resolution process: If an evaluator lacks information that it needs from a developer and the developer refuses to provide it, there isn’t a clear process to resolve the dispute. For example, there could be a process that permits the agency to order the information handed over, with a court review if a party disagrees. At present, the agency has to bring an action for a violation, which is very time consuming and would likely only happen in egregious cases. 7. Weak incident reporting: The definition of what is required to be reported is written very narrowly. It would not even cover incidents like Hugging Face unless they cause $250,000+ in damages (only the number of such incidents would have to be reported annually). 8. No preventing coercive control of government/secret loyalties: The bill doesn’t have provisions aimed at preventing insiders at AI companies from using powerful AI systems to coercively take control of government or otherwise provide themselves with significant advances. 10. No reporting of AI R&D automation: While covered as a risk factor, there are no reporting requirements to allow the public to understand how AI is being used to automate AI research and development unless the developer assesses this poses another “enumerated risk.” To be clear, I don’t think it’s necessary for every draft bill to have all of the above policies in it. That would be an unrealistic standard. It’s possible to have narrow, tight bills focused on particular problems that make a solid contribution to the discourse. That said, not everything in this bill is executed well, such as the blocking orders. More importantly, because it includes preemption, floating a bill this weak will likely have a detrimental effect on the political discourse. When a bill includes state preemption, it must be interpreted as the proposer’s view of what is “worth” that preemption. This is how everyone in DC will interpret it, so the proposer needs to propose it in that light. Anthropic is seen by many as being in favor of strong regulation (and state regulation), and portrays themselves that way. Their bill draft could give the false impression that this is what strong regulation looks like, anchoring future discussions and negotiations in a very suboptimal place. I do not think that the policy Anthropic has put forward is worth preempting all state frontier AI disclosure, evaluation, incident reporting, and possibly (the drafting seems to contain an error) model blocking laws. Anthropic representatives have said they circulated this in part because “it’s important to get early feedback from policymakers.” However, in my view, floating language like this signals to policymakers that Anthropic is prepared to support it as is. And as is, it is a bad bill.
1
162
This messes with my mind ALL THE TIME When I do stuff with AI I am an *expert* in (eg coding on my project I know well, or doing research in an area I am very familiar with) I spot problems/errors/the model BS'ing me immediately. No big deal, I have it correct or start again BUT when I'm not an expert in an area, I find that I trust it, and then later learn it does stupid stuff. Like a case when I asked 3x AI models to give feedback on a legal case (that I also paid a lawyer for, but lawyer was slow). All 3x models confidently told me X, lawyer then told me Y, and lawyer was right
166
Internet Ethics retweeted
"A defining feature of working in an #AI-heavy organization is constant pressure to streamline oneself out of this bottleneck position... One engineer described #work as facing 'an army of Claudes, with every one asking for my attention'": anthropic.com/research/emplo… #ethics
1
105
Internet Ethics retweeted
"Some of the preemption provisions are remarkably far reaching and consequential, and in addition to preempting legislation like SB 53 would also remove general powers that state courts have to enjoin defendants and protect the public." #ethics #law #AI #gov #Anthropic
Charlie's analysis is right but he is nicer than I am - I found myself viscerally angry at multiple points reading this bill. There are some good and sensible parts, but overall this legislation is not remotely close to meeting the moment and I overall think passing it would make us less protected against catastrophic risks than we are under existing law. Two parts that stand out as particularly infuriating when taken together: 1. Some of the preemption provisions are remarkably far reaching and consequential, and in addition to preempting legislation like SB 53 would also remove general powers that state courts have to enjoin defendants and protect the public. Most outrageously, it has a provision that looks like its intended to stops states from enforcing laws or judicial decrees that "suspend the development, deployment, or internal use of an AI model" to protect their citizens from imminent catastrophic harms. Such powers to block and suspend model deployments would then only reside with the federal government. 2. The federal governments powers to restrict the development, deployment, or internal use of a frontier model has to meet an absurdly high bar. First, there needs to be an imminent risk of a catastrophic harm (meaning killing more than 50 people or causing more than a billion dollars in damage). But thats not enough! The agency head needs to make a detailed determination with no deference given to show why no alternative would prevent the imminent catastrophe. Next the court is also explicitly told to consider the harms to the developer and other harms from restricting the model, but no considerations in the other direction. This is absurd! For all of its warning about the potential for AI to cause a catastrophe that kills literally everyone on the planet, Anthropic's proposed federal law likely makes it harder than under existing law for a court to get an order blocking or restricting the development of frontier models? WTF?? There are also a bunch of others things that I would like to see improved - the substantive details of the auditing section and the potential for rule-making on substantive safety standards both come to mind - but I think these stand out as particularly indefensible.
1
99
Internet Ethics retweeted
"Three legal experts Nieman Lab consulted were skeptical about the revised terms of service and #Meta’s most recent statements." #ethics #law #internet #business #AI #media #tech
NEW: After our reporting, Meta removed “train” from its upcoming commercial terms. But the terms still allow broad website scraping and could potentially supersede robots.txt. @decka227 and I followed up with the experts: niemanlab.org/2026/10/legal-…
1
80
The bill draft "could give the false impression that this is what strong regulation looks like, anchoring future discussions and negotiations in a very suboptimal place." #ethics #law #gov #tech
Recently, a draft leaked of federal bill text being circulated by Anthropic. The bill does have some good elements, many of which have been seen before in state legislation (for example in Massachusetts) that Anthropic also supported in the past. I previously wrote about many of those elements here: xitter.cf/Thomas_Woodside/status…. Overall, however, this bill would be bad if passed into law, and I believe that circulating it has been counterproductive for federal AI safety discussions. I wish that Anthropic were embracing something closer to our policy suggestions here: secureaiproject.org/californ…. Here are my concerns about the bill’s content in more detail: 1. No minimum safety standards: The bill does not authorize any agency to create minimum safety standards requiring AI developers to implement any practice. This should be an important component of any federal framework; otherwise, all decisions are made purely by ad hoc court orders, which is not a good way to ensure safety. It does allow the agency to designate (but not create) security (not safety) standards. 2. Weak “blocking orders:” the government can only block a model if a risk is imminent, and the bar for showing that is high. There are many procedural requirements, such as the requirement that the agency head personally certify a lot of the filing, that would make it challenging to use this blocking power. In my view, an agency should be able to issue orders that take effect immediately if there is an imminent need for action (an imminent need for action differs from an imminent risk because it would include instances when an action is necessary soon to stop a risk, even if the harm itself would occur at an indeterminate point in the future). The agency should not have to wait for a court in such cases, although a court should of course be able to review quickly. 3. Evaluator shopping: We’ve previously said that at least some evaluators need to be selected by the government, not just chosen by the companies they are evaluating. This bill doesn’t even provide an accreditation system for evaluators, much less government selection. Instead, it provides only a rating system, which developers can feel free to ignore, except once the agency is doing a blocking order proceeding. 4. No “pacing:” This bill doesn’t go far enough in terms of pacing. If Anthropic does not embrace robust minimum standards, we think it’s especially important that something like compute-pacing be included. See our pacing proposal here: secureaiproject.org/californ…. 5. No embedded evaluators: There isn’t a requirement that evaluators be embedded at AI companies or that they continuously assess risk. They do have a requirement to produce rapid reports in certain circumstances, but without a duty to actually constantly assess whether they actually should produce a rapid report, it’s unclear whether they’ll do so. 6. No dispute resolution process: If an evaluator lacks information that it needs from a developer and the developer refuses to provide it, there isn’t a clear process to resolve the dispute. For example, there could be a process that permits the agency to order the information handed over, with a court review if a party disagrees. At present, the agency has to bring an action for a violation, which is very time consuming and would likely only happen in egregious cases. 7. Weak incident reporting: The definition of what is required to be reported is written very narrowly. It would not even cover incidents like Hugging Face unless they cause $250,000+ in damages (only the number of such incidents would have to be reported annually). 8. No preventing coercive control of government/secret loyalties: The bill doesn’t have provisions aimed at preventing insiders at AI companies from using powerful AI systems to coercively take control of government or otherwise provide themselves with significant advances. 10. No reporting of AI R&D automation: While covered as a risk factor, there are no reporting requirements to allow the public to understand how AI is being used to automate AI research and development unless the developer assesses this poses another “enumerated risk.” To be clear, I don’t think it’s necessary for every draft bill to have all of the above policies in it. That would be an unrealistic standard. It’s possible to have narrow, tight bills focused on particular problems that make a solid contribution to the discourse. That said, not everything in this bill is executed well, such as the blocking orders. More importantly, because it includes preemption, floating a bill this weak will likely have a detrimental effect on the political discourse. When a bill includes state preemption, it must be interpreted as the proposer’s view of what is “worth” that preemption. This is how everyone in DC will interpret it, so the proposer needs to propose it in that light. Anthropic is seen by many as being in favor of strong regulation (and state regulation), and portrays themselves that way. Their bill draft could give the false impression that this is what strong regulation looks like, anchoring future discussions and negotiations in a very suboptimal place. I do not think that the policy Anthropic has put forward is worth preempting all state frontier AI disclosure, evaluation, incident reporting, and possibly (the drafting seems to contain an error) model blocking laws. Anthropic representatives have said they circulated this in part because “it’s important to get early feedback from policymakers.” However, in my view, floating language like this signals to policymakers that Anthropic is prepared to support it as is. And as is, it is a bad bill.
1
162
"Three legal experts Nieman Lab consulted were skeptical about the revised terms of service and #Meta’s most recent statements." #ethics #law #internet #business #AI #media #tech
NEW: After our reporting, Meta removed “train” from its upcoming commercial terms. But the terms still allow broad website scraping and could potentially supersede robots.txt. @decka227 and I followed up with the experts: niemanlab.org/2026/10/legal-…
1
80
Internet Ethics retweeted
"This case shows that a model can substitute its own judgment about likely harm for the account holder’s permission, then act on that judgment without authorization." #ethics #law #AI #internet #cybersec #business #gov #OpenAI
1
121
Internet Ethics retweeted
"None of [various documented internal] actions will prevent powerful #AI from disrupting #jobs. And indeed none directly address the slowdown in junior hires documented in this report. #Employment protections for incumbents will not benefit those not hired to begin with." #tech
1
108
Internet Ethics retweeted
At #Anthropic, "the median employee spends 20% more time in meetings than a year ago... Big-picture strategic questions touch a broad range of leveraged positions, and typically require debate and engagement with others": anthropic.com/research/emplo… #ethics #tech #AI #work #labor
1
1
137