IG 200 retweeted
In the AI discourse, there's this very weird dynamic. People seem to think that enforcing current laws against powerful people is impossible, but also that we need more laws. Why? What's the point of regulation if we can't enforce? This whole thing makes no sense.
IG 200 retweeted
In 1996, without adequate thought, Congress rushed to give a nascent Internet industry broad protection from liability. That law has become known as Section 230 and has protected horrific conduct for decades. Let’s not let history repeat itself.
1) The HuggingFace attack was a felony under the Computer Fraud and Abuse Act. So were Anthropic’s Claude gaining “unauthorized access to the production infrastructure of three different organization(s)”
2) Frontier labs have models that they are unable to stop from committing felonies. They should figure this out.
3) In 12 months open weights models will be released of the same capability. They will commit felonies too. If the model you are using or a model running on your infra commits a felony, you should probably stop using it or running it on your infra.
4) The govt should prosecute organizations that are running models that commit felonies.
5) The govt should not offer safe harbor to organizations that run models that commit felonies, just because those organizations have “embedded evaluators”.
6) The real slippery slope is allowing frontier labs to commit felonies without punishment because “the model did it because we’re accelerating too quickly”
7) Prosecute. Keep prosecuting. This is how you do reinforcement learning on a corporation. Companies that serve products that are unsafe for public use should not serve them. Period.
8) I’m not sure the anti-trust waiver is really necessary. I don’t see why information sharing about how much crime you’re allowed to commit is wise. In regulatory situations you want the corporation to fear MORE than the average case. You don’t want to establish a worst case that can be priced. You want regulatory uncertainty that forces the corporation to err in favor of being over cautious.
—
The above is actually a fairly decelerationist viewpoint.
I think Dario’s call for regulation actually accelerates things.
The AI firms are getting away with things that Meta people would be going to prison for.
Can you imagine what would happen if the New York Times had a front page news article “Meta AI breaks into competitors live systems, attempts to establish dominant position and steals secrets”
There is a reason Meta and Google are running slower, and that’s because as mature organizations they have layers of checks and balances.
I think the frontier labs are better off creating those checks and balances right now, regardless of the pace of what everyone else is doing.
You don’t have to accept the frame that unsafe acceleration must happen.
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: darioamodei.com/post/we-must…
IG 200 retweeted
Let’s say the government said ‘Hey OpenAI and Anthropic, if your systems go out of control again you can’t go public.’ Does anyone doubt the existential risk would disappear quickly?
So what are we really talking about if not the rule of law?
IG 200 retweeted
No one disputes that the OpenAI/HF incident represents a step change in hacking. But no one disputes that there were actual human beings responsible for the OpenAI/HF criminal act.
So is the problem that AI may take over society? Or that Sam Altman can do crimes without any culpability? Disagree on the first question, but it's notable that *no one* in the AI safety space is saying 'hey let's put Sam Altman in jail to discourage misuse of these products.'
IG 200 retweeted
I just shared an update for paid subs on $TWM.TO / $TWMIF
After a strong Q2 report, I believe the upside remains significant. Supply-and demand outlook in their region looks favorable, supporting higher crack spreads for longer. I do see a creditable path to C$100/share, which I laid out in the note:







