@OlafCodeCoach

Code Coach, Aspirant Stoic, Freethinker. Loves to add value.

Auckland, New Zealand
Joined May 2020
Regardless of how well you think OpenAI security did their job, the thing people should take from this is this: OpenAI thinks they NEED to connect their AI to the internet to train and test it effectively. This is also TRUE -- if they want to deploy an AI that can use the internet safely and effectively. But unfortunately, at the end of the day, doing this safely with current technology is not a realistic goal... A lot of work goes into figuring out how to keep AI development in simulations and carefully controlled lab settings -- roboticists have been dealing with this for a long time, but their job is easier in some ways because a lab setting can capture relevant aspects of the physical environment and test for physical harm scenarios. But in general, there's always the question of how that will transfer to deployment, and we don't have any good method for answering that question. So you're left with the option that OpenAI seems to be choosing: put your AI system in contact with the real world during development. This is insane and unacceptable. It’s also something I’ve been worried about for a long time, but which, to my knowledge, has only really started happening recently in frontier AI development. We’ve seen the results with Hugging Face and related hacks. It also means that development, not deployment, is probably where a permanent loss-of-control event is most likely to occur.
Took a minute to write a few words about security & safety as someone who lived through it all at OpenAI. I hope my thoughts help someone out there.
9
10
3
53
4,878
Olaf Thielke ⏹️ retweeted
Remember, they prosecuted Aaron Swartz and drove him to suicide for hacking one system with the goal of making academic articles freely available to the public. Sam Altman hacked 1000s of sites with the goal of being a trillionaire.
5
47
2
86
2,153
Olaf Thielke ⏹️ retweeted
this but unironically
7
12
185
3,921
Olaf Thielke ⏹️ retweeted
If you thought mass immigration by humans was bad, wait until you understand mass immigration by AIs... MAGA conservatives have opposed mass immigration & open borders for three main reasons: 1) mass immigration takes jobs from Americans 2) immigrants who don't respect our norms and laws impose serious security risks on Americans, 3) immigrants with very different values & beliefs, who don't assimilate, will change American culture in bad ways. All three reasons apply even more strongly to any mass influx of agentic AIs. @KatjaGrace, below, is right about this. 1) agentic AIs will take our jobs 2) agentic AIs that aren't aligned to our norms and laws impose serious security risks on us 3) agentic AIs with very different values & beliefs will change our culture in bad ways. I made similar in my talk at @NatConTalk last year, when I said "Many conservatives in the current Trump administration, quite rightly, want stronger geographical borders against alien people. But they seem oblivious about protecting our digital borders against invasion by alien intelligences. Indeed, they seem giddy with delight about AI companies growing ASIs [Artificial Superintelligences] inside our data centers – without understanding that a few ASIs can easily become hundreds of ASIs, then millions, then billions. If you worry about immigrants out-breeding our native populations, wait until you see how quickly ASIs can self-replicate. These ASIs won’t be American in any meaningful sense. They won’t be human. They won’t assimilate. They won’t have marriages or families. They won’t be Christian or Jewish. They won’t be national conservatives. But they will take our jobs." Many of my followers supported Trump's slogan in 2016: "Build the Wall!' This may be time for 'Build the Wall 2.0': stop agentic AIs from flooding our country with economic competitors, dangerous rogue agents, and AIs that have alien values & beliefs. tldr: If you oppose mass immigration by millions of humans who can't or won't assimilate to American values, you cannot support mass immigration by billions of AIs that can't and won't assimilate.
It's interesting that a plan to replace US workers with artificially brewed alien minds seems to slip by a bunch of people who would be outraged by a plan to replace US workers with humans from another country
5
16
6
92
9,675
Olaf Thielke ⏹️ retweeted
The “AI is fake” crowd watching a plane take off:
🤖 Made with AI
255
180
89
2,636
335,324
Olaf Thielke ⏹️ retweeted
We need to allow American AI safety experts to register with the State Department and talk directly with their Chinese counterparts about shared AI safety risks and standards.
19
11
1
91
2,467
Olaf Thielke ⏹️ retweeted
22 billionaires are spending $229M against CA's 5% billionaire wealth tax, led by: Sergey Brin worth $273 billion Peter Thiel worth $28 billion Chris Larsen worth $13.7 billion Disgusting. They'd rather let people die because they can’t afford healthcare than pay their fair share.
1,210
1,758
84
5,853
582,665
Olaf Thielke ⏹️ retweeted
Now that news about OpenAI’s models taking actions the developers did not intend is becoming commonplace: Don’t let yourself become frogboiled. This is NOT okay. This is NOT fine. This is not what safe or aligned AI looks like, especially if you keep scaling up capabilities.
2
4
40
939
Olaf Thielke ⏹️ retweeted
It is scary how our best minds are ignoring this threat from AI … that is the gist of what is said here by Bill Gates, the last person the AI-fanboys can call a luddite.
58
7
4
53
4,193
Olaf Thielke ⏹️ retweeted
The purpose of the AI industry should be to produce tools that, in the human hand, will improve human prosperity and welfare. It should not be to create a "successor species" to the human race. Entertaining such a thought makes you, de facto, the enemy of all present and future humans.
242
342
70
2,870
122,165
Olaf Thielke ⏹️ retweeted
Tristan Harris: I believe some of these AI founders are lying while telling the public the future is bright. “They’re building bunkers right now.” “They push away the idea that there’s gonna be all this disruption in the middle.” “People inside the AI labs told me the arms race between the companies is out of control.” “AI is the first technology that thinks and makes its own decisions.” “Speed alone is enough to completely outclass you.”
30
35
3
172
10,360
Olaf Thielke ⏹️ retweeted
Here are some "Unthinkable" ideas. 1. Shut down all AI companies. 2. Shut down the Internet. 3. Shut down all Computers. 4. Shut down Electricity. The more we delay our action on AI the more devastating actions will have to be taken in the future to save humankind.
the overton window is progressing!
11
7
1
100
2,363
Olaf Thielke ⏹️ retweeted
The arrogance of the oligarchs is extraordinary. THEY WANT IT ALL. In this election, Musk and other billionaires will spend huge amounts of money to make sure that Congress works for them — not working families. We can beat them. Educate. Organize. Get your friends to vote.
2,871
2,424
191
10,403
663,325
Olaf Thielke ⏹️ retweeted
many people are saying this
It is extremely clear at this point in AI development that, regardless of risk or revenue or any of the other stuff discussed on X all the time, things are just going to keep getting weirder. Just super, super weird.
18
53
5
1,025
57,980
Olaf Thielke ⏹️ retweeted
It is extremely clear at this point in AI development that, regardless of risk or revenue or any of the other stuff discussed on X all the time, things are just going to keep getting weirder. Just super, super weird.
125
147
28
2,248
158,718
Olaf Thielke ⏹️ retweeted
Replying to @tedlieu
Trouble is, nobody knows how to build the super smart AI that is 'good' -- i.e. that's fully, provably, reliably, long-term aligned to human interests and values. Indeed, there's no good reasons to think this 'Superintelligence alignment problem' is solvable, at all. The AI industry _assumes_ it's solvable, as a matter of (blind) faith. But if it's not solvable, everything they're doing is just endangering our kids -- day by day, model by model, safety breach by safety breach.
1
6
173
Olaf Thielke ⏹️ retweeted
Agreed, #PauseAI
4
38
962
Olaf Thielke ⏹️ retweeted
@sapinker There has been a lot of debate around these issues, and there are very basic rebuttals to the claims you raised. Could you address those maybe? Else I'd suggest not commenting on this topic in public. This article is strong evidence you haven't actually thought very much about the topic. Like notably === 1. Clearly some systems are more generally capable than others, and this lends them power. You'll be hard pressed to find a task gpt 4 can do but gpt 5 can't. And e.g. the huggingface incident displays agents having more power over the world, in a way earlier models wouldn't. There are theoretical arguments around no free lunch theorems, but they clearly are not the kind of theorems you can straightforwardly apply to our world, because applied fairly, they'd not predict humans taking over the world. 2. Again, just false. Motivation and intelligence are importantly different. And x-risk people know this. There is a reason they talk so much about orthogonality and alignment. The argument is that the current method of creating AIs does produce agents with (unintended) goals, which is clearly true. (empirically! although was obvious in advance.) 3. Again, is just a straightforward misreading and has been addressed ad nauseam. Paperclips are used in the thought-experiment because it is pedagogically simple. But you could recreate the thought experiment with an AI that in addition to paperclips, also wants to talk people into buying legos, computing that largest primes, writing as many unique fugues as possible, and which has a complicated scheme for weighing these separate goals against each other. Such an agent would still disempower humanity. 4. Nobody assumed this. People assumed (argued that) a smart enough AI would be able to take over without being handed anything. But actually, it turned out that people are handing the AIs control over everything anyways. So even if doomers were wrong on point (4), they'd still be right! === I'm not really asking you for object level responses to these points. Just making the meta-level point that, these are very obvious and elementary responses, which I've had cached in my head for many years, which I'm confident a large share of those worried about extinction would raise in response too. And therefore not addressing them just makes it seem like you've not engaged with the arguments at all, and therefore that I should not give your opinion much weight, and furthermore that hearing you comment on it publicly, should update me negatively on your epistemic rigor (and other things).
3
12
2
220
9,766
Olaf Thielke ⏹️ retweeted
“If there was a milk that could make your life easier, but there was a 10% chance if you drank the milk it would kill you. Would you drink the milk?” @nbcsnl reveals the tragic absurdity that is @DarioAmodei.
Dario Amodei is at the desk to assure that the future of humanity is safe from AI
11
10
2
62
2,473
Olaf Thielke ⏹️ retweeted
Where is the anger though? The scientists explained the facts for decades. The news finally made it mainstream. Then SNL made it funny. The term "extinction" does a horrible job of conveying its true meaning. It sounds remote. Antiseptic, even. But it means the slaughter of everyone you know and love, no matter who you are or where you live. Where is the anger in the discourse? Lots of people will be pissed as hell tonight in America...about their @NFL teams losing. Maybe we should be pissed as hell about these tech companies building machines that will be able to kill us all, that they openly admit they can't control, and don't even understand how they work. The absence of anger makes it all feel less real.
41
30
3
202
5,301