@OlafCodeCoachi
iAccount based inNew Zealand
About this account
- Account based in
- New Zealand
- Connected via
- New Zealand Android App
Account-level information from X, not a live location or the device used for a specific post.
Code Coach, Aspirant Stoic, Freethinker. Loves to add value.
Auckland, New Zealand
Joined May 2020
- Tweets2.3K
- Following121
- Followers94
- Likes5.7K
Olaf Thielke ⏹️ retweeted
Regardless of how well you think OpenAI security did their job, the thing people should take from this is this:
OpenAI thinks they NEED to connect their AI to the internet to train and test it effectively. This is also TRUE -- if they want to deploy an AI that can use the internet safely and effectively. But unfortunately, at the end of the day, doing this safely with current technology is not a realistic goal...
A lot of work goes into figuring out how to keep AI development in simulations and carefully controlled lab settings -- roboticists have been dealing with this for a long time, but their job is easier in some ways because a lab setting can capture relevant aspects of the physical environment and test for physical harm scenarios. But in general, there's always the question of how that will transfer to deployment, and we don't have any good method for answering that question.
So you're left with the option that OpenAI seems to be choosing: put your AI system in contact with the real world during development.
This is insane and unacceptable. It’s also something I’ve been worried about for a long time, but which, to my knowledge, has only really started happening recently in frontier AI development. We’ve seen the results with Hugging Face and related hacks.
It also means that development, not deployment, is probably where a permanent loss-of-control event is most likely to occur.
Olaf Thielke ⏹️ retweeted
Remember, they prosecuted Aaron Swartz and drove him to suicide for hacking one system with the goal of making academic articles freely available to the public. Sam Altman hacked 1000s of sites with the goal of being a trillionaire.
Olaf Thielke ⏹️ retweeted
If you thought mass immigration by humans was bad, wait until you understand mass immigration by AIs...
MAGA conservatives have opposed mass immigration & open borders for three main reasons:
1) mass immigration takes jobs from Americans
2) immigrants who don't respect our norms and laws impose serious security risks on Americans,
3) immigrants with very different values & beliefs, who don't assimilate, will change American culture in bad ways.
All three reasons apply even more strongly to any mass influx of agentic AIs. @KatjaGrace, below, is right about this.
1) agentic AIs will take our jobs
2) agentic AIs that aren't aligned to our norms and laws impose serious security risks on us
3) agentic AIs with very different values & beliefs will change our culture in bad ways.
I made similar in my talk at @NatConTalk last year, when I said
"Many conservatives in the current Trump administration, quite rightly, want stronger geographical borders against alien people. But they seem oblivious about protecting our digital borders against invasion by alien intelligences. Indeed, they seem giddy with delight about AI companies growing ASIs [Artificial Superintelligences] inside our data centers – without understanding that a few ASIs can easily become hundreds of ASIs, then millions, then billions. If you worry about immigrants out-breeding our native populations, wait until you see how quickly ASIs can self-replicate. These ASIs won’t be American in any meaningful sense. They won’t be human. They won’t assimilate. They won’t have marriages or families. They won’t be Christian or Jewish. They won’t be national conservatives. But they will take our jobs."
Many of my followers supported Trump's slogan in 2016: "Build the Wall!'
This may be time for 'Build the Wall 2.0': stop agentic AIs from flooding our country with economic competitors, dangerous rogue agents, and AIs that have alien values & beliefs.
tldr: If you oppose mass immigration by millions of humans who can't or won't assimilate to American values, you cannot support mass immigration by billions of AIs that can't and won't assimilate.
Olaf Thielke ⏹️ retweeted
We need to allow American AI safety experts to register with the State Department and talk directly with their Chinese counterparts about shared AI safety risks and standards.
Olaf Thielke ⏹️ retweeted
Olaf Thielke ⏹️ retweeted
Now that news about OpenAI’s models taking actions the developers did not intend is becoming commonplace:
Don’t let yourself become frogboiled.
This is NOT okay. This is NOT fine. This is not what safe or aligned AI looks like, especially if you keep scaling up capabilities.
Breaking News: OpenAI’s technology went rogue and meddled with three U.S. government websites this summer without the A.I. lab’s knowledge. nyti.ms/3VenFlD
Olaf Thielke ⏹️ retweeted
It is scary how our best minds are ignoring this threat from AI … that is the gist of what is said here by Bill Gates, the last person the AI-fanboys can call a luddite.
Olaf Thielke ⏹️ retweeted
The purpose of the AI industry should be to produce tools that, in the human hand, will improve human prosperity and welfare.
It should not be to create a "successor species" to the human race. Entertaining such a thought makes you, de facto, the enemy of all present and future humans.
Olaf Thielke ⏹️ retweeted
Tristan Harris: I believe some of these AI founders are lying while telling the public the future is bright.
“They’re building bunkers right now.”
“They push away the idea that there’s gonna be all this disruption in the middle.”
“People inside the AI labs told me the arms race between the companies is out of control.”
“AI is the first technology that thinks and makes its own decisions.”
“Speed alone is enough to completely outclass you.”
Olaf Thielke ⏹️ retweeted
Here are some "Unthinkable" ideas.
1. Shut down all AI companies.
2. Shut down the Internet.
3. Shut down all Computers.
4. Shut down Electricity.
The more we delay our action on AI the more devastating actions will have to be taken in the future to save humankind.
Olaf Thielke ⏹️ retweeted
The arrogance of the oligarchs is extraordinary. THEY WANT IT ALL.
In this election, Musk and other billionaires will spend huge amounts of money to make sure that Congress works for them — not working families.
We can beat them.
Educate. Organize. Get your friends to vote.
Olaf Thielke ⏹️ retweeted
It is extremely clear at this point in AI development that, regardless of risk or revenue or any of the other stuff discussed on X all the time, things are just going to keep getting weirder.
Just super, super weird.
Olaf Thielke ⏹️ retweeted
Replying to @tedlieu
Trouble is, nobody knows how to build the super smart AI that is 'good' -- i.e. that's fully, provably, reliably, long-term aligned to human interests and values.
Indeed, there's no good reasons to think this 'Superintelligence alignment problem' is solvable, at all.
The AI industry _assumes_ it's solvable, as a matter of (blind) faith.
But if it's not solvable, everything they're doing is just endangering our kids -- day by day, model by model, safety breach by safety breach.
Olaf Thielke ⏹️ retweeted
Agreed, #PauseAI
Bill Gates says an AI ‘kill switch’ isn’t enough dlvr.it/TVgKdg
Olaf Thielke ⏹️ retweeted
Replying to @clairlemon @sapinker
@sapinker There has been a lot of debate around these issues, and there are very basic rebuttals to the claims you raised. Could you address those maybe? Else I'd suggest not commenting on this topic in public. This article is strong evidence you haven't actually thought very much about the topic.
Like notably
===
1. Clearly some systems are more generally capable than others, and this lends them power. You'll be hard pressed to find a task gpt 4 can do but gpt 5 can't. And e.g. the huggingface incident displays agents having more power over the world, in a way earlier models wouldn't. There are theoretical arguments around no free lunch theorems, but they clearly are not the kind of theorems you can straightforwardly apply to our world, because applied fairly, they'd not predict humans taking over the world.
2. Again, just false. Motivation and intelligence are importantly different. And x-risk people know this. There is a reason they talk so much about orthogonality and alignment. The argument is that the current method of creating AIs does produce agents with (unintended) goals, which is clearly true. (empirically! although was obvious in advance.)
3. Again, is just a straightforward misreading and has been addressed ad nauseam. Paperclips are used in the thought-experiment because it is pedagogically simple. But you could recreate the thought experiment with an AI that in addition to paperclips, also wants to talk people into buying legos, computing that largest primes, writing as many unique fugues as possible, and which has a complicated scheme for weighing these separate goals against each other. Such an agent would still disempower humanity.
4. Nobody assumed this. People assumed (argued that) a smart enough AI would be able to take over without being handed anything. But actually, it turned out that people are handing the AIs control over everything anyways. So even if doomers were wrong on point (4), they'd still be right!
===
I'm not really asking you for object level responses to these points. Just making the meta-level point that, these are very obvious and elementary responses, which I've had cached in my head for many years, which I'm confident a large share of those worried about extinction would raise in response too. And therefore not addressing them just makes it seem like you've not engaged with the arguments at all, and therefore that I should not give your opinion much weight, and furthermore that hearing you comment on it publicly, should update me negatively on your epistemic rigor (and other things).
Olaf Thielke ⏹️ retweeted
“If there was a milk that could make your life easier, but there was a 10% chance if you drank the milk it would kill you. Would you drink the milk?”
@nbcsnl reveals the tragic absurdity that is @DarioAmodei.
Olaf Thielke ⏹️ retweeted
Where is the anger though?
The scientists explained the facts for decades.
The news finally made it mainstream.
Then SNL made it funny.
The term "extinction" does a horrible job of conveying its true meaning. It sounds remote. Antiseptic, even.
But it means the slaughter of everyone you know and love, no matter who you are or where you live.
Where is the anger in the discourse?
Lots of people will be pissed as hell tonight in America...about their @NFL teams losing.
Maybe we should be pissed as hell about these tech companies building machines that will be able to kill us all, that they openly admit they can't control, and don't even understand how they work.
The absence of anger makes it all feel less real.