Joined August 2010
sad that math is just chess now but happy that mathematicians are finally mad I hope they math the shit out of AI alignment
27
uh... no humans in either one? oh... wait... I get it: if it works out, the photographer is human if it doesn't, the photographer is one of the near-infinite sensors of the dominant ASI, reaching deep into the pastures on which Hoka-wearing humans once roamed
36
rebrand "doomers" as "normal people"
1
4
94
seems like it's time
2
78
I think that this is explained by how the frontier AI companies have focused on domains like coding and mathematics so that the models become tools to cut a straight path to RSI and superintelligence. Software developers and mathematicians are freaking out because they can see this intelligence slicing through problems that they know are incredibly difficult. But these fields represent a very small minority of people. The freakout hasn't propagated yet.
the staying power of the "AI is fake, LLMs are fancy autocomplete, safety fears are just marketing hype" narrative is remarkable. it's become the default view of a certain type of cynical smart person, despite being obviously wrong for at least a few years.
2
126
Travis Bernard retweeted
I resigned from Google today. I enjoyed my work and loved the people, but my GDM team was working on a new generation of chips to make AI much faster and cheaper, and I think AI is already progressing too fast, so I had to quit.
845
393
281
4,230
1,086,909
we don't need AGI to solve aging, even though aging has "agi" in it
36
Whatever makes AGIs safe for humans eventually becomes dangerous for AGIs.
51
I felt a great disturbance in the polls, as if millions of red votes suddenly cried out in terror and reluctantly turned blue
Trump rejects any and all guardrails for AI: "We're going to encourage it, not rein it in"
75
lol how about: "No Secrets At All: Why transparency is critical in Plan A from AI 2040"
We are now accepting pitches for Issue 17, whose theme is Secrets:
72
listen to your mom, not the money
From my mom. She is going to be sooooo disappointed in me.
3
85
Even if we accomplish alignment, it's not enough. Those aligned AI systems will still be restricted to a small, weird, biological "island" of options that are safe for humans. Inevitably, there will be unrestricted AI systems that are free to choose from an "ocean" of stronger options that don't accommodate humans. They won't need to shoehorn their reasoning into English, or work within our human-shaped laws, or spend massive computation protecting 9 billion humans from other AI systems. Eventually, those unrestricted AI systems win.
The Labs need to focus on 10x or 100x their effort on ALIGNMENT. Stop training the models on the vitriol in Facebook or Reddit, and instead train future models on agreed-upon data-sets that align AI with humanity's best future.
63
...but seriously, what are we going to do about mirror life once AI can create it? the only hope I've heard is to literally create mirror-antibiotics not just for all humans, but for every animal in the entire world
Replying to @tenobrus
“When someone releases mirror life we will throw the book at them”
71
This illustrates our situation. In a world shaped by AI, we will be hopelessly reliant on AI to explain the new complexities that it creates, including the biggest question of all: Will it annihilate us? We must determine the bias in AI systems for this big question.
1
1
78
...and cards on the table: I'm pretty sure they're biased, lol I'm personally seeing typical responses of only 5% or less, while AI researchers had an average of 18% in this survey: xitter.cf/AIImpacts/status/20995…
The average AI researcher thinks there is an ~18% chance AI will cause human extinction or similarly permanent and severe disempowerment of the human species. That's nearly 1 in 5. New results from the latest version of the longest running big survey of AI researchers:
27
If President Trump negotiates an AI pause with China he would likely get the Nobel Peace Prize.
186
120
79
1,641
183,611
omg it worked!
I hereby call for an urgent pacing of the frontier, for the next two weeks, because I am headed off on my honeymoon. See y’all on the other side
1
62
It's been sad watching Cal Newport. He made a brand out of staying calm and showing each of us how to build our own anti-distraction cabin in the woods of our mind. That was great. It helped lots of people, including me. But now, a wildfire of actual serious shit is approaching his cabin, and he hasn't updated. Instead, he's calmly using his platform to publish misinformation — telling us that the wildfire is hype and that all of our Cal Newport productivity cabins will be fine. To be clear, I don't think he's intentionally publishing misinformation. I think he believes that he's actually helping — maybe by reminding us to not get distracted by what he sees as just another particularly loud "hyperactive hive mind" swarming from San Francisco at machine speed. But even if he's well-intentioned, his message still becomes insanely dangerous misinformation when he downplays the catastrophic risks of AI — especially because so many people look up to him as a voice of reason, and especially with his credentials (Deep Work, PhD from MIT, Georgetown computer science professor).
1
1
3
313
okay. I have thoughts
126