AI Safety

How do you know that @DHH is a liar and a grifter? You just watch what he does. He (well, his AI slop bot) closed the PR that @ZachSDaniel1 made to fix Elixir with "doesn't maintain compatibility with Rails" when his own Rust slop doesn't either github.com/basecamp/once-cam…

We're still investigating the trouble with @heyhey and now with @basecamp for some of our users. We will keep you posted here and at our Status Site: 37status.com/. We're so sorry, folks.

The GitHub issue tracker is begging Google to roll back the breaking, server-side change. I’m asking: how did it make it into prod, without validation, to start with?? Someone else asking: was this Gemini 🙃

The more time I spend working with coding agents, the more convinced I am that they make software engineering even harder We can do amazing things with them, but unlocking their full potential requires extraordinary discipline and knowledge

You can see when software becomes vibe coded. Gmail can't even delete mail from inbox anymore. I press delete, it disappears, then I try to close the tab, but it won't let me without a warning. I reopen gmail - that mail is there again! Sometimes it takes 3 or 4 attempts to actually delete it. What a world of "solved" software!

Dario is right

I recently went through a translation of Musashi’s Book of Five Rings. The introduction chronicled the evolution of swordsmanship and martial arts in general from pragmatic battlefield necessities to sports, historical curiosities, and hobbies. It was interesting to hear how in the post-WW2 occupation when martial arts were banned, Judo was represented as equivalent to western wrestling, and Kendo later to western fencing. The poignant undercurrent for me is that I can see many programming skills following that path. There are probably dozens of people reading this that remember hand assembling opcodes to hex and still have some magic numbers burned into their memory, but even the small group of people still programming in assembly today (hey, @FFmpeg !) don’t work at that primitive level now. AI is making many other programming skills much less critical. We aren’t there yet, but carefully writing code completely by hand is moving from a -jitsu to a -do. Code-do? Codo? That’s ok! The retro computing scene is delightful, full of people building and exercising old skills for the love of it. But don’t be the out of touch Kung Fu master, heir to lifetimes of tradition, that gets mauled by an amateur MMA fighter. Musashi would probably have been pretty enthusiastic about assault rifles.

GODFATHER OF AI ADMITS HE WAS WRONG ABOUT RADIOLOGISTS geoffrey hinton predicted in 2016 that within about 5 years radiologists wouldnt be reading scans anymore 10 years later he gives two reasons he got it wrong first, making scans cheaper and faster didnt mean hospitals suddenly needed fewer radiologists. it meant they could just do more scans and second, he admits he didnt really understand the job itself his picture of a radiologist came mostly from one former student who spent his time reading scans and barely talking to people the AI part actually went pretty close to plan. machines got really good at reading scans but making one part of a job cheaper doesnt automatically make the whole job disappear AI can shrink a task without shrinking the job

the most shocking part of this graph is that Kimi K, 300 employee company, is beating google, an infinity employee company spending 200B on AI this year