you can tell @natfriedman built Muse because almost every interaction is under 150ms

I see a lot of headlines saying China refuses to pace AI progress and doesn’t care about safety. That’s a misinterpretation of their response to Dario’s essay. China isn’t ignoring #AI #safety, it’s just doesn’t agree with Dario’s condition that AI safety be coupled with holding back their domestic AI labs. If we want cooperation we need to show mutual understanding and respect. More details in this new @WIRED article from @lmatsakis. “China Isn’t Buying Silicon Valley’s Call for an AI Slowdown” Nice to see my views are aligned with @kristy_loke, @kevinsxu, and @michellesnie in this piece.

Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforevery… Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens. The reality is: - People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned. There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind. - Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well. Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built. - Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators. - Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well. I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.

8% chance the U.S. & China agree to slow the pace of AI development. poly.market/vrDPUHH

OpenRouter users spent more on OpenAI models than on Anthropic models last week. This hasn't happened for more than 2.5 years

Right. Dario was already claiming that GPT2 was too dangerous to open source back in 2019. I made fun of them then. Everyone should make fun of them now.

Donald Trump rejects calls from tech bosses for an AI slowdown ft.trib.al/bjaDHPx

open source won’t pace

I must be among an extremely small group of people (n=1?) that have both 1) trained a frontier LLM and 2) designed and synthesized custom viruses in a lab with my own two hands. And I think that the takes on AI killing us all by creating dangerous viruses is total bogus.

He thinks he will be put in charge of the most powerful transnational organization in history and strongarm the USA. Saying he would hand everything over to "the right set of government" is obviously predicated on the assumption that it is run by him and his stooges, not Trump.

Dario Amodei, Elon Musk and Sam Altman now agree that we must slow down the development of AI and “pace the frontier.” That’s a start, but it’s not enough. When you are racing towards a cliff, you don’t just ease up on the gas pedal. You hit the brakes. When the future of humanity is at stake we need a PAUSE on advanced AI development and a ban on artificial superintelligence — an AI mind smarter than any human and capable of operating independently beyond our control. At their upcoming AI summit, Trump and Xi must negotiate a treaty to pause AI and ban superintelligence before it is too late.