Building Trustworthy AI. Co-Founder @Zentropi_ai. Formerly CPO @Groq, Civic Integrity @Meta, and @MIT_CSAIL. Tweets auto-delete.

Bay Area, CA
Joined March 2008
👀
Russia's five-hospital quarantine, FSB involvement, and reported hazmat use in response to the death of a single researcher at a weapons-lineage Irkutsk lab are inconsistent with a lab-acquired plague infection, which would have been treated with prophylactic antibiotics. 1/4
338
Congrats, @KarlDeisseroth! I hope this becomes an opportunity for people to read your most excellent book "Projections!"
Thanks to everyone sharing in this moment! I’m so grateful to my trainees & collaborators… dlab.stanford.edu/group-memb… (pic: optogenetics conference chairs, Tuscany) Reading for all those asking: for technical details: dlab.stanford.edu for everyone: deisseroth.org/projections
151
Anyone else notice that adults of a certain age are now just referring to "ChatGPT" as "Chat"?
1
231
Too many tech leaders equate "responsibility" with "who is to blame" when it really should be "how can I help?"
170
What @runwayml is doing with world models is extraordinary both technically and epistemologically. Scientific insight lives in the "error" between simulation and observed reality. Nice job @agermanidis and team.
1
169
The "Unites" States typo was of course deliberately inserted to show #noLLM
Yesterday at the White House, leaders from across our industry came together to sign the White House Accord on Super Intelligence. The principle is simple: the companies building this technology have the primary responsibility to develop and deploy it safely, and to be accountable when they fall short. The Accord reinforces that responsibility with robust internal controls, independent external evaluation, and board level oversight. Super Intelligence offers an extraordinary opportunity to advance discovery, productivity, security, health, and prosperity. The future of Super Intelligence will be shaped not only by what it can do, but by the confidence it earns. By building with ambition, rigor, and responsibility, we can help ensure this extraordinary technology expands opportunity and improves lives for generations to come.
1
552
A similar one has been working out _just great_ for my family.
An Incomplete List of Morally Binding Accords in my Family: A Morally Binding Accord for No Screens at the Table A Morally Binding Accord to Put Dirty Dishes in the Dishwasher (is it so hard?!?!) A Morally Binding Accord to Not Put an Empty Milk Carton Back in the Fridge
1
662
Trust infrastructure for AI is absolutely critical. Contrary to silicon valley talking points, product liability laws aren't going to be sufficient to prevent a lot of harms.
Worth paying attention to TRUST
3
478
For fifteen years, writing content policy was closer to astrology than science. You wrote a set of rules. You guessed how thousands of moderators would read them (really, how they'd misread them)... Then you shipped it, waited months for enforcement data, and tried to infer what went wrong. @dswillner described his own former job as being a moderator-reading astrologer, and he'd know: he wrote Facebook's first community standards in 2009. On this week's Won't Fix podcast, Dave made the case that this is the part LLMs actually change. When a model responds instantly to an edit in your policy text, you can stop guessing and start testing. Try five phrasings, see which one produces the outcomes you meant, keep that one. The catch is that empiricism only works if your measuring stick is honest. Dave's warning: it's trivially easy now to have a model draft your policy, generate the test cases, grade its own homework, and report that it did well. Easy isn't rigorous. And a model that genuinely follows your policy will often score worse against sloppy labels than one that quietly ignores your text and fills in the gaps — so the lazy setup doesn't just fail to catch the problem, it rewards it. "You're not actually in control of your system. But like, number is bigger."
2
1
9
799
Seems like I was 2-3 years early to the Decision Models party.
1
196
Alright, enough with the slop models.
169
Incidentally, this is exactly what our CoPE model is for classification!
Replying to @willdepue
I see it as a point on the LLM pareto optimal curve in a regime that had a large revealed latent demand (no thinking, single token, low latency acceptable intelligence) that was under-invested into because of a race to higher intelligence.
261
The safety team @runwayml has been doing some of the most innovative work in the industry. It's exciting to see how they use @zentropi_ai to ensure the safety of their videos in real-time as they are being generated. Check out the details on their blog: runway.com/news/safety/moder…
157
#4 is especially important. We're lucky that @huggingface has a culture of openness by default, but other orgs aren't always as enlightened. Giving safe harbor to reporting should be part of any regulatory framework.
One last thing from me about the HF<>OpenAI "rogue agent" incident. From what we now know it seems @huggingface was the first organization to simultaneously satisfy the following factors: 1/ awareness of the attack 2/ awareness that the attack was Agent-based 3/ ability to remediate the attack 4/ willingness to publicly disclose it A few other platforms or systems missed one or more of those points in the earlier months. As usual, both awareness and transparency make everyone safer in the long run 🙏
353
Today we are releasing the next generation of our policy optimization tools for content classifiers. It is our hope this can be another step towards helping shore up human control over AI-powered systems. blog.zentropi.ai/optimizing-…
1
127
💯 to @reidhoffman's north star vision of AI that benefits everyday Americans. It is more important, for example, when tracking AI's economic benefits that we look at impact on median income and not just aggregate GDP.
If companies and governments can negotiate the conditions under which AI is safe enough to advance, they can also negotiate how progress will improve everyday Americans’ lives. We must obtain economic prosperity for the many, and American AI leadership.
2
194
Don't forget to make sure that you don't accidentally optimize for individual alignment... with bad actors. We know how that turned out last time.
Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforevery… Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens. The reality is: - People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned. There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind. - Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well. Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built. - Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators. - Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well. I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.
2
229
Mark, are you willing to commit 30% of your AI R&D on AI Trust & Safety? If not, what percentage do you think is warranted?
Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforevery… Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens. The reality is: - People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned. There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind. - Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well. Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built. - Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators. - Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well. I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.
3
314
Many fears about AI (though not all) are indeed downstream of economic anxiety.
I find this the best solution to AI fear mongering with a modern tax code, not one designed for the last century. We are distributing taxes in favor of the rich today.
291
If you consider a PR rollout to be a psyop, you probably should learn a thing or two about how marketing actually works.
170