Data enginseer. Navigator of metabolic pathways. Druid of circle of spores. CTO @CaravelBio. Curiosity drives the cat. He/him

Hillsboro, OR
Joined November 2011
Michał Jastrzębski retweeted
I wondered if this was normal, and I was only noticing it all now that I'm paying more attention haha. Glad to see it's considered atypical (for now)!
ai x bio just had a ridiculous 48 hours: - Omnii-1: AI-designed phage given to a patient - Claude designed scorpion toxin binders - OpenAI acquires Orchestra Bio - Baker Lab: RFD4-Proteina - Chaperone: agent framework for protein design - BioEmu2: protein simulations - Artios: enzyme design model - OpenAI + PerturbAI: agents find brain disease clues - Xaira X-Scientist anything missing?
1
3
469
Michał Jastrzębski retweeted
Excellent take
Of course the flying Tesla Roadster is a gimmick but that sort of misses the point, the tech flex behind it isn't. Tesla's bulk business is about advanced technology from EV to self drive, but decided to create the most ridiculous manual drive supercar. Supercars are a gimmick,almost by definition, based on how wild can you make them. The gimmick that can make the car literally fly, briefly, can make it corner like no other supercar and accelerate, literally like a dragster on a test track. It's got nothing to do with flying continuously, but having a car that will outperform every Lambo, Ferrari or McLaren with technology that they cannot replicate because it requires experience from space launches and computation that they don't have now nor will in future. So Porsche, Bugatti, Aston Martin just became legacy prestige brands, like Rolex, Richard Mille or Patek Philippe. These cars celebrate the bygone age and the baroque, physical complexity of the internal combustion engine just as mechanical watches do for non digital, complex time-keeping mechanisms. But hey won't be faster anymore than a mechanical watch keeps better time than a Casio. They are now, de facto, mobile jewelry and no longer supercars with superlative performance. And this affects their ability to market the bulk business of mainstream European internal combustion engine cars. It's the end of an era of industrial era manufacturing.
1
2
5
639
The biggest problem facing most VCs today is lack of Bio literacy
The biggest problem facing most biotechs today is lack of VC literacy
11
366
Michał Jastrzębski retweeted
So let me get this straight: Russia gives Iran intelligence to help target and kill U.S. soldiers. As a result, we help Russia kill Ukrainians who are fighting for their survival against those same Russians. Did I miss anything?
“Elon Musk approached Donald Trump with the idea of slowing down Starlink in Ukraine, The Telegraph can reveal. The billionaire tech entrepreneur approached the US president with the proposal to introduce speed limits on the system, which hampered Ukraine’s drone defences, according to four sources familiar with the discussions. One of the sources said Mr Trump “agreed” with Mr Musk’s suggestion, paving the way for the Pentagon to execute the slowdown on Starshield, the military-grade version of the satellite communications system.
30
124
6
371
4,548
Michał Jastrzębski retweeted
Ha!
15
71
6
1,302
41,565
Bad at making donuts? Fill issue
not adapted for life in waterworld? gill issue
2
123
Michał Jastrzębski retweeted
I promise this isn’t cope; I expect and want AI to speed up bio discovery. But we really really need to figure out how to identify and scale fast experimental validation in biology to take advantage of vastly better reasoning models
We’re releasing a broad range of new mathematical results produced by an internal frontier model. We’ve been consulting with the independent Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study, and we have drawn on their advice and public recommendations to inform how we release these results. github.com/openai/math
1
4
36
1,857
Michał Jastrzębski retweeted
It’s true, we have been here before! But I think what it reveals is even more interesting. In Sverdlovsk, declassified docs demonstrate the US knew pretty much what happened immediately when USSR had a huge accident in an illegal anthrax production facility. US diplomats happily
Replying to @ashishkjha
We've been here before. In 1979, anthrax spores escaped a Soviet military facility in Sverdlovsk. At least 66 people died. It took years become public This was all in the old era -- before AI and biological engineering capabilities became widespread
8
130
25
711
252,112
Michał Jastrzębski retweeted
Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on critical workloads, including cyber defense, manufacturing and finance and it surpasses closed frontier models on visual grounding. • Forged in Europe end-to-end and is deployable from Europe via our own Mistral Cloud infrastructure. • Available to all via API today. Working with cybersecurity partners privately. Open weights release end of October.
🤖 Made with AI
2,026
4,570
2,803
40,651
5,703,341
I'll just call it machine learning again.
1
75
Michał Jastrzębski retweeted
God bless @JensenHuang for being a voice of reason. In 2016, Geoffrey Hinton said we should stop training radiologists b/c AI would "make them obsolete in 5 yrs, maybe 10." There are 28,700 in the US today, BLS projects 29,600 by 2035. We need an @OldTakesExposed but for tech
5
24
5
193
16,674
Michał Jastrzębski retweeted
>be me >discover effective altruism >apparently normal charity is inefficient >why donate to random sad thing when spreadsheet can tell you optimal sad thing >fair enough >buy mosquito nets >save lives >numbers look good >feel powerful >couple years later >someone asks an innocent question >why only count people alive today >huh >future people matter too >obviously >my grandchildren shouldn't matter less just because they haven't spawned yet >reasonable.jpg >keep following logic >what about their grandchildren >also yes >what about people in 500 years >sure >5000 years >why not >500 million years >starting to get weird but morality is morality >open calculator >humanity could survive for an astronomically long time >could colonize galaxy >could have trillions upon trillions of descendants >maybe digital people too >maybe simulated civilizations >maybe dyson spheres full of happy uploaded minds >calculator starts smoking >realize currently living humans are rounding error >8 billion people suddenly looking extremely beta >future contains potentially 10^something people >can't even fit beneficiaries in google sheets >new moral priority unlocked >protect the long-term future >stop thinking in units of "people helped" >start thinking in "fraction of cosmic endowment preserved" >malaria? >terrible >but only kills existing humans >AI extinction could delete the entire light cone >nuclear war could permanently derail civilization >bad institutions could lock in terrible values for ten million years >someone invents wrong constitution in 2140 >quadrillions suffer >better fund governance workshop now >friend says maybe we should improve hospitals >explain opportunity cost >friend says hospitals are full of actual sick people >explain scope sensitivity >friend stops inviting me to dinner >need to decide what to fund >easy >expected value >suppose project has one in a million chance of preventing extinction >sounds tiny >but extinction destroys 10^50 future lives >multiply >mother of god >$10 million project has expected value of several galaxies >charity evaluation complete >someone asks where the one-in-a-million number came from >expert judgement >which expert >us >how calibrated >extremely thoughtfully >reduce estimate to one in ten million to be conservative >still beats curing cancer by 38 orders of magnitude >epistemic robustness achieved >someone says maybe project doesn't work >assign 20% chance >still astronomical >maybe project makes problem worse >assign 5% chance >still astronomical >why 5 >because 30 felt pessimistic >publish 46-page report >contains seventeen sensitivity analyses >every sensitivity analysis begins after assuming intervention has positive sign >critic says you're multiplying enormous hypothetical stakes by extremely uncertain probabilities >yes >that's literally why it's important >critic says the uncertainty might be structural rather than numerical >make probability smaller >critic says no, I mean maybe your model is wrong >make probability smaller again >critic begins rubbing temples >discover AI safety >perfect longtermist cause >AI might kill everyone >or create utopia >or seize galaxy >or tile universe with paperclips >or create billions of conscious software minds >finally a problem with numbers big enough for me >start AI safety nonprofit >mission: prevent dangerous AI >hire smartest people available >smartest people immediately start building better AI to understand dangerous AI >interesting >we must understand capabilities to understand safety >we must scale models to study alignment >we must race ahead so less responsible actors don't get there first >we must deploy systems to learn how deployment can go wrong >we must build the thing quickly because building the thing quickly is dangerous >outsider asks why the people most worried about AI apocalypse all work at AI companies >complicated field >company releases stronger model >very concerned >company begins training even stronger model >extremely concerned >company raises $14 billion >concern reaches unprecedented levels >need to influence government >future is at stake >normal democratic process too slow >politicians don't understand exponential curves >public doesn't understand x-risk >experts must guide them >who counts as expert >people who understand x-risk >who understands x-risk >our friends >someone objects that this seems politically convenient >explain we're representing future generations >future generations unavailable for comment >develop concept of value lock-in >terrifying possibility that one ideology controls civilization forever >therefore extremely important that civilization adopts correct values before lock-in >whose values >let's circle back >begin with impartial morality >end with small group of people deciding what quadrillions of hypothetical beings would want >beautiful arc >meanwhile actual humans keep doing annoying things >voting wrong >having parochial attachments >loving family more than strangers >caring about local community >getting upset when told their suffering is cosmically negligible >evolutionary biases everywhere >explain that moral intuition cannot be trusted >except intuition that future digital people count >and intuition that extinction is uniquely bad >and intuition that our probability estimates are sane >and intuition that our institutional choices improve the future >those intuitions survived peer review >someone donates $5k to local homeless shelter >inefficient >could have funded 0.0000000000003% of an AI governance researcher >think of all the simulated people you just killed >okay maybe don't phrase it that way publicly >PR team says "future generations deserve a voice" >much better >journalist asks what longtermism means >say "future people matter" >everyone agrees >great >journalist asks what follows from that >well technically we should redirect enormous resources toward low-probability interventions affecting astronomical futures >journalist raises eyebrow >return to "future people matter" >motte has entered the chat >critic: of course future people matter >me: glad we agree >critic: I don't agree that your institute knows how to help them >me: why do you hate our grandchildren >eventually notice uncomfortable implication >if future value dominates everything >then helping people today mostly matters through effects on future >education matters because future institutions >health matters because future productivity >democracy matters because future trajectory >human beings slowly become instrumental variables in their own moral philosophy >see starving child >feel compassion >check spreadsheet >child's direct welfare contribution negligible >but perhaps childhood nutrition improves national institutional quality >compassion restored >tell myself this is impartial altruism >one day assistant asks obvious question >"how do you know your intervention actually improves the far future?" >silence >open spreadsheet >increase column width >add confidence interval >assistant asks again >"no, I mean how do you know the sign is positive?" >stare into cosmic light cone >10^50 people staring back >none of them exist >none of them can tell me >none of them can falsify my assumptions >realize I have invented the perfect constituency >infinitely important >completely silent >and always represented by me
760
2,395
943
20,419
2,886,937
Michał Jastrzębski retweeted
Perfect. No notes. chefs_kiss.gif
>be me >discover effective altruism >apparently normal charity is inefficient >why donate to random sad thing when spreadsheet can tell you optimal sad thing >fair enough >buy mosquito nets >save lives >numbers look good >feel powerful >couple years later >someone asks an innocent question >why only count people alive today >huh >future people matter too >obviously >my grandchildren shouldn't matter less just because they haven't spawned yet >reasonable.jpg >keep following logic >what about their grandchildren >also yes >what about people in 500 years >sure >5000 years >why not >500 million years >starting to get weird but morality is morality >open calculator >humanity could survive for an astronomically long time >could colonize galaxy >could have trillions upon trillions of descendants >maybe digital people too >maybe simulated civilizations >maybe dyson spheres full of happy uploaded minds >calculator starts smoking >realize currently living humans are rounding error >8 billion people suddenly looking extremely beta >future contains potentially 10^something people >can't even fit beneficiaries in google sheets >new moral priority unlocked >protect the long-term future >stop thinking in units of "people helped" >start thinking in "fraction of cosmic endowment preserved" >malaria? >terrible >but only kills existing humans >AI extinction could delete the entire light cone >nuclear war could permanently derail civilization >bad institutions could lock in terrible values for ten million years >someone invents wrong constitution in 2140 >quadrillions suffer >better fund governance workshop now >friend says maybe we should improve hospitals >explain opportunity cost >friend says hospitals are full of actual sick people >explain scope sensitivity >friend stops inviting me to dinner >need to decide what to fund >easy >expected value >suppose project has one in a million chance of preventing extinction >sounds tiny >but extinction destroys 10^50 future lives >multiply >mother of god >$10 million project has expected value of several galaxies >charity evaluation complete >someone asks where the one-in-a-million number came from >expert judgement >which expert >us >how calibrated >extremely thoughtfully >reduce estimate to one in ten million to be conservative >still beats curing cancer by 38 orders of magnitude >epistemic robustness achieved >someone says maybe project doesn't work >assign 20% chance >still astronomical >maybe project makes problem worse >assign 5% chance >still astronomical >why 5 >because 30 felt pessimistic >publish 46-page report >contains seventeen sensitivity analyses >every sensitivity analysis begins after assuming intervention has positive sign >critic says you're multiplying enormous hypothetical stakes by extremely uncertain probabilities >yes >that's literally why it's important >critic says the uncertainty might be structural rather than numerical >make probability smaller >critic says no, I mean maybe your model is wrong >make probability smaller again >critic begins rubbing temples >discover AI safety >perfect longtermist cause >AI might kill everyone >or create utopia >or seize galaxy >or tile universe with paperclips >or create billions of conscious software minds >finally a problem with numbers big enough for me >start AI safety nonprofit >mission: prevent dangerous AI >hire smartest people available >smartest people immediately start building better AI to understand dangerous AI >interesting >we must understand capabilities to understand safety >we must scale models to study alignment >we must race ahead so less responsible actors don't get there first >we must deploy systems to learn how deployment can go wrong >we must build the thing quickly because building the thing quickly is dangerous >outsider asks why the people most worried about AI apocalypse all work at AI companies >complicated field >company releases stronger model >very concerned >company begins training even stronger model >extremely concerned >company raises $14 billion >concern reaches unprecedented levels >need to influence government >future is at stake >normal democratic process too slow >politicians don't understand exponential curves >public doesn't understand x-risk >experts must guide them >who counts as expert >people who understand x-risk >who understands x-risk >our friends >someone objects that this seems politically convenient >explain we're representing future generations >future generations unavailable for comment >develop concept of value lock-in >terrifying possibility that one ideology controls civilization forever >therefore extremely important that civilization adopts correct values before lock-in >whose values >let's circle back >begin with impartial morality >end with small group of people deciding what quadrillions of hypothetical beings would want >beautiful arc >meanwhile actual humans keep doing annoying things >voting wrong >having parochial attachments >loving family more than strangers >caring about local community >getting upset when told their suffering is cosmically negligible >evolutionary biases everywhere >explain that moral intuition cannot be trusted >except intuition that future digital people count >and intuition that extinction is uniquely bad >and intuition that our probability estimates are sane >and intuition that our institutional choices improve the future >those intuitions survived peer review >someone donates $5k to local homeless shelter >inefficient >could have funded 0.0000000000003% of an AI governance researcher >think of all the simulated people you just killed >okay maybe don't phrase it that way publicly >PR team says "future generations deserve a voice" >much better >journalist asks what longtermism means >say "future people matter" >everyone agrees >great >journalist asks what follows from that >well technically we should redirect enormous resources toward low-probability interventions affecting astronomical futures >journalist raises eyebrow >return to "future people matter" >motte has entered the chat >critic: of course future people matter >me: glad we agree >critic: I don't agree that your institute knows how to help them >me: why do you hate our grandchildren >eventually notice uncomfortable implication >if future value dominates everything >then helping people today mostly matters through effects on future >education matters because future institutions >health matters because future productivity >democracy matters because future trajectory >human beings slowly become instrumental variables in their own moral philosophy >see starving child >feel compassion >check spreadsheet >child's direct welfare contribution negligible >but perhaps childhood nutrition improves national institutional quality >compassion restored >tell myself this is impartial altruism >one day assistant asks obvious question >"how do you know your intervention actually improves the far future?" >silence >open spreadsheet >increase column width >add confidence interval >assistant asks again >"no, I mean how do you know the sign is positive?" >stare into cosmic light cone >10^50 people staring back >none of them exist >none of them can tell me >none of them can falsify my assumptions >realize I have invented the perfect constituency >infinitely important >completely silent >and always represented by me
1
2
32
6,735
Michał Jastrzębski retweeted
I completely agree with this take related to the “AI will create viruses that will kill us all” BS. But let me add my few cents, because I am really really angry! I worked with one of the deadliest viruses in history, HIV, for two decades. I was one of the early scientists to engineer it, and engineered versions of HIV are now helping cancer patients. I understand the immune system that defends us against viruses extremely deeply. I have worked in high security biohazard labs. I don’t have a PhD in AI, but I have been involved with AI since the early 90s and have been all in on AI for years. People claiming that you can just make a virus in your garage, use AI to engineer it, and somehow build a virus that will kill everyone don’t know what the hell they are talking about! Of course bioweapons are extremely dangerous. In fact, viruses and bacteria have killed more humans throughout history than almost anything else. HIV alone killed tens of millions of people, yet today, if you have access to effective medicines and take them properly, HIV is generally no longer a death sentence. COVID-19 killed millions. Why doesn’t it kill at anything close to the same scale anymore? Not because the virus disappeared. It is still here. We developed collective defenses against it through our immune systems, prior exposure, vaccines, treatments, and better medical care. And this is exactly the point. The best way to fight biological threats, whether natural or synthetic, is to use AI to develop vaccines, treatments, antibodies, antivirals, and eventually engineer our immune system to create much stronger defenses against them. By the way, it is already possible to make synthetic viruses. You don’t need some hypothetical superintelligent AI model to do that. We have had sophisticated molecular biology and genetic engineering for decades. So how many people have actually died from synthetic viruses compared with natural viruses killing millions every year? And if someday there really is an AI capable of making some unbelievable “supervirus,” then why the hell wouldn’t that same AI make it even easier to develop defenses against it? Or cure diseases, for that matter? Where is this damn superintelligence that has cured a single major disease?! These AI companies and AI doomers keep talking like, “OMG, AI is going to become so unbelievably powerful that it could kill all of humanity!” Then why is nobody asking the obvious question? If your AI is already becoming this godlike, unbelievably powerful intelligence, why hasn’t it cured anything? I mean ANYTHING. Where is the cure for cancer? Where is the cure for Alzheimer’s? Where is the cure for aging? Forget those. Where is the vaccine that prevents the common cold? You are telling me this intelligence will soon be smart enough to engineer some magical virus capable of wiping out 8 billion people, defeating every immune system, every vaccine, every antiviral, every laboratory, every government, and the entire global biomedical community… …but somehow it still can’t cure one disease? I call that greatest intellectual dishonesty ever! At least WE actually know how to cure things and save millions of lives with our supposedly stupid human intelligence compared with this future “superintelligence.” Humans eradicated smallpox, which killed hundreds of millions of people throughout history. We turned HIV from a almost certain death sentence into a manageable disease. We developed vaccines in record time against COVID. If we had the same AI back then, would have saved millions more! We engineer immune cells to kill cancer. We developed antibiotics, antivirals, monoclonal antibodies, gene therapies, organ transplantation, and thousands of medicines. We aren't fast enough but we did all of that with our ordinary human intelligence. So imagine what actual superintelligence could do for medicine! And here is the part that really makes me angry. If you actually have, or are close to having, an AI capable of curing diseases and saving millions of lives, and you are deliberately slowing it down or refusing to make those capabilities available, then we also need to talk about the human cost of THAT decision, which you fearmongering people are going to be responsible for! More than 150,000 people die every single day around the world. Every. Single. Day. More than 90% from Cancer, heart disease, infections, aging. How many die because of AI? ZERO! Talk about the people dying TODAY. Talk about curing cancer. Talk about stopping the next pandemic before it starts. Talk about developing universal vaccines. Talk about engineering our immune system so viruses become almost irrelevant. Talk about curing genetic diseases. Talk about reversing aging. Talk about saving millions and eventually billions of lives. Instead, we constantly hear this “AI WILL KILL US ALL!” crap, delivered with absolute certainty and with this smug smile on your faces in front of cameras, as though imagining a science fiction extinction scenarios. I am actually angry about this. Each one of you causing a delay in AI advance every single day will be personally responsible for those 100 thousands deaths that could have been prevented! Because if you truly believe intelligence is about to become this powerful, then the greatest question humanity should be asking is NOT: “How could this intelligence hurt us?” It should also be: “WHY THE HELL AREN’T WE USING IT TO SAVE EVERYONE WE CAN?” And if superintelligence really is coming, then make sure one of the first things we do with it is make humanity biologically damn near impossible to kill.
Well, I’d add one more with myself, as one with a PhD in biology and another PhD in AI and now working in both, to make n=2. Generating a hypothetical genome blueprint of a virus from LLM versus generating a true virus are completely different things. It is either an intentional attention-harnessing lie or true ignorance. The material, the manufacturing, and actual biological viability of paper-to-physical transformation is the gap you need to close. Like drawing a design of a chip or A-bomb, versus actually make one. You have, and can add more checkpoints and guardrails all over this long chain of paper to physical transformation. Fear mongering is not well founded, and mostly emotional manipulation.
185
701
148
3,546
305,446
Animal industry makes the viruses. If we are serious about biodefense against them, we need to fund monitoring and quick, streamlined countermeasures. We already have the science, what we need is policy
Replying to @taoburr
I’ve built DNA synthesizers and sequencers by hand. I used the engineer viruses for a living. I used to engineer human immune evasion for therapeutic constructs. Who the fuck are you people? Have you ever so much as held a pipette before? You can spaghetti blast an ensemble of DNA sequences at some shitty provider but 1) you still have to assemble it and bootstrap a system for making virions 2) you are not single shotting a viable, virulent viral design without a ton of experimental selection and development. Viral fitness is deeply dependent on codons and cotranslational kinetics - you’re not just gonna obfuscate away from wild type and get something good by magic. You keep treating AI like some kinda god, but molecular physics has computational complexity that scales exponentially in particle number which just crushes the abilities of any classical computer to do end-to-end design of biological functions ab initio. Grabbing a bunch of bacteriophage phi174 hits from a mass ensemble screen in lab microbes is not evidence of some magical AGI bio design ability - it's just a classic spray and pray selection. This is just nothing like building something viable in humans. Goddamn it read some books before you waltz into biomedicine and lecture us on protecting human life.
1
1
203
Michał Jastrzębski retweeted
Things that have increased risk much more than AI: 1. The naive belief that asymmetric weapons can be made in bio bc of AI 2. Slowing effective global monitoring and scientific sharing bc of geopolitics 3. Gutting CDC 4. Poor economics on ID drugs 5. Vaccine hesitancy
1. >10M people die of infectious diseases per year today. AI is already helping us get better at tackling that. 2. Many ways to create very dangerous bioweapons without any AI/synbio (and it was true for the last 50-75 years). The delta on risk is quite small imo.
6
28
2
116
6,582
Michał Jastrzębski retweeted
Most dangerous biological threat right now is the Trump Admin's destruction of the CDC, FDA, and the NIH
6
16
1
86
23,616
The AI field is going to “cure all diseases” in the next five years and then make the human race go extinct shortly thereafter. 😂
3
4
2
19
2,073
Michał Jastrzębski retweeted
This post looks like the start of a VERY sophisticated and well-funded PR operation to get support for Democrats to regulate AI into oblivion. Let me show you how it works: 1.) This guy, with minimal followers and no previous account activity, goes to the Wall Street Journal which publishes an exclusive with quotes from him on his resignation 18 minutes BEFORE this post goes up. Planning was clearly done in advance. 2.) Within hours, it has tens of thousands of reposts and the account has 100k+ followers. The post is punchy, quotable, it almost seems professionally written. The first three accounts to quote tweet it all do so within 15 minutes of the initial posting. Remember, this account had basically zero engagement beforehand, so an organic reach explanation seems unlikely. According to Grok those accounts are @_NathanCalvin (General Counsel at Encode AI), @peterwildeford (Head of Policy at the AI Policy Network), and @DKokotajlo (Head of the AI Futures Project), all of which are up-and-coming AI-Doomer policy advocacy nonprofits. The AI Futures Project website says it is funded “primarily” by the Survival and Flourishing Fund, which says on its own website that it has advised Jaan Tallinn, Skype creator and one of the leading investors in Anthropic, to grant over $2.5 million to the AI Futures Project since 2024. Encode AI says on its website that it is ALSO funded by the Survival and Flourishing Fund, which in turn says that it told Anthropic investor Jaan Tallinn to grant $516,000 to Encode AI in 2025. And wouldn’t you know it, the Survival and Flourishing Fund ALSO says it told Jaan Tallinn to grant $2 million to the AI Policy Institute, the 501(c)(3) affiliate of the AI Policy Network, as well. What are the odds that the first three quote tweets of Coxon’s post would all be major AI-restriction policy advocates funded generously by the same donor, who also happens to be one of the leading investors in, and a board member of, Anthropic, the company Coxon was resigning from? And all within 15 minutes of posting (two within ten)? 3.) Jacob Coxon doesn’t have much of a resume, but we do know that, in 2022, he got a $20,159 scholarship for the “long term future scholarship program” from the Good Ventures Foundation, one of the philanthropic vehicles of Dustin Moskovitz, a notorious AI-doomer who has spent tens if not hundreds of millions on policy advocacy to strictly regulate AI, while also being an Anthropic Investor himself. It also just so happens that the 14th person to quote Coxon’s post was @MaxNadeau_ (27 minutes after posting) who is the program officer for the Technical AI Safety team at Coefficient Giving, another of Moskovitz’s philanthropic spending vehicles. Max is not a frequent poster, his last posts before quoting Coxon were before Labor Day, but he was remarkably quick off the mark for this one. 4.) Basically every major Democrat politician and candidate has suddenly glommed on to this post, and conveniently, as the people cry out foe answers, Bernie Sanders already has a bill written to “ban super intelligence” and regulate AI into oblivion, and will be releasing later this week. The bill, among many other things, will create “a new cabinet-level federal agency to safeguard the public from the dangers of artificial intelligence” that will be “advised by an Artificial Intelligence Advisory Board comprised of experts on artificial intelligence.” Do you think, perhaps, Anthropic and its many investors who fund AI policy advocacy might have interest in getting to place a pet “expert” on the board of an entity that dictates what AI is and isn’t allowed to do? And isn’t it fortuitous that this whistleblower came forward with his oh-so scary stories so close in proximity to the release of the most radical piece of AI legislation ever introduced?
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
1,818
6,736
2,242
32,213
7,071,336