Biology x AI | Founding MTS, Evals @EdisonSci | Previously @FutureHouseSF

San Francisco, CA
Joined January 2015
Kosmos can now read @NaturePortfolio! Today we're announcing a subscription agreement with @SpringerNature that brings licensed content from specialist journals across the Nature Portfolio directly into Kosmos. When Kosmos generates a hypothesis or evaluates a target, it can now pull directly from Springer Nature journals, linked to the Version of Record so it's iterating on current, correct science. This is the first of several content partnerships we plan to announce, because better-sourced literature makes for a faster path from discovery to development.
3
10
3
50
13,178
Jon Laurent retweeted
Science – debatably the #1 journal in the world – published a paper on a "virtual biotech" AI system this week but the authors never even test if it works well! all the evidence for its performance is 3 anecdotes the paper has no benchmark scores, no baselines, no replicates
21
42
10
336
40,064
Jon Laurent retweeted
BixBench3 is out! Our latest eval for biology capabilities in language models. Essentially requires agents to reproduce all work needed to write a paper from raw data. OpenAI is in the lead with 5.6-Sol at 48%, Anthropic is in 4th with Opus 4.8, after Kimi and GLM. Opus 5 has weird instruction following problems that severely degrade its performance. I’m sure Fable is great but can't be evalled on this. Read more below. Also lest we miss the forest for the trees, we’re in a position now where the models can essentially reproduce entire papers ~50% of the time. Crazy time to be alive.
8
24
3
169
9,337
Jon Laurent retweeted
very excited for the main effort of my time so far @EdisonSci to go live today! bixbench3 is, afaik, the longest horizon biology benchmark in existence – in terms of tokens, time, and task scope
Introducing BixBench3, our latest eval for language models in science and the first eval to measure the ability of models to produce the analyses underpinning entire biology papers from raw data. BixBench3 evaluates 13 frontier models on 20 paper-derived tasks, using datasets up to 241 GB. Each task mirrors how scientists often use agents today: setting a research objective and designing a methodological plan, then delegating implementation to the agent. The best model reproduced 48% of the requested artifacts on average. Agents are starting to approach research study-scale capabilities, but there is still plenty of work to do.
3
9
19
2,173
Bixbench3: Can models reproduce the entire analysis from papers? We had agents repro papers end-to-end, with over 1B tokens spent on some. Frontier agents still score below 50%, and due to real problems like environment misconfig, quitting, or faking data 1/6
15
44
5
296
23,571
Agents are getting good at carrying out discrete analyses in bio, like those in prior benchmarks like OG BixBench. But the ultimate promise lies in autonomous study-scale research. This was quite an effort, driven by the indomitable @zanehkoch. Stayed tuned for more!
Introducing BixBench3, our latest eval for language models in science and the first eval to measure the ability of models to produce the analyses underpinning entire biology papers from raw data. BixBench3 evaluates 13 frontier models on 20 paper-derived tasks, using datasets up to 241 GB. Each task mirrors how scientists often use agents today: setting a research objective and designing a methodological plan, then delegating implementation to the agent. The best model reproduced 48% of the requested artifacts on average. Agents are starting to approach research study-scale capabilities, but there is still plenty of work to do.
1
14
610
Jon Laurent retweeted
At Edison, we are on a mission to leverage AI to prevent or cure all diseases. Today, we are announcing a critical step: our first partnership using our AI scientist, Kosmos, to launch new biotech companies. Many of the most transformative new medicines begin life in biotech companies rather than big pharmas. We are partnering with Population Health Partners (PHP) to deploy Kosmos across their company creation pipeline. Kosmos will assist in the creation of PHP’s companies, allowing us to bring more medicines to patients. PHP has an outstanding track record of incubating successful biotech companies like @MetseraInc (acquired by @pfizer in a $10B deal), and The Medicines Company (acquired by @Novartis for $9.7B), to name just two. With PHP, we will focus on biotechs treating population-scale diseases like cardiovascular disease and obesity. If we can scale up the process of launching Metsera-style companies, we have an opportunity to transform medicine in the coming years.
6
35
5
167
31,803
Jon Laurent retweeted
long-lived species and humans living 100+ years are known to have increased DNA repair capacity but how DNA repair could be boosted to extend human lifespan is largely unknown our research in Nature Aging today proposes a target to enable such a boost: the DREAM complex
6
26
5
97
7,503
Jon Laurent retweeted
We live in a golden age of biology. So why are people still dying from disease? Because discovery and development move slower than they should. Today, we’re partnering with Incyte to change that. Kosmos is now the first agent that can compress months of drug development into weeks, from the earliest stages of scientific discovery through to FDA approval. @Incyte will be the first company to deploy it across their pipeline. Work that used to take a team of scientists months now happens in weeks. Patients can't wait, and neither can we.
120
438
179
1,925
7,041,753
Jon Laurent retweeted
Earlier this week at GTC, we announced our partnership with Nvidia. We will work with Nvidia to build strong, American open-source models that are at the frontier of scientific reasoning. These models will be essential for the US to compete with China on science in the coming decades. Jensen is committing to spend tens of billions of dollars developing open-source models, and we are excited to be a partner with them in figuring out how to benchmark, train and use those agents to accelerate scientific research. We have already open-sourced some of the work we have done with them, and are looking forward to open-sourcing more. There are few things today that are more important. See our blog post below, and watch the video to learn more, narrated by the man himself.
8
22
5
130
24,443
Jon Laurent retweeted
The Azenta XPeel is now supported in PLR thanks to Robert Kaptur from Adaptyv!
2
6
500
Science is too slow. At Edison, we are integrating AI Scientists into the full stack of research, from basic discovery to clinical trials. We want cures for all diseases by mid-century. We have raised a $70M seed to get started. Join us. We need cracked software engineers who want to work on finding cures rather than selling ads and generating slop. If you’re reading this, you’re probably a candidate. We need brilliant AI researchers who want to figure out how AI will accelerate real-world science. We need scientists and researchers with deep expertise in biology, biotech, and pharma who want to figure out how to integrate AI deeply into scientific workflows, from ideation to experimentation, and how to measure success or failure. We need extraordinarily talented generalist operators across BD, sales, product management, and partnerships who can focus on getting our tools into the hands of pharmaceutical companies. If any of these roles sound like you, get in touch. We are also expanding access to our platform. Our goal is to accelerate science writ large. To that end, we will continue to give academics and students 650 credits/mo indefinitely. I can’t promise we’ll keep this up forever, but we will try. Kosmos will still cost 200 credits, and the other agents (Analysis, Literature, etc.) will cost 1 or 2 credits. All paid users will have access to our regular agents, like our Analysis agent, Literature agent, and so on, for free via the UI. API access will still be paid, and users without a paid subscription will continue to get 10 credits per month for those agents. Our $200/mo subscription for 650 credits/mo is staying in place for now, but might be phased out at our next major product update. Along the lines of accelerating science, we’re also doing a major release of PaperQA today, our flagship open source literature agent, as part of our commitment to open science. In the short run, expect major improvements to Kosmos, including the ability to automatically access data, the ability to steer its exploration, and the ability to converse directly with its world model. In the long run, expect exponentially increasing rates of scientific discoveries, in biology and elsewhere. Our round is led by Triatomic Capital, Spark Capital, and a major US institutional biotech investor. We are also joined in this round by existing investors Pillar VC and Susa Ventures, two exceptional early-stage funds who backed us at founding, along with Striker Venture Partners, Hawktail VC, Olive VC, and a host of exceptional angels that includes famous AI researchers, the CEOs of multiple frontier AI labs, and leadership of major biotech and pharma companies.
133
163
48
1,529
246,560
Jon Laurent retweeted
Obviously a joke but the world where computation is separate from experiment will end. Tremendous progress on both fronts it will seem silly not to do both in the future just like it's silly today to do everything on CPU vs dedicated chips like GPU/T2 and how we "hardware encode" certain brain functions
I need a wetlab so that I can screen my submissions to protein design competitions before submitting
2
3
27
5,637
Replying to @btnaughton
Let me know if folks figure out what a virtual cell means.
2
1
1
80
3,663
Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially @ludomitch, @jonmlaurent, @cvi94 , @alexjandonian, and many more.
53
40
8
206
62,045
Kosmos is unlike any other agent we have at Edison, both in terms of outputs and infrastructure. Running at scale requires our platform to support order-of-magnitude swings in resource requirements, all unknown at submit time. Each run sees between 0 and 120 sandbox environments with up to 4 TB of memory, between 125 and 3,200 documents parsed, and timing between 1 hour and 32 minutes and 14 hours and 12 minutes. It's like a bad interview question!
3
17
5
72
22,229
The people have spoken! We're doubling the number of free credits for edu users to 1300, enough for six Kosmos runs + a bunch of agent runs. These expire after a month, so use them before they run out! Also, we are announcing a satisfaction guarantee. If your Kosmos run doesn't produce good results, we'll give you the credits back. This applies to all users. You'll see the new credits in your account shortly. If you want to claim credits under the satisfaction guarantee, contact us via our website. (We'll make some UI changes to make that easier soon.) Have fun, and share your results as you get them. xitter.cf/SGRodriques/status/198…
edu users: what would make it easier for you to try Kosmos? If you have other ideas, post them in the comments.
43%More free runs
17%Refunds for bad runs
11%Better tutorial
29%Show answers
118 votes • Final results
11
23
3
139
23,861
Our older agents, like Crow, Phoenix, and HasAnyone, are still available on our platform as Literature, Molecules, and Precedent, respectively, for 1-2 credits per run. We will be launching more powerful versions soon! (Falcon, our deep research agent, has merged with Crow.)
1
9
27
3,382
Edison Scientific is launching today, with our launch of Kosmos, the most powerful AI Scientist released yet. We are a spinout from FutureHouse, focused on building and commercializing AI agents for science. Try our newest agents, including Kosmos, on our platform today.
31
41
11
334
44,230
After two years of work, we’ve made an AI Scientist that runs for days and makes genuine discoveries. Working with external collaborators, we report seven externally validated discoveries across multiple fields. It is available right now for anyone to use. 1/5
194
537
96
3,670
923,117