Breakthrough AI to solve the world's biggest problems. › Join us: https://xitter.cf/t.co/MjUpZpKi8b › Newsletter: https://xitter.cf/t.co/k9gGznrVGL
Seattle, WA
Joined September 2015
- Tweets4K
- Following449
- Followers86.9K
- Likes3.6K
Pinned Tweet
AI’s biggest role in science may not be answering questions. It may be helping scientists find which questions are worth asking.
At @ProvSwedish, AutoDiscovery surfaced an unexpected immune signal in a heavily studied cancer dataset—and follow-up research confirmed it. 🧵
allenai.org/blog/swedish-aut…
Today we’re introducing FairStress, a benchmark for testing demographic fairness beyond a model’s final answer: how readily it changes a well-supported decision & how it explains its choice. 🧵
github.com/pardissz/fairstre…
Since LLMs have various biases in their decisions and reasoning, we then examined how training data might influence this, & find that LLMs are never really taught fair decision-making yet are often aligned to prevent discrimination—which may explain over-correction patterns.
We hope FairStress gives researchers a way to uncover hidden asymmetries in model decision-making, test fixes, & develop more consistent systems.
📝 Blog: allenai.org/blog/fairstress
📄 Paper: allenai.org/papers/fairstres…
Ai2 retweeted
Hugging Face is becoming more and more the home of AI x Science projects. Open source accelerates scientific discovery when models, datasets, and tools are shared openly, all researchers can reproduce them and build on top of them.
A big thanks to @allen_ai, @OpenMed_AI, and @NVIDIAAI for being the most active contributors of AI for Science artifacts on @huggingface these days!
🤗 Hugging science heatmap: huggingface.co/spaces/huggin…
What if you could simulate global extreme weather at 3 km resolution for ~1/300th the cost?
Our new HiRO-ACEv2 system does just that, while matching X-SHiELD’s statistics to within 3% even for events as rare as 1 in a million data points. 🧵
huggingface.co/allenai/HiRO-…
Together, ACE + HiROv2 can generate years of global climate data at resolutions fine enough to capture storms, severe winds, & other local extreme events.
And it’s cheap: global 3 km simulations cost ~300× less than X-SHiELD, with even bigger savings for individual regions.
Next, we want HiRO-ACEv2 to work across more climates—not just the one it was trained on.
We’re training it on observed-weather & +4°C datasets, adding outputs like temperature, snow, & ice + exploring ways to make HiROv2 10×+ faster.
Read more: buff.ly/NAfRlQI
Kai Van Brunt adapted Molmo 2, our open model for video understanding, to a domain far outside its training data: sonar video of salmon.
Meet Molmo2Fish, a prototype that tracks fish + can correct some of its mistakes through natural-language guidance. 🧵
allenai.org/blog/molmo2fish
Kai fine-tuned Molmo 2 on sonar video then trained it on examples of tracking errors, instructions, & corrections.
In tests, Molmo2Fish could fix some mistakes after guidance—for example, when two salmon had been assigned the same track.
Another benchmark, another #1 for MolmoAct 2! 🤖🏆
Our robot policy tops @datapointai’s human-preference rankings for real-world manipulation tasks, including candy sorting & cup stacking.
Thanks to the Datapoint AI team for the evaluation & open dataset!
the full dataset is free and open: huggingface.co/datasets/data…
overall and category-wise rankings of 9 robot policies are available on our robot bench: trydatapoint.com/benchmark/l…
Proud to support AI research for protein design and drug discovery alongside @UWProteinDesign and colleagues at the University of Washington.
