Staff RS @ DeepMind | RL & meta-learning
London, UK
Joined November 2010
- Tweets2
- Following138
- Followers112
- Likes8
Pinned Tweet
Dataset curation for language models has long relied on brittle, hand-crafted rules. It's time for a more principled, automated approach.
Enter DataRater: a meta-learning framework that learns to value data based on downstream training efficiency. Great summary by Luisa below 👇
Excited to share our new paper, "DataRater: Meta-Learned Dataset Curation"!
We explore a fundamental question: How can we *automatically* learn which data is most valuable for training foundation models?
Paper: arxiv.org/pdf/2505.17895 to appear @NeurIPSConf
Thread 👇
Dan A. Calian retweeted
Excited to announce that our work on “Discovering state-of-the-art RL algorithms” is finally published in @Nature! In this work, we meta-learned RL algorithms at scale.
Paper: nature.com/articles/s41586-0…
Blog: google-deepmind.github.io/di…
See thread 👇