Ge Gao retweeted
Will be in SF for #CoLM2026! I’m presenting GIANTS and Librarian Agents (more to come soon 👀).
Interested in test-time adaptation, learning in open-ended environments, and self-improvement.
Also, would be on the job market this year. Feel free to reach out (dms open)!
🚨🚨New Paper: Generative Insight Anticipation from Scientific Literature
Human scientists achieve breakthroughs by "standing on the shoulders of giants," synthesizing profound insights from disparate sources. While LMs show promise in scientific discovery, they currently struggle to reliably generate ideas of true impact, diversity, and feasibility.
Introducing "insight anticipation," a novel task challenging LLMs to generate a downstream paper's core scientific contribution directly from its foundational prior works. We also introduce GIANTS-4B, an RL-trained model that significantly outperforms frontier models at this task! 🧵⬇️
Ge Gao retweeted
✨New work on off-policy evaluation with synthetic trajectories: PERRY (Policy Evaluation with Confidence Intervals using Auxiliary Data), accepted to TMLR!✨
TL;DR: we incorporate fully synthetic trajectories into off-policy evaluation (OPE) and develop two methods to learn valid confidence intervals over the policy value.
Paper: arxiv.org/abs/2507.20068
Authors: @Aishwarya_R_M , @jasonjmeng , @GeGaoCS , @JiankaiSun , @MacSchwager, @BeEngelhardt , @EmmaBrunskill
Ge Gao retweeted
Excited to release our latest paper, Maximizing Mutual Information Between Prompt and Response Improves LLM Performance With No Additional Data (in short, MIPO), which has been accepted to ICML 2026!
tl;dr Can we build a data augmentation method analogous to translation and rotation in computer vision for training LLMs without external verifiers or human supervision? We show that generating chosen responses from correct prompts and rejected responses from misspecified (random!) prompts can provide promising training signals.
w/ @AimeeLiS @natashajaques
paper: arxiv.org/abs/2603.19294
code: github.com/nam630/mutual_inf…
Ge Gao retweeted
Introducing EXPO-FT – Efficient, Reliable & Open-Source VLA Finetuning!
EXPO-FT unlocks π0.5 for challenging manipulation tasks:
Routing string lights & inserting the power connector to illuminate them
Striking pool ball into pocket
Inserting flower into wine bottle
(1/5)
Ge Gao retweeted
Heading to ICLR today and excited to be presenting two papers! 🇧🇷
If you’re interested in self-improving agents, lifelong learning, exploration, or just want to connect, I’d love to chat. DMs are open!
👇 I’ll be presenting:
📝 RLAD: Training LLMs to Discover Abstractions for Solving Reasoning Problems
📅 04/23, 3:15 PM | Pavilion 3, Poster #1413
📝 FSPO: Few-Shot Optimization of Synthetic Preferences Personalizes to Real Users
📅 04/23, 10:30 AM | Pavilion 3, Poster #1509
Ge Gao retweeted
Scientists often make breakthroughs by synthesizing ideas across papers. In our new paper, we ask whether a language model can anticipate this process: given two parent papers, can it generate the core insight of a future paper built on them? 🧵⬇️
Ge Gao retweeted
And our 3rd workshop poster is on off policy RL selection!
ARLET RL Workshop (Rm 31abc) 3:30 p.m
Behavior-Aware Off-Policy Selection in High-Stake Human-Centric Environments
w/G.Gao, Aishwarya Mandyam, Joy He-Yueuya & Min Chi #NeurIPS2025
Ge Gao retweeted
I’m recruiting several PhD students at Carnegie Mellon University!
If you’re interested in LLM reasoning, agents, or diffusion language models, consider applying to the CMU ECE PhD program.
Applications are due Dec 15.
ece.cmu.edu/admissions/gradu…
Ge Gao retweeted
Could the way a student interacts with educational software in the first few hours predict their success months later? A new study suggests it's possible. hai.stanford.edu/news/assess…
Ge Gao retweeted
We’ve released updated 2024 lectures from my Stanford RL CS234 class! shorturl.at/pf427
This includes a guest lecture on Direct Preference Optimization (DPO) from 1st authors @rm_rafailov @archit_sharma97 @ericmitchellai tinyurl.com/3kr4czth Thanks to @StanfordOnline!
Ge Gao retweeted
Replying to @anjalie_f
Thanks for sharing. I've added it as a reference in here:
yisongyue.medium.com/checkli…
Ge Gao retweeted
Morning, everyone! The COMPLETE #SIGCSE2021 program is now LIVE! Check it out now.
sigcse2021.sigcse.org/schedu…
Ge Gao retweeted
📢 Applications for the 2021 GMG Summer Fellowship are now open!
Don't miss this opportunity to make a lasting difference, gain XP, mentor some amazing kids — all from home! 🏠
Open to ages 18+, all genders
Apply here: buff.ly/2NfveFP
#RT Spread the word!