Often found scribbling down math with intermittent bursts of bashing out code.

New York City, USA
Joined June 2011
Do you want to do a Postdoc developing new methods/theory in Optimization for deep learning/ML? Do you enjoy bluesky open research and discussions on black boards? Then Apply to the Flatiron Fellowship in the Center of Computational Mathematics simonsfoundation.org/flatiro… 1/3
1
7
1
27
5,830
Robert M. Gower retweeted
📣 We are excited to announce the workshop Emerging Directions in Probabilistic Modeling: Methods and Scientific Applications 📅 Oct. 5–7, 2026 📍 Flatiron Institute & IBM Research, NYC Applications are welcome by Aug. 22: edpmworkshop.github.io
2
21
2
83
13,094
Robert M. Gower retweeted
I am looking for the amazing postdocs to advance the foundations of optimization, machine learning, and AI. Requirement: - Outstanding training and track record in mathematics and computer science. - Stellar research track record in optimization, ML and AI, a closely related field. Supplementary info: richtarik.org/i_apply.html
Lead your independent research. Create global impact.​ Designed for exceptional early-career researchers, KAUST Global Fellowship offers the opportunity to pursue independent research in areas aligned with global priorities, including Health, Water, Energy, Food Security, AI, and Marine Science.​ Register your interest: kgfp.kaust.edu.sa/
1
8
1
34
5,527
We've been working for about a year now on how to port the core idea of Muon to LoRA (low rank) finetuning. If you're interested in Muon, preconditioned Muon, Lora, let me tell you about what we learned and our PoLoRA method arxiv.org/abs/2607.17620 nikhilgsh.github.io/polora/
6
27
2
164
14,050
We have a lot of experiments and tests in the paper on learning rate transfers, different data sets from Math, coding to Bengali! Check out our paper, arxiv.org/pdf/2607.17620 and blogpost for. more nikhilgsh.github.io/polora/ Work led by @nikhilghosh101 and Tetiana Parshakova.
2
1
13
443
@nikhilghosh101 was the driving force behind this— deriving the method to running the experiments. He was determined to make something that works at scale and beats Adam in both time and steps. Try his code and watch your GPUs go brrr: github.com/nikhilgsh/polora
2
130
Looking for some original acoustic Brazilian songs? Check out my cousins new channel. Her songs and voice are amazing. She's going to be star. youtube.com/@apenasveri?si=k…
323
Robert M. Gower retweeted
Poster today at 5pm! #ICML2026
"It's easier to tune the LR for method A than for B." We tried to formalize this for model-based stochastic optimization methods. We find a key quantity, called stability index, that describes how stable a (weakly) convex bound is as a function of LR. 📚arxiv.org/abs/2602.09842
3
1
25
2,925
Robert M. Gower retweeted
"It's easier to tune the LR for method A than for B." We tried to formalize this for model-based stochastic optimization methods. We find a key quantity, called stability index, that describes how stable a (weakly) convex bound is as a function of LR. 📚arxiv.org/abs/2602.09842
3
9
2
72
10,496
And now we are very proud and humbled to have received the ICLR 2026 Honorable Mention award for this work blog.iclr.cc/2026/04/23/anno… Very fun to have found this useful math nugget that can actually speed-up LLM training.
Are you interested in the new Muon/Scion/Gluon method for training LLMs? To run Muon, you need to approximate the matrix sign (or polar factor) of the momentum matrix. We've developed an optimal method *The PolarExpress* just for this! If you're interested, climb aboard 1/x
10
60
4,213
Very happy that this has now been accepted to ICML2026! Great, systematic work done by @CrichaelMawshaw
We've just finished some work on improving the sensitivity of Muon to the learning rate, and exploring a lot of design choices. If you want to see how we did this, follow me ....1/x (Work lead by the amazing @CrichaelMawshaw)
4
46
3,644
And now we got the Honorable paper mention of ICLR 2026 for our work on Muon+PolarExpress!
Are you interested in the new Muon/Scion/Gluon method for training LLMs? To run Muon, you need to approximate the matrix sign (or polar factor) of the momentum matrix. We've developed an optimal method *The PolarExpress* just for this! If you're interested, climb aboard 1/x
1
3
59
3,743
Robert M. Gower retweeted
Check out my poster today (Thurs) at 11am--2pm session. Exhibit Hall C,D,E Poster Location: #602 "Fisher meets Feynman: score-based variational inference with a product of experts" (NeurIPS spotlight) with @gowerrobert David Blei and Lawrence Saul @FlatironInst #NeurIPS2025
2
10
1
64
5,524
Robert M. Gower retweeted
We’re recruiting for both postdoc and open-rank positions. Learn more about ML@CCM 👉 users.flatironinstitute.org/… I’ll also be in San Diego for NeurIPS — feel free to DM if you’re interested in #AIforScience or #GenerativeAI
Want to do fundamental ML research in NYC? 🧠 The Center for Computational Mathematics @FlatironInst @SimonsFdn is hiring! – Flatiron Research Fellow (postdoc, by Dec 1): apply.interfolio.com/173401 – Open Rank (by Jan 15): apply.interfolio.com/173640
1
3
27
4,933