
AI @Oracle | Ex- @WandAI_ @symbldotai @IBMResearch @ASU | Startup Advisor | AAAI Senior Member | Views my own
Seattle, WA
Joined June 2010
- Tweets1.7K
- Following364
- Followers693
- Likes697
Pinned Tweet
Check out our latest work (that @rasbt talks about in much detail in the post below) on "Concise Reasoning via Reinforcement Learning" -
Paper: arxiv.org/abs/2504.05185
Blog: wand.ai/blog/from-prolixity-…
As we all know by now, reasoning models often generate longer responses, which raises compute costs. Now, this new paper (arxiv.org/abs/2504.05185) shows that this behavior comes from the RL training process, not from an actual need for long answers for better accuracy. The RL loss tends to favor longer responses when the model gets negative rewards, which I think explains the "aha" moments and longer chains of thought that arise from pure RL training.
I.e., if the model gets a negative reward (i.e., the answer is wrong), the math behind PPO causes the average per-token loss becomes smaller when the response is longer. So, the model is indirectly encouraged to make its responses longer. This is true even if those extra tokens don't actually help solve the problem.
What does the response length have to do with the loss? When the reward is negative, longer responses can dilute the penalty per individual token, which results in lower (i.e., better) loss values (even though the model is still getting the answer wrong).
So the model "learns" that longer responses reduce the punishment, even though they are not helping correctness.
In addition, the researchers show that a second round of RL (using just a few problems that are sometimes solvable) can shorten responses while preserving or even improving accuracy. This has big implications for deployment efficiency.
Today in MTV: Panel w/ @vyas_sekar and Baolu Shen for Agents in Production.
We’ll discuss what comes after the demo: agents that deliver real value but remain controlled, secure, observable, and recoverable.
5:45pm PT, JJ Lake Business Center
Register: luma.com/00q9b0m0
Check out my latest article: Metering is Coming linkedin.com/pulse/metering-… via @LinkedIn
I will be speaking on this panel this afternoon at 12:15 pm PST on technical debt in agentic AI systems and the reality of deployments, especially at enterprise scale.
The conference is free to attend, you can register below:
datasciencedojo.com/agentic-…
See you at the conference!
A recent trend that I'm noticing with the emergence of LLMs: Engineers are increasingly isolating themselves from talking to outside teams and companies. That vacuum is now filled with enterprising product types who can now code a lot more, and want to build for customers' needs.
Kartik Talamadupula retweeted
Yochanites at @ #NeurIPS2025 🤗(two still en-route..)
Kartik Talamadupula retweeted
Call for ACM SIGAI Autonomous Agents Research Award 2026
The award is made for research excellence in autonomous agents, to recognise researchers whose current work is an important influence
Deadline: 15th Dec 2026
Nominate: forms.gle/RNLZgbbaPQe6TDsb6
#SIGAIAward
... for a coffee that robots are making. A python like queue for some java.
The reason AI progress is plateauing is because everyone is stuck standing in those long espresso lines.. #NeurIPS2025
Kartik Talamadupula retweeted
The reason AI progress is plateauing is because everyone is stuck standing in those long espresso lines.. #NeurIPS2025
Kartik Talamadupula retweeted
I think this award is tremendous and I am inspired by this year's awardee @shakir_za and the past recipients like Milind Tambe, and Stuart Russell for their efforts to advance AI for humanity. #aaai
The AAAI Award for Artificial Intelligence for the Benefit of Humanity recognizes the positive impacts of artificial intelligence to protect, enhance, and improve human life in meaningful ways with long-lived effects. This year, the AAAI Awards Committee is pleased to announce that the 2026 recipient of the award is Shakir Mohammed, for significant contributions to maximizing social benefit by empowering communities worldwide to learn, contribute, debate, and shape how AI is used. Learn more: aaai.org/about-aaai/aaai-awa…
Kartik Talamadupula retweeted
What a tour de force and gracious #NeurIPS2025 Test of Time talk by Kaimeng He! 🙏
Faced with a choice of a "prophet talk" or a "realistic talk", he says he went for the latter, and we are all the richer for it.
"I feel like I am in a ship in Atlantic. Everything ahead is unknown. There is no oracle. No prophet. And when it is discovered, I hope it becomes common knowledge."
Kartik Talamadupula retweeted
Wondering how to attend an ML conference the right way?
ahead of NeurIPS 2025 (30k attendees!) here are ten pro tips:
1. Your main goals:
(i) meet people
(ii) regain excitement about work
(iii) learn things
– in that order.
2. Make a list of papers you like and seek them out at poster sessions. Try to talk to the authors– you can learn much more from them than from a PDF.
3. Pick one workshop and one tutorial that sounds most interesting. Skip the rest.
4. Cold email people you want to meet but haven't. Check Twitter and the accepted papers list. PhD students are especially responsive.
5. Practice a concise pitch of unpublished research you're working on for "what are you interested in rn?". Focus on big unanswered questions and exciting new directions, *not* papers.
6. Skip the orals. Posters are a higher-bandwidth, more engaging, more invigorating. Orals are a good time to go for a walk or talk in the hallway.
7. for the love of god, do NOT work on other research in your hotel room. Save mental bandwidth for the conference. (This may seem obvious; you'd be surprised.)
8. Talk to people outside your area. There are many smart people working on niches <10 people understand. Learn about one or two that won't help your own work.
9. Attend one social each night. Don't overthink it or get caught up in status games. They're all fun.
10. Take breaks. You can't go to everything, and conferences consume more energy than a normal workweek.
hope this helps, and sad i'm not attending neurips, have fun :)
Kartik Talamadupula retweeted
🎙️ A new episode of The Information Bottleneck podcast!
This time we're trying something different, just AI news & paper discussions (no guest interview).
We talked about:
🏥 GPT-5 in medicine & healthcare AI risks
📦 Stanford's "Cartridges" paper on compressing KV caches
🔄 Continuous Autoregressive Language Models paper
📚 The Smol Training Playbook
Let us know what you think of this experimental format!
Kartik Talamadupula retweeted
born to build artificial intelligence
forced to debug python package installation
Kartik Talamadupula retweeted
first AI came for stackoverflow
and i did not speak out
due to their unpleasant moderators
then AI came for quora
and i did not speak out
because i never use quora
then AI came for Wikipedia
and i did not speak out
because i did not care
then AI came for AI research
and there was no one left
to speak for me
Kartik Talamadupula retweeted
people saying sf parties are lame simply aren't committing to the bit. three vc sponsored cocktails in and i genuinely care about this devtools launch
Kartik Talamadupula retweeted
Sometimes we forget that NVIDIA wins because it's a software company. DGX Spark is a reminder of that. It's a CUDA dev machine that's beautiful enough and small enough to be on my desk and with enough memory to fit a truckload of params.
It's not the fastest or best at anything, but it's great to develop on and transfer your final training run to a H/B200, final robotics policy to your Jetson, final inference to {nvidia/apple/amd/[favorite vendor]}.
✨ We were honored to deliver some of the very first NVIDIA DGX Sparks to AI Pioneer @ylecun and AI Researcher, @soumithchintala, from @Meta and @NYUniversity in NYC.
“Every PhD student in AI should have one of these,” said Yann.
We couldn’t agree more.
We are anticipating great things from their visionary AI research.
Learn more: nvda.ws/42EGKOM
#SparkSomethingBig 💫




























