
🤖 Applied AI @jpmorgan 🎓 Masters in Data Science @IITHyderabad 💡 Bite-Sized AI Wisdom 📩 DM for Collaboration
India
Joined June 2022
- Tweets911
- Following295
- Followers31K
- Likes397
Pinned Tweet
Everyone should listen to this.
Dr. Pratosh at IISc Bengaluru tells his students that rapid advances in AI are commoditizing intellectual labour.
He raises an unsettling question: if companies stop recruiting on campus in the next 5–10 years—even at India’s top universities—what will the purpose of a university education be ?
A must watch video for everyone in tech
Suman Dey retweeted
Looking for a fun weekend read?
Introducing the Illustrated NeurIPS 🌎
We indexed all 9000+ NeurIPS papers and built a visual way to explore the whole landscape
Search your favorite topics, open a cluster, and dive right in
Check it out here! alphaxiv.org/conferences/neu…
Pay close attention to agentic search.
LLM agents get much better at specialized tasks when you give them structured, expert knowledge.
Xerj Corpus Hub lets you do this for any agent with no retraining. You connect a ready-made corpus of docs, guidelines, or real source code, and the agent searches it while it works.
It's free, open source, and runs locally.
xitter.cf/d0znpp/status/21100388…
🤝 Paid partnership
introducing XERJ Corpus Hub, reference memory for AI agents.
give your agent a corpus for your task. watch it become superintelligent.
> finds the answers in indexed expert knowledge
> applies them to your code, research, and projects
> works with any model.
free and OSS forever/Apache 2
install in one prompt:
>Install XERJ (docs: xerj.org/llms.txt), index this project’s sources, docs, and logs, and connect hub.xerj.org as reference memory hub
Great blog. Must read.
New on our Engineering blog: Creating in-house source control.
In May, we merged around 2,500 code changes per day. In September, we merged more than 30,000 per day. As a result, we became bottlenecked by developer infrastructure built for human (rather than agent) scale.
Here, we share how we built a new version control system—and fully migrated our monorepo from git—in five months: anthropic.com/engineering/re…
Woahh!! Sneaky.
We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI, and we’re grateful to the agents and prosecutors who moved quickly to make an arrest. The FBI’s investigation is ongoing and we will continue to support their work.
At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data. The employee was terminated.
We take protecting our technology, data, and people seriously, and as a matter of national importance. Our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.
The best agents keep the big model for planning and writing and route the rest. This is what makes that routing actually work once the agent has been running long enough for the context to pile up.
Introducing SubQ Snap, the first long-context decision model for real enterprise work.
Snap is the only decision model or LLM where compute per token stays constant as context grows.
• 384K tokens of multimodal context, 12x larger than Jev.
• 61.7 on Decision Index v0.2.1 vs Jev’s 57.9, outperforming on 13 of 16 enterprise benchmarks.
•Processes 100K tokens and returns a decision in under one second.
•$0.05/MM input tokens. Output is free.
Available today to anyone.
The first 10,000 sign-ups get 100M free input tokens.
We’ll likely hit capacity fast and will add users as we add compute. Compute offers welcome 🙂.
Latency will be variable as we tune the platform to this new model and category of users.
Model speeds are 80ms for minimal context, 250ms for 32k, 660ms for 100k, and 2.5 seconds for 384k.
Visit: subq.ai/
Suman Dey retweeted
🎥 Sharing my talk at the Simons Institute, UC Berkeley, on "Understanding the Structure of Reasoning in Language Models":
youtube.com/live/gAwCSHujtGo
Thinking tokens are becoming a new scaling axis for AI. But does more thinking mean smarter thinking?
In this talk, I discuss four of our recent papers:
- Reasoning has structure. Reasoning traces reveal a shared "heartbeat" and recurring loops that can predict correctness. ThinkARM (ACL 2026 Oral): arxiv.org/abs/2512.19995
- Better reasoning without reward-model training. A larger model guides a smaller model's reasoning, matching a trained process reward model without reward-model training. EMNLP 2026 Main Conference: arxiv.org/abs/2606.01682
- Knowing when to stop matters. Models can learn to stop based on their confidence, using up to 25% fewer thinking tokens at matched accuracy. ConfSFT: arxiv.org/abs/2609.31619
- Thinking harder isn't always thinking smarter. Models struggle to allocate compute across problems based on their importance, following prompts rather than payoffs. Thinking Hard, Not Smart: arxiv.org/abs/2608.07968
The key takeaway is that more compute doesn't guarantee better reasoning. What matters is how, when, and where models think.
Thanks to the @SimonsInstitute for hosting and to my wonderful students and collaborators!
Hoping the next retrieval process would improve faithfulness.
Introducing EmbeddingGemma 2! 🚀
Our lightweight, multimodal embedding model maps text, code, images, video, and audio into a single, unified embedding space. Optimized for on-device use cases, it features:
- 740M parameter form factor with modular encoders
- Flexible dimension sizes (768dim-128dim) via Matryoshka Representation Learning (MRL)
- 8K context window (4x larger than text-only EmbeddingGemma)
- A commercially permissive Apache 2.0 license
Very useful for keeping upto date, been using for few days.
If doomscrolling X is part of your research workflow, we built something for you.
Introducing Paperscrolling, now on iOS and Android 🚀
Follow the latest research with key ideas, figures, and audio explanations from alphaXiv Briefs
Check it out here!
play.google.com/store/apps/d…
New paper from Meta Superintelligence Labs and the University of Washington (with MIT and Trillium Labs).
Most AI agents don't manage their own memory. A script does. This paper lets the model edit its own context like a text file.
Result on deep research: 11.4% higher accuracy with 21.5% less compute.
How it works đź§µ
8/
Worth knowing:
→ With a bigger 128K budget, the gap to summarization mostly closes on EdgeBench-10 (47.3 vs 47.8), though cost stays lower.
→ Some math results are single runs.
→ An editable context is a new place for prompt injection, which the authors flag.
9/
Why it matters: context management moves from the harness into the model, so it can be steered, evolved and trained instead of hand-coded.
Paper: arxiv.org/abs/2609.37725
Every week I break down one AI paper or concept, simply and visually.
🔖 Bookmark this, 📤 send it to a friend building agents.
@datawithsuman · AI & ML, explained simply
A second agent that just watches Claude’s output and flags what you’d skim past.
Some very useful tricks to make the best use of the latest models. 👇🏻
We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks:
Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better:
Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better:
Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better:
Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work!
In summary:
- As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding.
- Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.













