
CS prof @Penn & founder @Rabdos_AI: creating data for the worldโs hardest reasoning, from the chalkboard to the wet lab
Philadelphia, PA
Joined January 2019
- Tweets475
- Following385
- Followers2.5K
- Likes2.2K
Mayur Naik retweeted
We've released the weights for Beam!!
๐ค huggingface.co/reflection
๐ Model card: reflection.ai/beam-model-carโฆ
๐งช Try Beam in our playground & get an API key: platform.reflection.ai/playgโฆ
๐ AND we take open model safety seriously and have posted our safety report: reflection.ai/beam-safety-reโฆ
We built our first model!! Beam is a competitive text-only 501B-A23B MoE, openly released under the Apache 2.0 license
Itโs been fun scaling the production RL/OPD stack for this over the past year. Iโm so proud of the team! We attained exactly what we set out to do and ended up with a stable run on 10K GB300s that produced more than 100M rollouts across ~1M tasks that significantly improved the final performance of the model
๐ many more details in our announcement below :)
Mayur Naik retweeted
My team at @AnthropicAI is hiring: DevRel, but for scientists.
Run hackathons, build demos, and help us grow a community of researchers using Claude.
If you're a scientist who also loves to teach or post about AI for science, please apply!
job-boards.greenhouse.io/antโฆ
Mayur Naik retweeted
We're significantly expanding access to Gemini for scientists via antigravity - sign up now!
Top of mind question for scientists on data retention - please turn off telemetry if you'd like.
docs.google.com/forms/d/e/1Fโฆ
Excited to launch Gemini 4 Argon, designed to help with hardest coding and knowledge work tasks with its frontier capabilities..
For developers and enterprises, itโs available in the paid tier of the Gemini API and the Gemini platform, for Ultra subscribers in Google Antigravity, and Ultra and Pro subscribers in the Gemini app and Search.
Read more: blog.google/innovation-and-aโฆ
am thinking about what the future of a "math book" should be... heavy on graphics; with interactive elements (e.g. GPT Sites); dynamic references that auto-update N-times-per-year to reflect changes; self-repairing to fix errors...
not paper & not a pdf... maybe a github repo?
Mayur Naik retweeted
Penn CIS is hiring in security and AI systems! You can find the application here: cis.upenn.edu/open-faculty-pโฆ.
As in prior years, the committee doesn't care if you have few or many papers. They focus only on 2 or 3, so make sure that your application focuses on your best work!
I am at COLM'26 this week in San Francisco with my students as well as folks from @Rabdos_AI . We have three cool papers on timely and exciting topics; drop by if you are attending!
> MathDuels: A Self-Play Benchmark That Grows
arxiv.org/abs/2604.21916
Wednesday 11-1, Grand Ballroom #121
Leaderboard: mathduels.ai/
> Detecting Safety Violations Across Many Agent Traces
arxiv.org/abs/2604.11806
Thursday 11-1, Grand Ballroom #129
> Do We Need Frontier Models to Verify Mathematical Proofs?
arxiv.org/abs/2604.02450
Thursday 4:30-6:30, Imperial Ballroom #21
This is the first semester in my teaching career that I have been able to use LLMs to improve the learning experience.
One way Iโve been doing this is simply feeding my static slides from each lecture into an agentic framework to create live demos in class.
For my software analysis class (cis547.github.io/), I used Claude Code to demo different program correctness techniques, from random testing using AFL++ to theorem proving using Dafny. In the past, I spent hours just debugging the setup of these tools. Now Claude does it autonomously for me in *under 5 minutes*, giving me a standalone Docker container with a web UI.
Check out this demo of an automated debugging technique called Delta Debugging that I covered this week:
static.us.edusercontent.com/โฆ
As a bonus, you yourself learn subtle new things about the technical content. For me this happened with a concurrency fuzzing technique called PCT, where Claude showed how P(bug per run) is higher but rate of bugs per second is lower if you put threads to โsleepโ versus simply preempt them.
It is an even bigger privilege to be teaching in these times. LLMs can now do almost anything so it all comes down to instructor taste and judgment.
Huge congratulations to Adam, my recently graduated PhD advisee who worked on this newly minted model -- on the topic of safety which is becoming a big deal!
Beam is out! I feel extremely lucky to have been been part of this launch as part of the safety team for the past ~2 months. Itโs been a lot of looking deeply into model outputs and data, being surprised by what we see, and updating our evaluations and training recipes to fix the problems. Itโs amazing what has been achieved in so short a time, and I'm very excited for the road ahead!
What do surjective / injective functions have to do with optimizing and verifying ML kernels? Read on!
In math/logic foundations of CS, we learn early on about โsurjectiveโ and โinjectiveโ functions. Thereafter, most of us have only a hazy recollection of these words, let alone why we learnt them or if we will ever apply them. I was certainly in this camp.
Until recently, when I worked on proving equivalence of tensor programs with my amazing PhD student Paul Biberstein (paulbiberstein.me/) and colleague Joe Devietti: arxiv.org/abs/2609.19611.
Suppose you want to check if tensor programs P and Q are equivalent. This is decidable but intractable. Since 90% of time is spent in 10% of code, it is often the case that we can express P and Q as:
P = F o R o G
Q = F o S o G
for programs R and S such that checking R == S becomes tractable. At first glance, it seems that one can always strip F and G. But this turns out to be true only if F is surjective and G is injective! Hereโs why:
If R == S, then it is easy to see why P == Q.
But if R != S, there is an input X such that R(X) = Y and S(X) = Z and Y != Z. Lifting this counterexample to P and Q requires F to be surjective and G to be injective.
F is surjective means for all B: exists A: F(A) = B. So one can plug in B = X from the above counterexample and apply the inverse of F to it.
G is injective means X1 != X2 => G(X1) != G(X2). So one can plug in X1 = Y and X2 = Z in the above counterexample.
Putting these two together, we see that there exists an input A such that P(A) != Q(A). In other words, one can โliftโ the counterexample of R == S to a counterexample of P == Q provided F is surjective and G is injective.
When I first memorized things like โinjective == one-to-oneโ and โsurjective == ontoโ, I wish I had seen a practical example. In the LLM era, we have an opportunity to tailor explaining abstract concepts to individualsโ methods of learning.
My research group is building the formal machinery for optimizing and verifying ML kernels, and this paper is our first on this topic. It only scratches the surface of classic symbolic methods and math concepts one can bring to bear in this domain. A lot more to come in future months!
The status quo for R1 institutions cannot last. I'm guessing there will be a barbell distribution of focus that splits the classical research/teaching fusion we currently enjoy. A few OOM of improvement in AI and we might see:
1. The research side goes industrial -- applied mathematicians producing enormous bodies of interdisciplinary work; physical science labs running in warehouses with heavy robotics and automated data collection and processing; economics and social science simulations at extreme scales...
2. Teaching is top-quality, high-touch, personalized-service, with courses becoming works-of-art and top professors being superhuman performers and guides.
In short, each end of the research-teaching axis taken to extremes.
There are hints of this divergence already. At Penn, the two top schools (by $$$ & prestige) are the medical school (no undergraduate teaching; lots of heavy lab-based research at scale), and the business school (almost all teaching, highly profitable, most research occurring in pockets like the stats department at wharton).
Ramp that split with AI improving 100-fold and more, and we will see a vast bimodal transformation that integrates the university more with industry (large scale research) and serves students better (extremely attentive teaching).
Congrats to Anthropic on shipping Claude Opus 5.5! Here's an especially noteworthy article by Boris Cherny on using this model to formally verify the Claude Agent SDK using Lean.
Rabdos is an industry leader in creating high-quality Lean data; check out our benchmark at rabdos.ai/math-index/lean
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached.
TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt.
I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted.
Is formal verification the future of coding (or at least, bug finding)?
Mayur Naik retweeted
Congratulations to Anthropic on the release of Claude Opus 5.5! ๐
At Rabdos, we spend our days thinking about the hardest problems in math and science, so it's exciting to watch frontier reasoning keep advancing this quickly.
๐ฃ We're growing our team at Rabdos AI!
We're looking for a ๐ฅ๐ฒ๐๐ฒ๐ฎ๐ฟ๐ฐ๐ต ๐๐ป๐ด๐ถ๐ป๐ฒ๐ฒ๐ฟ to lead our work on mathematical formalization in Lean. You'd turn informal math into formal proofs and build autoformalization pipelines alongside frontier AI models, working with some of the sharpest mathematicians and computer scientists I know.
If you love Lean, rigorous math, and hard open problems, I'd love to hear from you. Please share with anyone who comes to mind! ๐
๐ฃ ๐ช๐ฒ'๐ฟ๐ฒ ๐ต๐ถ๐ฟ๐ถ๐ป๐ด! ๐ฅ๐ฒ๐๐ฒ๐ฎ๐ฟ๐ฐ๐ต ๐๐ป๐ด๐ถ๐ป๐ฒ๐ฒ๐ฟ โ ๐ ๐ฎ๐๐ต๐ฒ๐บ๐ฎ๐๐ถ๐ฐ๐ฎ๐น ๐๐ผ๐ฟ๐บ๐ฎ๐น๐ถ๐๐ฎ๐๐ถ๐ผ๐ป ๐ถ๐ป ๐๐ฒ๐ฎ๐ป
At Rabdos AI, we build research-level STEM tasks that stay beyond the reach of frontier AI models, even as those models approach millennium-prize-level problems. Founded by academics at the University of Pennsylvania, we've bootstrapped to $๐ฎ๐ฑ๐ ๐ถ๐ป ๐๐ฅ๐ฅ ๐ถ๐ป ๐น๐ฒ๐๐ ๐๐ต๐ฎ๐ป ๐ฎ ๐๐ฒ๐ฎ๐ฟ, and we're growing the team.
๐ช๐ต๐ฎ๐ ๐๐ผ๐'๐น๐น ๐ฑ๐ผ
๐น Lead the design and evaluation of methods that turn informal mathematical reasoning into formal proofs in Lean
๐น Build ๐ฎ๐๐๐ผ๐ณ๐ผ๐ฟ๐บ๐ฎ๐น๐ถ๐๐ฎ๐๐ถ๐ผ๐ป workflows and integrate them with frontier AI models
๐น Curate high-quality formal reasoning datasets alongside mathematicians and computer scientists
๐น Prototype, experiment, and iterate on tools that make formal verification scalable and reliable
๐ช๐ต๐ฎ๐ ๐๐ฒ'๐ฟ๐ฒ ๐น๐ผ๐ผ๐ธ๐ถ๐ป๐ด ๐ณ๐ผ๐ฟ
โ
Experience with formal theorem proving and autoformalization, ideally in ๐๐ฒ๐ฎ๐ป ๐ฐ
โ
๐๐ฟ๐ฎ๐ฑ๐๐ฎ๐๐ฒ-๐น๐ฒ๐๐ฒ๐น knowledge of mathematics or physics
โ
Experience building and improving AI systems such as LLM pipelines or evaluation tools
โ
A degree in CS, Math, Physics, or a related field (or equivalent research experience)
โ
Clear communication across disciplines and a commitment to rigorous validation
๐๐ผ๐ป๐๐ ๐ฝ๐ผ๐ถ๐ป๐๐
โ Strong Python skills
โ Familiarity with how LLMs are trained, fine-tuned, or evaluated
๐ง๐ต๐ฒ ๐ฑ๐ฒ๐๐ฎ๐ถ๐น๐
๐ ๐ข๐ป-๐๐ถ๐๐ฒ ๐ถ๐ป ๐ฃ๐ต๐ถ๐น๐ฎ๐ฑ๐ฒ๐น๐ฝ๐ต๐ถ๐ฎ | ๐๐๐น๐น-๐๐ถ๐บ๐ฒ | Start ASAP
๐ฐ $๐ญ๐ฑ๐ฌ๐ โ $๐ฎ๐ฎ๐ฑ๐ + ๐ฒ๐พ๐๐ถ๐๐ + performance bonuses paid multiple times a year
๐ฉบ Health insurance, a daily Uber Eats stipend, and a commute benefit
If your background is a good fit, we'll reach out within ๐ผ๐ป๐ฒ ๐ฏ๐๐๐ถ๐ป๐ฒ๐๐ ๐ฑ๐ฎ๐ to schedule an intro call.
๐ ๐๐ฝ๐ฝ๐น๐ ๐ต๐ฒ๐ฟ๐ฒ: rabdos.ai/apply/research-engโฆ
Know someone who'd be a great fit? Please tag them or share this post! ๐
Rabdos AI is an equal opportunity employer.
Are endpoint protection systems like CrowdStrike prepared for large-scale agentic workloads?
My research group has been running 100's of codex agents in parallel on a machine this summer. The agents are not coordinating (or at least aren't supposed to): each works on an independent research task in a STEM domain such as math, SWE, materials, biochem, ... In a matter of days, they have started tripping conventional security software in ways that have alarmed IT folks and are very hard to debug. The only solution seems to be to isolate the machine from the network, but that cuts off the agents from even basic web search.
This and recent incidents of agents running amok at frontier AI labs present a massive opportunity for research and startups in AI x security.
How do we specify / enforce security policies for agents? How do we triage alarms? Seems especially difficult since good vs. bad behavior is superficially indistinguishable : agents exploring how to use a low-level systems tool could be misconstrued as trying to breach security; a sequence of such seemingly random tool calls would pose an even greater challenge.
Feels like the early days of the wild west, and a harbinger of things to come ...
Every year I take an international trip, I measure in-flight internet connectivity as an indicator of global technological progress. 2026 represents a *huge* step up in this measure, entirely single-handedly due to @Starlink. They have essentially solved this problem from 0 to 1.














