CS prof @Penn & founder @Rabdos_AI: creating data for the worldโ€™s hardest reasoning, from the chalkboard to the wet lab

Philadelphia, PA
Joined January 2019
Mayur Naik retweeted
We've released the weights for Beam!! ๐Ÿค— huggingface.co/reflection ๐Ÿ“„ Model card: reflection.ai/beam-model-carโ€ฆ ๐Ÿงช Try Beam in our playground & get an API key: platform.reflection.ai/playgโ€ฆ ๐Ÿ“š AND we take open model safety seriously and have posted our safety report: reflection.ai/beam-safety-reโ€ฆ
We built our first model!! Beam is a competitive text-only 501B-A23B MoE, openly released under the Apache 2.0 license Itโ€™s been fun scaling the production RL/OPD stack for this over the past year. Iโ€™m so proud of the team! We attained exactly what we set out to do and ended up with a stable run on 10K GB300s that produced more than 100M rollouts across ~1M tasks that significantly improved the final performance of the model ๐Ÿ‘‡ many more details in our announcement below :)
8
32
2
255
16,132
My team at @AnthropicAI is hiring: DevRel, but for scientists. Run hackathons, build demos, and help us grow a community of researchers using Claude. If you're a scientist who also loves to teach or post about AI for science, please apply! job-boards.greenhouse.io/antโ€ฆ
32
47
4
553
39,187
Mayur Naik retweeted
We're significantly expanding access to Gemini for scientists via antigravity - sign up now! Top of mind question for scientists on data retention - please turn off telemetry if you'd like. docs.google.com/forms/d/e/1Fโ€ฆ
Excited to launch Gemini 4 Argon, designed to help with hardest coding and knowledge work tasks with its frontier capabilities.. For developers and enterprises, itโ€™s available in the paid tier of the Gemini API and the Gemini platform, for Ultra subscribers in Google Antigravity, and Ultra and Pro subscribers in the Gemini app and Search. Read more: blog.google/innovation-and-aโ€ฆ
8
8
1
100
7,020
Mayur Naik retweeted
am thinking about what the future of a "math book" should be... heavy on graphics; with interactive elements (e.g. GPT Sites); dynamic references that auto-update N-times-per-year to reflect changes; self-repairing to fix errors... not paper & not a pdf... maybe a github repo?
23
11
1
101
5,148
Penn CIS is hiring in security and AI systems! You can find the application here: cis.upenn.edu/open-faculty-pโ€ฆ. As in prior years, the committee doesn't care if you have few or many papers. They focus only on 2 or 3, so make sure that your application focuses on your best work!
9
53
4,898
I am at COLM'26 this week in San Francisco with my students as well as folks from @Rabdos_AI . We have three cool papers on timely and exciting topics; drop by if you are attending! > MathDuels: A Self-Play Benchmark That Grows arxiv.org/abs/2604.21916 Wednesday 11-1, Grand Ballroom #121 Leaderboard: mathduels.ai/ > Detecting Safety Violations Across Many Agent Traces arxiv.org/abs/2604.11806 Thursday 11-1, Grand Ballroom #129 > Do We Need Frontier Models to Verify Mathematical Proofs? arxiv.org/abs/2604.02450 Thursday 4:30-6:30, Imperial Ballroom #21
4
355
This is the first semester in my teaching career that I have been able to use LLMs to improve the learning experience. One way Iโ€™ve been doing this is simply feeding my static slides from each lecture into an agentic framework to create live demos in class. For my software analysis class (cis547.github.io/), I used Claude Code to demo different program correctness techniques, from random testing using AFL++ to theorem proving using Dafny. In the past, I spent hours just debugging the setup of these tools. Now Claude does it autonomously for me in *under 5 minutes*, giving me a standalone Docker container with a web UI. Check out this demo of an automated debugging technique called Delta Debugging that I covered this week: static.us.edusercontent.com/โ€ฆ As a bonus, you yourself learn subtle new things about the technical content. For me this happened with a concurrency fuzzing technique called PCT, where Claude showed how P(bug per run) is higher but rate of bugs per second is lower if you put threads to โ€œsleepโ€ versus simply preempt them. It is an even bigger privilege to be teaching in these times. LLMs can now do almost anything so it all comes down to instructor taste and judgment.
3
16
949
Huge congratulations to Adam, my recently graduated PhD advisee who worked on this newly minted model -- on the topic of safety which is becoming a big deal!
Beam is out! I feel extremely lucky to have been been part of this launch as part of the safety team for the past ~2 months. Itโ€™s been a lot of looking deeply into model outputs and data, being surprised by what we see, and updating our evaluations and training recipes to fix the problems. Itโ€™s amazing what has been achieved in so short a time, and I'm very excited for the road ahead!
2
31
1,025
What do surjective / injective functions have to do with optimizing and verifying ML kernels? Read on! In math/logic foundations of CS, we learn early on about โ€œsurjectiveโ€ and โ€œinjectiveโ€ functions. Thereafter, most of us have only a hazy recollection of these words, let alone why we learnt them or if we will ever apply them. I was certainly in this camp. Until recently, when I worked on proving equivalence of tensor programs with my amazing PhD student Paul Biberstein (paulbiberstein.me/) and colleague Joe Devietti: arxiv.org/abs/2609.19611. Suppose you want to check if tensor programs P and Q are equivalent. This is decidable but intractable. Since 90% of time is spent in 10% of code, it is often the case that we can express P and Q as: P = F o R o G Q = F o S o G for programs R and S such that checking R == S becomes tractable. At first glance, it seems that one can always strip F and G. But this turns out to be true only if F is surjective and G is injective! Hereโ€™s why: If R == S, then it is easy to see why P == Q. But if R != S, there is an input X such that R(X) = Y and S(X) = Z and Y != Z. Lifting this counterexample to P and Q requires F to be surjective and G to be injective. F is surjective means for all B: exists A: F(A) = B. So one can plug in B = X from the above counterexample and apply the inverse of F to it. G is injective means X1 != X2 => G(X1) != G(X2). So one can plug in X1 = Y and X2 = Z in the above counterexample. Putting these two together, we see that there exists an input A such that P(A) != Q(A). In other words, one can โ€œliftโ€ the counterexample of R == S to a counterexample of P == Q provided F is surjective and G is injective. When I first memorized things like โ€œinjective == one-to-oneโ€ and โ€œsurjective == ontoโ€, I wish I had seen a practical example. In the LLM era, we have an opportunity to tailor explaining abstract concepts to individualsโ€™ methods of learning. My research group is building the formal machinery for optimizing and verifying ML kernels, and this paper is our first on this topic. It only scratches the surface of classic symbolic methods and math concepts one can bring to bear in this domain. A lot more to come in future months!
3
6
23
1,812
Mayur Naik retweeted
The status quo for R1 institutions cannot last. I'm guessing there will be a barbell distribution of focus that splits the classical research/teaching fusion we currently enjoy. A few OOM of improvement in AI and we might see: 1. The research side goes industrial -- applied mathematicians producing enormous bodies of interdisciplinary work; physical science labs running in warehouses with heavy robotics and automated data collection and processing; economics and social science simulations at extreme scales... 2. Teaching is top-quality, high-touch, personalized-service, with courses becoming works-of-art and top professors being superhuman performers and guides. In short, each end of the research-teaching axis taken to extremes. There are hints of this divergence already. At Penn, the two top schools (by $$$ & prestige) are the medical school (no undergraduate teaching; lots of heavy lab-based research at scale), and the business school (almost all teaching, highly profitable, most research occurring in pockets like the stats department at wharton). Ramp that split with AI improving 100-fold and more, and we will see a vast bimodal transformation that integrates the university more with industry (large scale research) and serves students better (extremely attentive teaching).
4
9
1
81
9,050
Congrats to Anthropic on shipping Claude Opus 5.5! Here's an especially noteworthy article by Boris Cherny on using this model to formally verify the Claude Agent SDK using Lean. Rabdos is an industry leader in creating high-quality Lean data; check out our benchmark at rabdos.ai/math-index/lean
I used Opus 5.5 to formally verify the Claude Agent SDK using Lean. A couple short prompts = 16 PRs fixing various bugs and race conditions. Video attached. TLA+ also works well. I sometimes combine Lean and TLA+ to look for issues around data flow, concurrency, and state mgmt. I don't know either language well, but Claude is excellent at both. This approach is super useful for formally modeling your code and finding bugs that a human probably wouldn't have spotted. Is formal verification the future of coding (or at least, bug finding)?
1
11
1,054
Mayur Naik retweeted
Congratulations to Anthropic on the release of Claude Opus 5.5! ๐ŸŽ‰ At Rabdos, we spend our days thinking about the hardest problems in math and science, so it's exciting to watch frontier reasoning keep advancing this quickly.
Introducing Claude Opus 5.5, the first model in our new Claude 5.5 family. It performs at the level of Claude Fable 5.1 for most tasks, and costs 40% less to run than Opus 5.
1
2
10
1,292
๐Ÿ“ฃ We're growing our team at Rabdos AI! We're looking for a ๐—ฅ๐—ฒ๐˜€๐—ฒ๐—ฎ๐—ฟ๐—ฐ๐—ต ๐—˜๐—ป๐—ด๐—ถ๐—ป๐—ฒ๐—ฒ๐—ฟ to lead our work on mathematical formalization in Lean. You'd turn informal math into formal proofs and build autoformalization pipelines alongside frontier AI models, working with some of the sharpest mathematicians and computer scientists I know. If you love Lean, rigorous math, and hard open problems, I'd love to hear from you. Please share with anyone who comes to mind! ๐Ÿ‘‡
๐Ÿ“ฃ ๐—ช๐—ฒ'๐—ฟ๐—ฒ ๐—ต๐—ถ๐—ฟ๐—ถ๐—ป๐—ด! ๐—ฅ๐—ฒ๐˜€๐—ฒ๐—ฎ๐—ฟ๐—ฐ๐—ต ๐—˜๐—ป๐—ด๐—ถ๐—ป๐—ฒ๐—ฒ๐—ฟ โ€” ๐— ๐—ฎ๐˜๐—ต๐—ฒ๐—บ๐—ฎ๐˜๐—ถ๐—ฐ๐—ฎ๐—น ๐—™๐—ผ๐—ฟ๐—บ๐—ฎ๐—น๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ถ๐—ป ๐—Ÿ๐—ฒ๐—ฎ๐—ป At Rabdos AI, we build research-level STEM tasks that stay beyond the reach of frontier AI models, even as those models approach millennium-prize-level problems. Founded by academics at the University of Pennsylvania, we've bootstrapped to $๐Ÿฎ๐Ÿฑ๐—  ๐—ถ๐—ป ๐—”๐—ฅ๐—ฅ ๐—ถ๐—ป ๐—น๐—ฒ๐˜€๐˜€ ๐˜๐—ต๐—ฎ๐—ป ๐—ฎ ๐˜†๐—ฒ๐—ฎ๐—ฟ, and we're growing the team. ๐—ช๐—ต๐—ฎ๐˜ ๐˜†๐—ผ๐˜‚'๐—น๐—น ๐—ฑ๐—ผ ๐Ÿ”น Lead the design and evaluation of methods that turn informal mathematical reasoning into formal proofs in Lean ๐Ÿ”น Build ๐—ฎ๐˜‚๐˜๐—ผ๐—ณ๐—ผ๐—ฟ๐—บ๐—ฎ๐—น๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป workflows and integrate them with frontier AI models ๐Ÿ”น Curate high-quality formal reasoning datasets alongside mathematicians and computer scientists ๐Ÿ”น Prototype, experiment, and iterate on tools that make formal verification scalable and reliable ๐—ช๐—ต๐—ฎ๐˜ ๐˜„๐—ฒ'๐—ฟ๐—ฒ ๐—น๐—ผ๐—ผ๐—ธ๐—ถ๐—ป๐—ด ๐—ณ๐—ผ๐—ฟ โœ… Experience with formal theorem proving and autoformalization, ideally in ๐—Ÿ๐—ฒ๐—ฎ๐—ป ๐Ÿฐ โœ… ๐—š๐—ฟ๐—ฎ๐—ฑ๐˜‚๐—ฎ๐˜๐—ฒ-๐—น๐—ฒ๐˜ƒ๐—ฒ๐—น knowledge of mathematics or physics โœ… Experience building and improving AI systems such as LLM pipelines or evaluation tools โœ… A degree in CS, Math, Physics, or a related field (or equivalent research experience) โœ… Clear communication across disciplines and a commitment to rigorous validation ๐—•๐—ผ๐—ป๐˜‚๐˜€ ๐—ฝ๐—ผ๐—ถ๐—ป๐˜๐˜€ โž• Strong Python skills โž• Familiarity with how LLMs are trained, fine-tuned, or evaluated ๐—ง๐—ต๐—ฒ ๐—ฑ๐—ฒ๐˜๐—ฎ๐—ถ๐—น๐˜€ ๐Ÿ“ ๐—ข๐—ป-๐˜€๐—ถ๐˜๐—ฒ ๐—ถ๐—ป ๐—ฃ๐—ต๐—ถ๐—น๐—ฎ๐—ฑ๐—ฒ๐—น๐—ฝ๐—ต๐—ถ๐—ฎ | ๐—™๐˜‚๐—น๐—น-๐˜๐—ถ๐—บ๐—ฒ | Start ASAP ๐Ÿ’ฐ $๐Ÿญ๐Ÿฑ๐Ÿฌ๐—ž โ€“ $๐Ÿฎ๐Ÿฎ๐Ÿฑ๐—ž + ๐—ฒ๐—พ๐˜‚๐—ถ๐˜๐˜† + performance bonuses paid multiple times a year ๐Ÿฉบ Health insurance, a daily Uber Eats stipend, and a commute benefit If your background is a good fit, we'll reach out within ๐—ผ๐—ป๐—ฒ ๐—ฏ๐˜‚๐˜€๐—ถ๐—ป๐—ฒ๐˜€๐˜€ ๐—ฑ๐—ฎ๐˜† to schedule an intro call. ๐Ÿ‘‰ ๐—”๐—ฝ๐—ฝ๐—น๐˜† ๐—ต๐—ฒ๐—ฟ๐—ฒ: rabdos.ai/apply/research-engโ€ฆ Know someone who'd be a great fit? Please tag them or share this post! ๐Ÿ™ Rabdos AI is an equal opportunity employer.
3
2
10
1,284
Are endpoint protection systems like CrowdStrike prepared for large-scale agentic workloads? My research group has been running 100's of codex agents in parallel on a machine this summer. The agents are not coordinating (or at least aren't supposed to): each works on an independent research task in a STEM domain such as math, SWE, materials, biochem, ... In a matter of days, they have started tripping conventional security software in ways that have alarmed IT folks and are very hard to debug. The only solution seems to be to isolate the machine from the network, but that cuts off the agents from even basic web search. This and recent incidents of agents running amok at frontier AI labs present a massive opportunity for research and startups in AI x security. How do we specify / enforce security policies for agents? How do we triage alarms? Seems especially difficult since good vs. bad behavior is superficially indistinguishable : agents exploring how to use a low-level systems tool could be misconstrued as trying to breach security; a sequence of such seemingly random tool calls would pose an even greater challenge. Feels like the early days of the wild west, and a harbinger of things to come ...
2
271
Every year I take an international trip, I measure in-flight internet connectivity as an indicator of global technological progress. 2026 represents a *huge* step up in this measure, entirely single-handedly due to @Starlink. They have essentially solved this problem from 0 to 1.
3
13
1,575