
Associate Professor @ColumbiaLaw | JD @StanfordLaw PhD @StanfordAILab | tech, law, data
Joined November 2018
- Tweets584
- Following879
- Followers1.6K
- Likes3.4K
Really excited to share that we have a new piece out in PNAS on legal AI benchmarking from an institutional perspective. Though a huge amount has been written on the technical aspects of benchmarking (e.g., picking metrics and building datasets), relatively less has been written on the institutional design of benchmarking.
The piece is about legal AI benchmarking specifically, but it contains two broader ideas which are important to larger conversations about AI governance.
(coauthored with @andystruct @christinestsang @chrmanning @JulianNyarko Daniel Ho)
Law folks: If you’re not using Claude Code or ChatGPT’s Codex, you have no idea what you’re missing. So I’m distributing my research tools that provide a huge boost to legal scholarship. Research assistance, cite-checking, proofreading, and more (thread):
danepps.github.io/legal-rese…
Neel Guha retweeted
New post, looking at typos in M&A agreements.
The basic finding is that certain lawyer-teams make more typos than others. Law firms effects, by contrast, are pretty small.
Neel Guha retweeted
I didn’t think it was possible! But it is:
The Even More Conservative Case for Class Actions!
balkin.blogspot.com/2026/10/…
Neel Guha retweeted
1. Our latest, Who Leads in Mass Litigation?, is forthcoming in the Harvard Law Review. With an incredible interdisciplinary team, we took a 20 year dive into lawyers steering multidistrict litigation--which accounts for ~40% of all filed federal cases. papers.ssrn.com/sol3/papers.…
After three years of work, I am honored to share that my dataset of US Secretary of State speeches (1997-2026) is public! Jay Revolinsky and I introduce a novel corpus of all remarks delivered by US SoS's throughout the post-Cold War (~17,700 speeches).
github.com/revolins/sos-corp…
Neel Guha retweeted
🧵Today, I’m presenting our work on building safe and verifiable AI for the Superior Court of Los Angeles at the Ninth AAAI/ACM Conference on AI, Ethics, and Society!
Our work was featured in the New York Times and I’m very excited to share it with the AI ethics community.
Neel Guha retweeted
Excited to share my new article on appropriations law and executive power, forthcoming in the @HarvLRev.
Comments are welcome! (Link below.)
Neel Guha retweeted
Today, we're killing the billable hour for patent work.
Fearn Legal (@fearnlegal ) is a modern patent firm built from the ground up on our own operating system, FearnOS.
What that means:
→ Flat fees, not hourly billing
→ Drafts in days, not months
→ Experienced patent attorneys reviewing every application
→ One platform for your entire portfolio, with permissions you control
If you're building something worth protecting, we'd love to help.
Neel Guha retweeted
The days of waiting weeks for a patent are over.
Today we’re launching Fearn, a modern patent firm with flat fees, turnaround in days, and human expertise embedded in every part of the application cycle, all built on our own operating system, FearnOS.
One detail I'm especially proud of: in our editor, expert edits can't be overwritten by AI. Technology executes the mechanical work while people make the judgment calls. That's how we move fast without cutting corners.
Legal services are at an inflection point. We think founders deserve a new standard, and we're excited to start delivering it.
Today, we're killing the billable hour for patent work.
Fearn Legal (@fearnlegal ) is a modern patent firm built from the ground up on our own operating system, FearnOS.
What that means:
→ Flat fees, not hourly billing
→ Drafts in days, not months
→ Experienced patent attorneys reviewing every application
→ One platform for your entire portfolio, with permissions you control
If you're building something worth protecting, we'd love to help.
Once math is solved, I’m looking forward to AI soon solving all the big open questions in law, such as whether the U.S. Constitution protects stuff that conservatives like or stuff that liberals like.
We’re working with an independent advisory group of mathematicians to help OpenAI responsibly share advances in AI and mathematics.
The group will advise on how we assess and communicate new mathematical results, uphold academic and professional standards, and build tools that support mathematical research and learning.
Through this work, we want mathematicians to be at the center of shaping how AI supports mathematical understanding and how its benefits reach the wider community.
openai.com/index/advisory-gr…
Neel Guha retweeted
Delighted to share my latest article, "The Jailhouse Bar." It's about how prisons regulate jailhouse lawyers, and the bar's surprising response. It's headed to @StanLRev
in 2027 and will be my job talk paper this fall. Here's a recent draft: papers.ssrn.com/sol3/papers.….
Really delighted to share that I've been named one of the "Top 50 Legal Innovators in Academia" by @natlawreview and Wickard. It’s a privilege to be amongst friends, colleagues, and other individuals I’ve long looked up to!
natlawreview.com/article/202…
Neel Guha retweeted
I recently gave a talk introducing young economists to post-training.
The slides are now up! kawine.github.io/assets/aies…
Not only is post-training your own model more doable than ever, but economists and other social scientists can play a big part in the next era of post-training.
The post-training suite looks roughly like:
1) SFT
2) Offline Methods (DPO/KTO/SimPO/etc)
3) Online Methods (PPO/GRPO/CISPO/etc)
4) RL Environments
5) Distillation (<--- we are here)
6) World Adaptation (<--- the future)
As agents are deployed in the real world, the real world will adapt to them. This adaptation is largely overlooked by the current post-training paradigm because working with verifiable rewards from static environments is much simpler and scalable. As we saw with the OpenAI-Huggingface incident however, we shouldn't assume that the real world will remain fixed---quite the opposite, in fact. So:
1. How can we anticipate real-world adaptation during post-training?
2. What do equilibria look like in these scenarios, if there are any at all?
3. What tools can be created to scale up human oversight?
Many such questions abound, and if you're an economist, these are high-impact problems worth studying.
This is such a neat idea! I was curious about what the implications for legal reasoning are, so I compared the 5B LittleLearner model to the unfiltered baseline model on LegalBench. Pretty big performance gaps across the board!
What happens when an LLM never sees material beyond fifth grade?
We trained a 5B LittleLearner model from scratch on LittleCurriculum, a corpus restricted to K–5 material, to make this question testable.🧵
💬 Chat with LittleLearner yourself: littlelearner-ll.github.io


































