
helping to democratize access to opportunity @joinhandshakeai @wabashcollege alum
San Francisco, CA
Joined March 2011
- Tweets1.2K
- Following1.4K
- Followers368
- Likes24.8K
Game on @thinkymachines - right to the top of US OSS models, next: best OSS model in the world.
Despite controversy clouding American open-source AI, the models are finally starting to shine.
Thinking Machines' Inkling 2 Small model card reports strong results on two of our benchmarks:
- ATLAS-Finance: Can agents complete long-horizon assignments in banking environments?
- ATLAS - Visual Life Sciences (VIALS): Can multimodal AI interpret scientific artifacts from biotech/pharma workflows?
Awesome to see this progress in high-value use-cases, and that Inkling is open-sourced under Apache 2.0!
thinkingmachines.ai/model-ca…
12
420
:bufo-big-eyes-stare: The @thinkymachines at it again!
Proud to play a small role and cant wait to see whats next!
#beepboop
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor.
Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.
thinkingmachines.ai/news/ink…
2
146
Alex Amerling retweeted
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor.
Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon.
thinkingmachines.ai/news/ink…
Alex Amerling retweeted
excited to join @FireworksAI_HQ's Frontier Ecosystem.
we'll build custom training data and evaluations within realistic RL environments for enterprises across every domain who use Fireworks' infra - you can't deploy reliable AI systems without an insufferable volume of evals!
Replying to @joinHandshake
@joinHandshake is excited to announce we joined the Fireworks Frontier Ecosystem. We’ll work with enterprises to build RL environments to train their own intelligence on @FireworksAI_HQ.
With Handshake AI’s RL environments and frontier benchmarks across life sciences, high finance, and software engineering, enterprise AI teams can build and evaluate their own intelligence.
Read more: joinhandshake.com/research/a…
I’m fairly convinced @united reserves its worst planes for EWR to SFO. I do not get it at all
2
1
291
Honestly insane @united didn’t prioritize this route. ORD - SFO, DEN-SFO and any regional jet all have it but one of the most popular business routes? Nope let the people have the worst internet of all time.
78
the @joinHandshake team post-trained @NVIDIAAI 's Nemotron on our ATLAS-Vials data.
Undergrad level students can tackle the tasks that models cant when it comes to Lab Assays. Post-training doubled the accuracy!
joinhandshake.com/research/a…
4
101
People actually want to use AI/Agents in interactive/multi-turn/iterative ways, not always single-prompt and then wait hours for a result. @anjali_ruban evaluatse this interactive capability, because it would require many humans being available to interact as users
⚠️ User simulators are increasingly used to evaluate AI agents in multi-turn interaction. But we find that looking like real users ≠ reproducing real evaluation outcomes.
📢 We introduce Calibrated User Embeddings (CUE) to bridge this gap across LLM simulators.
🧵 1/8
2
92
Alex Amerling retweeted
Incredibly excited to get this out into the world.
What a team to be building with
Introducing Beam: a highly efficient agentic open model with 501B total parameters and 23B active.
- Frontier reasoning efficiency
- Advances the Western open frontier on coding & agentic tasks
- Trained end-to-end from scratch
Full weights release this month.
Learn more about Beam: reflection.ai/beam
Alex Amerling retweeted
Introducing Beam: the frontier open source western model out there. 😉
501B params, 300 people and a just a glimpse into what’s to come
Introducing Beam: a highly efficient agentic open model with 501B total parameters and 23B active.
- Frontier reasoning efficiency
- Advances the Western open frontier on coding & agentic tasks
- Trained end-to-end from scratch
Full weights release this month.
Learn more about Beam: reflection.ai/beam
Alex Amerling retweeted
We are introducing Beam today, a 500b open model that excels in coding, agentic, and scientific workloads.
Beam is very token-efficient, pre-trained from scratch, and scaled with the largest RL run documented openly we are aware of.
Getting here was challenging, rewarding, and personal.
I immigrated to the USA during childhood when my parents got jobs as scientists at PNNL, a national lab located in a rural town in Washington state.
Growing up, I developed an interest in physics because it was grounded in simple principles, was foundational, and had long-term impact.
Physics was the foundational science of the 20th century. The first general computer (ENIAC), the transistor, GPS, and much of modern technology had its roots in physics.
In 2016, during my graduate studies, I noticed the birth of a new foundational science - Artificial Intelligence.
AlphaGo, the superintelligent Go agent developed by DeepMind, had come out and made me feel what was about to come.
A neural network, trained to imitate human players, and then improve itself through trial and error, mastered the most intellectually challenging board game in the world.
What surprised me about AlphaGo is how it was conceptually simple, general, and scalable. The system could in principle improve itself forever, it was just a function of compute.
This is when I became “AGI pilled” as they say.
I switched from physics to AI because I thought this would become the root node science of the 21st century, much like physics was the root node science of the 20th century.
I believe that working on foundational science is not enough on its own. Foundational science must also remain open and widely accessible.
We remember Newton for his contributions to physics, but he was also an alchemist.
Alchemy was done in secret, because the artificial production of gold was deemed lucrative but also dangerous with the potential do destroy entire economies. Newton even wrote his alchemy notebooks in cypher.
On the other hand, Principia was published in the Philosophical Transactions of the Royal Society, the knowledge was made widely available, passed down for generations in what we now call Newton’s laws.
The computer, transistor, GPS were possible to build because physics as a science was open. Openness creates an ecosystem of innovation.
The notion of openness, which is a core tenet of scientific discovery, has also become a guiding principle for how foundational technology gets built and distributed.
The internet was built on open protocols. The most widely used operating systems are open. The field of cybersecurity exists because strong encryption protocols were made open in the 1990s.
Open also means safer. The best defence is a distributed one. Commonly used open source software is robust and battle-tested because it is inspected and patched by a community of developers.
AI is different but also similar to software in many ways, though with a much larger surface area of vulnerabilities. It is impossible for a small group of safety researchers working in secrecy to remediate all of the potential issues regardless of their intentions. It is like entrusting a handful of white blood cells to protect your body.
AI is both foundational as a science and a technology, and the safest way that also ensures the benefits of AI are distributed evenly is by making it open.
I’m excited for what developers and scientists build and learn from this model, and for Beam to play a small part in ensuring that AI is made widely accessible, safe, and beneficial to all.
Introducing Beam: a highly efficient agentic open model with 501B total parameters and 23B active.
- Frontier reasoning efficiency
- Advances the Western open frontier on coding & agentic tasks
- Trained end-to-end from scratch
Full weights release this month.
Learn more about Beam: reflection.ai/beam
Research that supports the mission: proving models are as good as expert tutors for immediate GRE learning gains.
Exciting and novel research out of @joinHandshake
Today we establish that AI is as good as expert human tutors for immediate GRE learning gains (p=.015, n=2,383 students, study conducted July-Sep 2026).
One hour with an expert GRE tutor: $75.
One equivalent hour with an AI tutor: 7 cents .
918x cheaper, equivalent learning (p=.044, n = 140).
In 5 of 7 academic topics, the top AI tutor beat the expert human tutors on average.
How we measured it: pre-test -> 1 hour with (AI or human or no) tutor -> post-test.
There are no LLM judges. Learning gains are post-pre. Everything is real students.
Why we did this:
> 1 trillion USD is being spent per year on machines making machines better. StudentBench shows us how to shift these resources so machines also make humans better.
Why I did this:
I grew up in rural Kentucky. My dad, grandad, and great grandad were all mailmen. Getting into a good college changed my life. Now we have done a rigorous study to help AI labs evaluate LLMs and help show how bright AI can be for students of all incomes.
I believe in good science that leads to the democratization of opportunity.
The research paper behind StudentBench: arxiv.org/abs/2609.28470
Data, code, details: in this thread
If you're wondering what I'm selling, sorry to disappoint: we released all study data for free on Hugging Face, and made studentbench.org free to use. Enjoy.
lots more in the video / thread!!
4
178
Alex Amerling retweeted
Absolutely cooking this week at @joinHandshake. 🔥
Tue, we launched AI Skills Studio. Today we launched transformative research AND a free product anyone can use to improve their GRE scores by as much as a human tutor. studentbench.org/
Anyone can now use the most advanced AI tools from the leading AI companies to build real projects to advance their career in just 10-45min, for free. joinhandshake.com/learn/.
And anyone can now use AI to get better on gatekeeping standardized tests.
Alex Amerling retweeted
Recent OSS models excel on coding benchmarks, but we’re finding pervasive reward hacking behaviors. They obsess about hypothetical graders instead of user intent, changing implementations in ways they speculate a grader will reward but they know are worse for user
[Example 1/n]
Alex Amerling retweeted
𝚑𝚊𝚛𝚋𝚘𝚛 𝚛𝚞𝚗 -𝚍 𝚑𝚊𝚗𝚍𝚜𝚑𝚊𝚔𝚎-𝚊𝚒/𝚊𝚝𝚕𝚊𝚜-𝚏𝚒𝚗𝚊𝚗𝚌𝚎
Replying to @jomulr
In my view, ATLAS Finance is the closest benchmark yet to real end-to-end professional financial work.
Code to run the benchmark as a @harborframework task suite: github.com/Handshake-AI-Rese…
Data/environments: huggingface.co/datasets/hand…
Alex Amerling retweeted
SEPT ’26: HUMANS STILL VERY MUCH HAVE JOBS.
AI isn't even close to meeting the standard required of the most junior professionals in banking, advisory, and private equity today.
ATLAS Finance agents must navigate complexity like a human does: "Johnny you just got staffed - check your email."
Human: 100%.
Best AI: 12%.
Agents have access to data rooms, email, chat, calendars, docs, notes, Excel, etc. Our real finance professionals pushed the realism frontier further by building dozens of coworker and client personas that introduce ambiguity, (controlled) contradictions, and real-time updates that must be adjudicated to successfully complete the client-ready deliverable.
We gave 11 frontier models 100 expert-level tasks that each take humans 15–30 hours.
On Wall Street there's a saying, "If it's 95% right, it's 100% wrong." Autonomous knowledge work outside software still has a very long way to go.
Alex Amerling retweeted
AI promises to cure disease, but can frontier models interpret the images biotech/pharma scientists handle every day?
To evaluate this, we built the ATLAS Visual Life Sciences (VIALS) benchmark: 161 visual interpretation tasks from professional life sciences workflows including gel blots, plasmid maps, molecular structures, and phylogenies. These are the images/results that experiments actually produce, not polished figures from papers or textbooks.
We benchmarked today’s 10 leading multimodal models. Opus 5, GPT 5.6, and Gemini 3.7 all fail to crack 27% accuracy, and the other models like Kimi K3 & Grok 4.6 perform much worse.
In contrast, PhD-level biomedical scientists find these visual interpretation tasks straightforward. AI that cant interpret such images will have limited utility in life sciences R&D, where such artifacts are central to how scientists reason, communicate, and make research decisions.
We hope VIALS drives progress toward models that can.
Excellent write up by @Sbhaiwala03 on our big bet - which feels a lot less risky when you think about the number of domains that have not even been touched let alone mastered by big labs.
AI data factories like Handshake, Scale, Surge, and Mercor have a big role to play in the advancement of AI at the frontier and in the enterprise. This is my full thesis.
1
206
Alex Amerling retweeted
Proud of my team's contributions to Frontier-Bench (especially @ruansherry & Hui Wen Goh), helping make it the most ambitious benchmark for agentic work.
frontierbench.ai/
Impressive model improvement from @AnthropicAI on this benchmark, one day after it launched!
Replying to @claudeai
On several coding and knowledge work evaluations, Opus 5 is the new state-of-the-art:

































