Pinned Tweet
Interested in shaping how models behave? Start with these accessible resources that lay out how major AI labs think about model behavior.
Open Evals retweeted
If an AI developer was on track to lose control of its internal agents, would anyone outside the company know?
Today, we are sharing METR’s vision for how we would work with AI developers to openly assess and share evidence about this.
very interesting read
I wrote about the state of AI, why I’m concerned about the next few years, and the choices we need to make to keep the future in humanity’s hands.
An Alien Mind: openai.com/index/an-alien-mi…
Open Evals retweeted
I am finishing a book with @patchenbarss that gives a non-technical explanation of how AI works and explains why it is dangerous and what we should do about it.
@VikingBooks @VikingBooksUK
penguinrandomhouse.com/books…
Open Evals retweeted
Releasing the model weights and technical report of Kimi K3.
Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window.
New model architecture: 2.5x the intelligence per unit of compute, not just more params.
Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale.
Model weights: huggingface.co/moonshotai/Ki…
Tech report: github.com/MoonshotAI/Kimi-K…
Tech blog: kimi.com/blog/kimi-k3
Open Evals retweeted
Working on AI Evals? We're excited to welcome @HamelHusain for a community talk! Come join us: luma.com/q8lan58u
Open Evals retweeted
Today, we are introducing Inkling.
Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available.
thinkingmachines.ai/news/int…
Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵
Open Evals retweeted
Submissions for the NeurIPS 2026 Creative AI Track are now open! Don’t forget to submit your research papers/artworks by August 3, 2026 (AoE).
We invite submissions exploring emerging applications, methods, and critical perspectives on AI and machine learning in art, design, and creative practice.
For details, see: neurips.cc/Conferences/2026/…
Open Evals retweeted
To keep pace with AI progress, we're advancing how we study Claude's economic impact.
Hourly sampling and survey data show us how the cadences of life shape usage, what people produce with Claude, and how perceptions of AI's impact may be changing. anthropic.com/research/econo…
simulating human behavior
The advanced civilizations of sci-fi legend (Banks, Asimov, etc) have some form of simulation to guide society.
@joon_s_pk is taking a crack at building that simulator with @simile_ai.
As Joon's cofounder @percyliang puts it: great science starts with a great measurement. From Smallville in 2023 to today, Simile is trying to build the Hubble Telescope equivalent for simulating human behavior.
00:00 Introduction
01:49 Building Generative Agents
02:29 Valentines Day Emergence
03:33 From GPT 3 To Agents
05:03 Social Computing Problem
06:19 Social Simulacra Subreddits
07:57 Models Getting Good Enough
08:57 Humans Are Not Rational
10:04 Turning Research Into Simuli
11:55 Validation And Accuracy Proof
12:43 Customer Workflow CVS Example
16:11 Why Collect Real Data
17:51 Behavioral Signals And RCTs
21:52 Use Cases And Second Order Effects
26:31 Evaluating Convergence Divergence
31:58 Big Societal Simulations Ahead
36:08 Future Of Simulation
Open Evals retweeted
Congratulations! 🐡
Human intelligence is fundamentally a collective intelligence. We solve complex problems by participating in a vast cultural network that builds upon ideas across generations.
I believe the strongest AI systems will become a collective intelligence, too.
Since we started Sakana AI, our core conviction has been that the most powerful AI systems will be collaborative ecosystems, not isolated monoliths. Evolution innovates under constraints, and the future belongs to systems that explicitly learn how to coordinate collective intelligence.
Today, we are taking a major step toward that future with the launch of Sakana Fugu.
Fugu dynamically orchestrates the world’s best models to tackle complex tasks. We are proving that a well-orchestrated pool of swappable agents can match restricted frontier models like Fable and Mythos.
But Fugu is about more than just performance. I believe that Orchestration Models are the next frontier, beyond bigger models.
Relying on a single company’s model for national infrastructure is a massive risk. As recent export controls have shown, access to top models can disappear overnight.
Collective intelligence is the practical hedge against this concentration of power. Fugu simply routes around vendor restrictions by relying on an entirely swappable agent pool.
I am incredibly proud of our Tokyo team for shipping this. By orchestrating the world’s models, we are delivering the resilient blueprint required for AI sovereignty.
Read our full vision and results here:
sakana.ai/fugu-release 🐡
Open Evals retweeted
Domain experts—as judged by the questions they ask and vocabulary they use about a subject—are more likely to see success.
But the gap between intermediate and expert users is quite modest, suggesting that proficiency in a domain is sufficient to code successfully within it.
We’re sharing new research on a method for anticipating how models may behave in real-world use before release: simulating deployment with recent, de-identified user requests and studying candidate model responses. openai.com/index/deployment-…
Open Evals retweeted
Our latest economic research introduces a framework for tracking Claude Code as it scales.
Who is using Claude Code, and what are they using it for? How is the value of tasks changing? And how much does domain expertise shape whether a session succeeds?
anthropic.com/research/claud…
"Private reinforcement learning environments should let models grow stronger on real traces from inside the organization. Its knowledge base makes institutional memory queryable and use of tokens more efficient.
This loop becomes the new IP of the firm. I think of it as a hill climbing machine. And unlike most assets, it compounds."
Open Evals retweeted
Beautiful paper from Google DeepMind.
Explains the pathways from AGI to ASI, and why that jump could happen through several routes.
The authors frame the AGI-to-ASI transition around 4 technical pathways:
- continued scaling of compute, model size, data, and test-time inference;
- algorithmic paradigm shifts beyond today’s transformer-based foundation-model stack;
- recursive self-improvement, where AI accelerates AI R&D and improves future systems; and
- multi-agent collective intelligence, where large populations of specialized agents coordinate into a superhuman group agent.
Scaling may work for a while, but it could hit limits in data, compute, energy, or weaker returns from making systems larger.
Recursive improvement is the most uncertain path, because AI could speed up AI research, but that loop may also slow if hard research problems need real-world testing, scarce hardware, or new ideas.
Multi-agent collectives may be the most underappreciated path, because a society of competent digital workers could outperform a brilliant individual model through specialization, speed, and coordination.
The big point is that ASI may not arrive as 1 sudden event, but as a chain of faster changes as AI helps create better AI and stronger scientific tools.
----
Link – arxiv. org/abs/2606.12683
Title: "From AGI to ASI"
Open Evals retweeted
Evaluating AI Agents -- come join us next week! meetup.com/machine-learning-… @DeepLearningAI @arizeai
Open Evals retweeted
cool work evalevalai.com/infrastructur…
Open Evals retweeted
AI is advancing at a pace our policymaking institutions were never built for—and the gap between the two is becoming the central challenge of the technology. In his latest essay, our CEO Dario Amodei lays out how to close it.
We're launching three new initiatives to support the efforts he outlines.
Today I'm publishing a new essay, Policy on the AI Exponential. AI is progressing extremely fast—much faster than the policy process was built to handle. The essay lays out where I think the technology is now, and the action needed to close the gap: darioamodei.com/post/policy-…
Open Evals retweeted
Today I'm publishing a new essay, Policy on the AI Exponential. AI is progressing extremely fast—much faster than the policy process was built to handle. The essay lays out where I think the technology is now, and the action needed to close the gap: darioamodei.com/post/policy-…





















