
neuroscientist @berkeley_ai. NIH K00 + UC Presidential Postdoctoral Fellow
Unceded Muwekma Ohlone Land
Joined August 2020
- Tweets596
- Following668
- Followers1.7K
- Likes2.4K
Pinned Tweet
excited to share some recent work!
tldr; models trained on multi-view sensory data are the first to match human-level 3D shape perception—all zero shot, with no training on experimental data/images
project page: tzler.github.io/human_multiv…
1/🧠
tyler bonnen retweeted
"Video models are world simulators."
Ok — can they predict a ball bouncing off another ball, off another ball? 🤨
We find standard video diffusion breaks down as the chain of dependent events lengthens — and more compute isn't the fix.
Meet the seriality gap. 🧵
1/n
tyler bonnen retweeted
What if you could turn any number of photos (3, 8, 15, or even 60) into one clean 3D surface (pts & mesh) with Flow Matching?
Check out our new work, Surflo: Consistent 3D Surface Flow Model with Global State. 🧵
1/n
🔗anttwo.github.io/surflo/
tyler bonnen retweeted
Scaling laws describe how loss changes with scale. Do neurons inside models change predictably too?
We study vision and language models up to 30B params and find systematic scaling in neuron universality, specialization, and selectivity.
Paper+code: avdravid.github.io/rosetta-n…
1/n
tyler bonnen retweeted
I'm at #CVPR2026 presenting our ✨AutoGaze highlight✨ with @baifeng_shi this week!
- talk @ GAZE workshop (🗓️Thurs 2:30p📍room 711)
- poster #258 (🗓️Sat 11:45a📍Exhibit Hall F)
stop by or reach out to chat about vision+cogsci and modeling human vision :D
Humans can see in high-res, high-FPS in real-time. Why can't VLMs?
Introducing AutoGaze: ViTs/VLMs "gaze" only at key video regions! Up to 4-100x token savings, 19x speedup, and enables scaling to 4K-res 1K-frame videos.
📄 arxiv.org/abs/2603.12254
🌐 autogaze.github.io
🤗 huggingface.co/collections/b…
(1/n)🧵
tyler bonnen retweeted
1/ New preprint with @dyamins + team! Ventral visual representations within areas evolve over the course of the response along the same hierarchical complexity axis that distinguishes the visual areas, potentially driven by local recurrence.
biorxiv.org/content/10.64898…
1/ How do we see 3D shape — for grasping, reaching, navigating — when the world is constantly in motion? We started with one piece of this puzzle—how the brain recovers surface geometry from dynamic input. New preprint, a joint effort from Josh Tenenbaum’s and Jim DiCarlo’s labs at MIT. (1/6)
doi.org/10.64898/2026.05.13.…
tyler bonnen retweeted
We developed a simple, sample-efficient online RL technique for post-training image generation models. We see it as a possible steerable alternative to CFG, driven by any scalar reward, including human preference.
tyler bonnen retweeted
New paper: Back into Plato’s Cave
Are vision and language models converging to the same representation of reality? The Platonic Representation Hypothesis says yes. BUT we find the evidence for this is more fragile than it looks.
Project page: akoepke.github.io/cave_umwel…
1/9
tyler bonnen retweeted
The shell game is a fun challenge that cannot be solved by looking at a single frame. The model has to track every move, from the moment the object is hidden. Excited to share this!
tyler bonnen retweeted
1/ Most model-brain comparisons only ask: can the model predict the brain? — without also checking the reverse direction. When you map in both directions, differences between models emerge that were previously invisible. In prior work, we showed there's a deeper principle behind bidirectional mapping: we should compare models to brains the same way we compare real brains to each other 🧵
The missing half of the neural network–brain comparison
For a decade, the standard benchmark for artificial neural networks as models of the brain has been forward predictivity: learn a linear mapping from model activations to neural recordings and measure explained variance. Top models of the macaque inferior temporal (IT) cortex—central to object recognition—have plateaued near 50% regardless of architecture.
Muzellec and Kar argue this plateau hides something important. Two models can score identically on forward predictivity while relying on fundamentally different internal strategies. One may have many units tightly coupled to IT responses; the other may reach the same score with a smaller aligned subset while carrying a large pool of biologically inaccessible dimensions.
To expose this, they introduce reverse predictivity: instead of asking how well model features predict neurons, they ask how well IT neurons predict individual model units. A truly brain-like model should be bidirectionally predictable—just as two monkeys' IT populations predict each other symmetrically, which the authors confirm as their empirical baseline.
Across 39 architectures—CNNs, transformers, self-supervised and robust models—reverse predictivity is consistently lower than forward predictivity and the two metrics are uncorrelated. Strikingly, higher ImageNet accuracy predicts lower reverse predictivity. Adversarial training helps; higher dimensionality hurts. The "common" units identified this way predict primate behavior more consistently across species and models than the "unique" ones inaccessible from neural activity.
For AI in drug discovery, neurotechnology, or computational biology, this has a direct implication: forward accuracy alone does not guarantee that a model's internal representations are embedded in the biological system it claims to describe. When those representations guide mechanistic interpretations or experimental decisions, the mismatch can mislead.
Paper: Muzellec et al., Nature Machine Intelligence (2026) | nature.com/articles/s42256-0…
tyler bonnen retweeted
Our review on AI for protein engineering is out now, about this too-fast-moving field full of hype and overclaim, yet one that is having a real impact on the world and can be described in a coherent manner without histrionics
science.org/eprint/666XRGRCV…
tyler bonnen retweeted
What’s the right representation for a world model? 3D, pixels, or something else?
Excited to release our new paper “Forecasting Motion in the Wild” where we propose point tracks as tokens for generating complex non-rigid motion and behavior
From @GoogleDeepmind @Berkeley_AI @TTIC_Connect
tyler bonnen retweeted
When people share a space, their movements become intertwined. Embodied agents need to understand these social dynamics to interact effectively.
Introducing MAGNet 🧲, a unified autoregressive diffusion forcing model for multi-agent motion generation that captures these interactions.
MAGNet is flexible: predict the future, fill in missing motion, or have people react to each other, all while naturally scaling to N>2 people and generating ultra-long motion sequences.
tyler bonnen retweeted
Excited to finally be releasing AutoGaze! Check it out autogaze.github.io/ (and 👀 the video demo)
Humans can see in high-res, high-FPS in real-time. Why can't VLMs?
Introducing AutoGaze: ViTs/VLMs "gaze" only at key video regions! Up to 4-100x token savings, 19x speedup, and enables scaling to 4K-res 1K-frame videos.
📄 arxiv.org/abs/2603.12254
🌐 autogaze.github.io
🤗 huggingface.co/collections/b…
(1/n)🧵
tyler bonnen retweeted
Humans can see in high-res, high-FPS in real-time. Why can't VLMs?
Introducing AutoGaze: ViTs/VLMs "gaze" only at key video regions! Up to 4-100x token savings, 19x speedup, and enables scaling to 4K-res 1K-frame videos.
📄 arxiv.org/abs/2603.12254
🌐 autogaze.github.io
🤗 huggingface.co/collections/b…
(1/n)🧵
tyler bonnen retweeted
I recently gave a talk at the AI@MIT reading group on our NeurIPS 2025 paper: arxiv.org/abs/2506.08010
We identify the neural mechanism behind attention sinks and propose a training-free mitigation.
Video: youtube.com/watch?v=Ea7mfn78…
Slides: tinyurl.com/5hffwre2
tyler bonnen retweeted
𝗢𝗻𝗲 𝗺𝗲𝗺𝗼𝗿𝘆 𝗰𝗮𝗻’𝘁 𝗿𝘂𝗹𝗲 𝘁𝗵𝗲𝗺 𝗮𝗹𝗹.
We present 𝗟𝗼𝗚𝗲𝗥, a new 𝗵𝘆𝗯𝗿𝗶𝗱 𝗺𝗲𝗺𝗼𝗿𝘆 architecture for long-context geometric reconstruction.
LoGeR enables stable reconstruction over up to 𝟭𝟬𝗸 𝗳𝗿𝗮𝗺𝗲𝘀 / 𝗸𝗶𝗹𝗼𝗺𝗲𝘁𝗲𝗿 𝘀𝗰𝗮𝗹𝗲, with 𝗹𝗶𝗻𝗲𝗮𝗿-𝘁𝗶𝗺𝗲 𝘀𝗰𝗮𝗹𝗶𝗻𝗴 in sequence length, 𝗳𝘂𝗹𝗹𝘆 𝗳𝗲𝗲𝗱𝗳𝗼𝗿𝘄𝗮𝗿𝗱 inference, and 𝗻𝗼 𝗽𝗼𝘀𝘁-𝗼𝗽𝘁𝗶𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻.
Yet it matches or surpasses strong optimization-based pipelines. (1/5)
@GoogleDeepMind @Berkeley_AI
tyler bonnen retweeted
📢 PhD position in Developmental Language Modelling (plz RT🙏)
What can human language acquisition teach us about training language models? Join us as a PhD!
4 yrs, fully funded, MPI-NL; april 3
mpi.nl/career-education/vaca…
these findings provide a computational bridge between cognitive theories and current practices in deep learning
we talk about some of these connections in the manuscript, but there are so many exciting questions to explore at the intersection of cog/comp/neuro science
it's amazing working with @akanazawa and @JitendraMalikCV!!
manuscript: arxiv.org/abs/2602.17650
project page: tzler.github.io/human_multiv…
code: github.com/tzler/human_multi…
benchmark: huggingface.co/datasets/tzle…


























