Timaeus retweeted
Please reach out if you’re interested in working with us! Sequent will have a large in-person presence in Berkeley, as well as researchers remote from London, Melbourne, and elsewhere. 🇺🇸🇬🇧🇦🇺
1. Full post: sequent.org/launch
2. Express interest: sequent.org/apply
Timaeus retweeted
I’m incredibly proud of what we’ve built with Timaeus and all the research we’ve accomplished. But given how much research will change over the next few years, it’s time to make another bet. 9/9
Timaeus retweeted
This is why a strong human component is still necessary in alignment research at Sequent. Maybe that’s you. You should consider dropping what you’re doing and helping. A lot of other theoretical and empirical research can be left to the ASI, but alignment can’t (responsibly).
Timaeus retweeted
“Neural networks are grown, not programmed”
We’re changing that. Mechinterp investigates how models generalize beyond their training data by studying the resulting internal structure. We introduce patterning as the dual: given desired structure, determine what data produces it.
Timaeus retweeted
Well, we haven't solved all the problems yet, so the offer stands...
If you want to solve deep scientific problems in AI safety, come work with me through the Pivotal Fellowship 1/4
Timaeus retweeted
Training Data Attribution (TDA) should account for learning dynamics! The same data can influence model behavior in dramatically different ways at different time points of training.
We call for a shift towards stagewise data attribution and the study of influence dynamics.
1/11
Using singular learning theory, we study how data shapes the structures that neural networks learn during training, and how those structures enable generalization.
This gives us a unique lens on interpretability and alignment.
xitter.cf/danielmurfet/status/19…
If you're excited to support our researchers and contribute to this agenda, apply today! airtable.com/appMGBqrZQpiKXR…
More details: timaeus.co/blog/updates/2025…
Timaeus retweeted
1/ AI is accelerating. But can we ensure that AIs truly share our values and follow our goals? We argue that aligning advanced AI systems requires cracking a core scientific challenge: how data shapes AI's internal structure, and how that structure determines behavior.
Timaeus retweeted
Our paper has been accepted to ICLR as a spotlight paper!
We introduced the refined Local Learning Coefficient, which measures “how much structure” there is in particular parts of the model associated to particular datasets or behaviors.
We’re hiring! We’re looking for research scientists, engineers, and a research lead to work on AI alignment through singular learning theory
More details: $70-140k, initially remote with possible relocation to Berkeley/London. Rolling applications until Feb 13th.
Announcement: lesswrong.com/posts/g8e4pz7a…
Apply directly: airtable.com/appMGBqrZQpiKXR…
Timaeus retweeted
1/8 How do transformers learn? In our new work, we find that transformers develop in-context learning in discrete stages that can be automatically discovered. 🧵
arxiv.org/abs/2402.02364
Joint work w/ @georgeyw_, Matthew Farrugia-Roberts, @lemmykc, Susan Wei, @danielmurfet



















