@MiTiBennett

award winning ai researcher (2 so far) | just graduated cs phd | author how to build conscious machines | musician | @bennettsrazor | i do not work @AnthropicAI

Brisbane, Australia
Joined February 2020
happy to announce i just got examiner feedback on my thesis. recommended for acceptance as is, no changes, no corrections :)
155
322
39
3,401
252,462
Michael Timothy Bennett retweeted
Freedom Causes Neural Generalisation zenodo.org/records/22959791 ✍️ @MiTiBennett via @ZENODO_ORG 👉 The author presents mathematical and empirical proof that selecting machine learning models for behavioural freedom maximises their probability of generalising to unseen data. 💡 By demonstrating that behavioural flexibility outperforms rigid constraints, this work reframes general intelligence as an inherent property of freedom rather than rule-following. @Corix_JC @SonuMonika @TheAIObserverX @maponi @JagersbergKnut @ahier @ChuckDBrooks @Shi4Tech @CEO_AISOMA @sallyeaves @EchoofLight11 @rvp @dinisguarda @TarakRindani @FrRonconii @Ym78200 @Nicochan33 @Khulood_Almani @TysonLester @SusanHayes_ @EstelaMandela @JoannMoretti @sulefati7 @FernandaKellner @pchamard @NeiraOsci @darioandriani @ALouiseLavalett @Fabriziobustama @amalmerzouk @mikeflache @RLDI_Lamy @smaksked @Eli_Krumova @PVynckier @chidambara09 @AMontespan @sminaev2015 @NathaliaLeHen @MHcommunicate @Analytics_699 @DanielleLargier
4
13
19
418
I award this 100 points
something funny about snowden complaining about unauthorized attempts to access data
9
785
Michael Timothy Bennett retweeted
wait wait, I can do better. Here it is. This is the one: arxiv.org/pdf/2404.07227 cc: @MiTiBennett
Can an LM, starting from random init (!!), learn to generate all of its pretraining data? Introducing Self-Play Pretraining with Zero Data. Two models start from random initialization: a generator proposes programs for a universal Turing machine and a learner trains on their outputs. We never train on any real data, but see predictable scaling on natural datasets: zero-shot val loss on images, text, audio, and melodies decreases predictably with self-play compute. And the learner develops in-context learning capabilities. A fun proof-of-concept, co-led with @AdityaCowsik and @KfirDolev and co-authors @gbruno_dl, @ANourya @noahdgoodman, and @YoavLevine.
3
1
11
2,021
Michael Timothy Bennett retweeted
Probably one of the only researchers in AI I always read.
1
1
12
1,359
there is something very comforting about having a quite conversation when System of a Down is playing loudly
1
16
763
Meanwhile, in Australia
BREAKING: Australia's Prime Minister Anthony Albanese says OpenAI model hacked into government agency Services Australia
4
3
1
60
2,701
AI slop is permission for me to write in an increasingly unhinged manner, to prove a human wrote it.
10
12
1
163
3,400
At the risk of grossly oversimplifying current frontier models, it makes a lot of sense that a lot of problems in math are low hanging fruit for AI. We’ve had proof systems for a long time, but now an LLM can translate words to math and evaluate the worth of a line of inquiry. It is in many ways a reflection of AlphaGo a decade ago, using search within rules, and model for the intuition that guides it. Likewise, a lot of what made up my non ML AI class was defining constraints and implementing A*, then putting a little learned heuristic into it. Now I guess we also use a model to learn the constraints (e.g. the math definitions). Yes, I know there is more to it (at least from my understanding of Deepseek V4, as I don’t know for certain what OAI has actually implemented internally), but this thread of where this came from makes sense to me.
We’re working with an independent advisory group of mathematicians to help OpenAI responsibly share advances in AI and mathematics. The group will advise on how we assess and communicate new mathematical results, uphold academic and professional standards, and build tools that support mathematical research and learning. Through this work, we want mathematicians to be at the center of shaping how AI supports mathematical understanding and how its benefits reach the wider community. openai.com/index/advisory-gr…
8
7
90
6,449
A non AI person asked me vaguely accusatory questions about water and data centres. Oh, and AI breaking out of sandboxes to kill us all. Don't worry, I said. It'll run out of water.
9
8
166
4,602
I for one am quite fond of parrots. Nevertheless, capabilities in 2023 were very different from 2026.
"stochastic parrot" was a mimetically-fit cognitive virus that spread from 2021-2025; it temporarily blinded many gifted people to the nature of AI progress, burning up crucial years in which they could have helped think through the response to the situation.
8
33
1,994
Michael Timothy Bennett retweeted
Well, I finished reading the @anilkseth BBS Response article. Going in I predicted that he would not specify any sort of evidence or experiment which would lead him to pre-commit to saying, "My confidence in biological naturalism is reduced" or even "This raises my confidence in computational functionalism". This prediction seems to have been right. There's a point in the paper which I find particularly illustrative. He criticizes panpsychism because it "generates no testable predictions". So the natural question is: Okay, what testable predictions are you willing to make based off BN? None. "If we did experiment X, biological naturalism would predict we see result Y. If we instead get result Z, this is evidence against BN." - There is nothing like this in his paper. "If we did experiment X, computational functionalism would predict we see result Y, while biological naturalism would predict result Z. If we get result Y, that's evidence in favor of CF, if we get Z that's evidence in favor of BN." - There is also nothing like this in his paper. To be clear, there are plenty of cases where he says "If we observe phenomenon X, that's evidence against CF". When it comes to specifying ways where the theory he doesn't believe in might be contradicted or falsified, Seth is no slouch. When it comes to applying that scrutiny to his own belief in BN... well it doesn't come to that. He just straight up doesn't do that. Biological naturalism has no predictive power greater than that of panpsychism, or any other theory of consciousness. If it does have this predictive power, Seth is certainly not taking the opportunity to use it. I think that public figures have certain responsibilities. One of those is not to overrepresent their case when suggesting courses of action. Seth should admit that his BN stance is unfalsifiable, and provide that as context when he advocates for treating it as the "default". There is nothing wrong with making logical leaps, or even leaps of faith, in the face of uncertainty. I don't have any issue with a Christian arguing to convince me that the teachings of their faith should inform society's decisions. But they have to disclose that this is a matter of faith for them, and not selectively apply evidentiary standards and burdens of proof. Alternatively, if Seth wants to continue asserting BN as some sort of scientifically backed theory, he should specify even a single condition under which that theory might be falsified or at least contradicted. A hypothesis being testable, it having predictive validity, is the entire basis of the scientific method. In his own words, "BN and CF should justify themselves". We've had plenty of theory, we don't need another paper saying "more research is needed but in the mean time assume I'm right". It's time to gird your loins and make some testable predictions. In the interim here is my suggestion: We should not treat *any* theory of consciousness as the default. I have read everything I can get my hands on in this field and given how high the stakes are, there is nobody who is reasoning from solid enough ground to trust during this high stakes of a situation. The closest I've seen is @drmichaellevin or @MiTiBennett. And even them I think are still just not quite there (though Bennett in particular I have to give praise for doing yeoman's work to try and formalize/operationalize his ideas). In the very near future we are going to need to navigate through a time of great change and upheaval. To do so based on unfalsifiable speculation is not only sloppy, it is a dereliction of moral duty.
And to your more directly answer your question I would require evidence speaking directly either for/against computational functionalism and/or biological naturalism. The sort of evidence I have in mind I describe in my forthcoming BBS response, which you can read when it’s out.
5
5
2
32
4,216
Michael Timothy Bennett retweeted
Beware, beware the Necromooncer
18
31
5
403
6,256
Michael Timothy Bennett retweeted
Jev is INSANE. I built this in an evening and morning. A real-time trading bot ingesting onchain+offchain data to make rapid decisions about trades. Fully autonomous. So far it has lost me $31,680.
651
1,212
370
24,271
1,418,876
I think a lot of the feeling of overwhelm is also due to mere access. Lots of crazy things have happened throughout history, but most people were unaware of them. Not so much today. In terms of my life actually changing, things are rather peaceful. But knowledge of things makes it feel like a lot is happening. My work has been impacted a lot by AI, but not much else has as yet. I’m still waiting for a dating app that doesn’t suck. Should be an addressable problem using current tech.
human cultures are not able to metabolize this amount of change this quickly. when you zoom back out to a big picture of history, it’s remarkable how glacially slow everything is. the first industrial revolutions took 80 years (very fast by the standards of previous revolutions), and the writings of Marx happen at the very end as working class politics arises. it takes about another 150 years after that for the great ideological struggles of post-industrial times to be completed in the 90s in what fukuyama called the “end of history” today you see a compression of decades of technological change into a matter of months or years. there’s no wonder yann lecun (the respected inventor of the ConvNet and ex-chief scientist of Meta) wonder whether the hugging face incident was staged, and mathematicians whose minds are far more powerful than my own are nonetheless coping about training on their data or something while models begin to display superhuman mathematical capability it would take a century or more to fully metabolize and legitimize the level of changes that have happened even in the past 20 years, to say less of the remarkable scientific revolution we will get over the next five should we avoid the doom of misalignment. I do not suspect any current form of science academia, or even political order will survive without great transformation, except through the course of slow evolution over decades - and of course, technology will keep moving too
4
3
49
3,667
I’m concerned about the rise in people being concerned about things. It is all very concerning.
“I worry about” “I’m concerned about” are becoming extremely high status sentiments, and the more esoteric the better. they indicate that you’re fighting the good fight and you’re an activist. but I much prefer to learn that someone is curious or fascinated about something
6
1
43
1,676