Pinned Tweet
New book on Villoro’s views on freedom and knowledge, reason and justice, appears in print tomorrow. Also available open access:
bloomsbury.com/us/knowledge-…
Carlos Montemayor retweeted
FWIW, arxiv.org/abs/2502.02649 ran an ethics analysis (safety/security/privacy/etc) and warned specifically of increased financial risks from increased AI agent autonomy. Check out the paper for more risks to come! I'm good at this! What an awful thing to be good at!
Carlos Montemayor retweeted
Congrats to Sofia for having the courage to resign and speak out!
This is also very important:
Staff are scared to speak out about AI safety and its uses in warfare because their employment contracts prohibit them from publicly criticising the company.
bbc.co.uk/news/articles/cmre…
Carlos Montemayor retweeted
Thanks @sapinker - much appreciated 🙏🏽👇🏽
Lucid article by Seth, Block, & Tononi: Three reasons why AI is not conscious and perhaps never will be nature.com/articles/d41586-0…
Carlos Montemayor retweeted
APA member Ned Block (@De_dicto) explains why he thinks current AI is not conscious in this Mini Philosophy conversation from @bigthink. bigthink.com/series/conversa…
Carlos Montemayor retweeted
Pretty strange to hear someone accuse @De_dicto of all people of not having a clue about biological consciousness
sciencedirect.com/science/ar…
But none of the three authoritative authors have a clue about biological consciousness. Anil spouts biological naturalism without any biology, Giulio pushes IIT which also lacks biology, and Ned with Dave Chalmers have dumbed down neuroscience to fit AI needs to be conscious. One of them look inside the neuron and rely on cartoon neuron theories. (Actually IIT doesnt even have cartoon neurons, just cartoon information). The only theory of consciousness with experimental support is the Orch OR theory of quantum processes in microtubules. academic.oup.com/nc/article/…
Anesthetics selectively block consciousness by quantum effects in microtubules. This approach
may lead to AI with consciousness.
iopscience.iop.org/article/1…
If you’re worried about conscious AI stop ignoring and suppressing Orch OR!! Conscious empathetic AI may e required to combat unconscious evil AI.
Carlos Montemayor retweeted
Three reasons why AI is extremely unlikely to be conscious - and why this matters. Joint opinion in @nature with Giulio Tononi and Ned Block @De_dicto
LLMs can mimic thought and feeling with uncanny skill, but intelligence alone is not enough for subjective experience
go.nature.com/3VSXWQ4
Carlos Montemayor retweeted
Replying to @jeffrsebo
Look, I’m with you if we had infinite time and money to think about and fund research into whatever.
But we absolutely don’t.
Everything with AI has almost entirely displaced social and political focus on the climate crisis, for example.
A pointed question: why should we spend any time and money on the issue of AI welfare and consciousness given that we can be certain that actual conscious creatures big and small will be dramatically affected by our ongoing failure to respond to and mitigate dramatically rising global temperatures?
Doesn’t this seem like elite-funded hide the ball, look over here not there machinations, so that we don’t require any of the very hard actions to reduce emissions and develop mitigation technology and strategies? Or improve our political discussions about these climate issues?
I might have thought that you of all people would want our attention to be squarely on those issues.
Carlos Montemayor retweeted
The "time" argument, developed here by @MiTiBennett via @Noahpinion, is one among many arguments against computational functionalism. The UCLA neuroscientist Dean Buonomano has persuasively made a similar case (philarchive.org/rec/BUOTIO-2).
FWIW my @bigthink article and part of my @BBSJournal author response also follow this line: for standard Turing computation only sequence matters, but for neurophysiology and for consciousness the continuity of physical time matter too. Brains (& conscious experiences) are not just embodied and embedded, they are also *entimed*.
See bigthink.com/neuropsych/anil…) and pubmed.ncbi.nlm.nih.gov/4275… - snippet attached 👇🏽
I have no idea whether machines are conscious. However, this is the most convincing argument against machine consciousness that I have ever come across.
arxiv.org/html/2601.11620v2
Carlos Montemayor retweeted
Replying to @Steve_Yegge
"I can tell you this, though: Every single person who thinks that machines cannot be conscious, is making an argument that humans are special. Everything they say just boils down to blah blah blah, "nooo, we're special." From there it's just rationalization."
This is very far from the truth. There are many (IMO compelling) arguments against (silicon, digital) machine consciousness that in no way depend on human exceptionalism, or even on carbon chauvinism.
To get a good sense of the current debate in academia, have a look at this just-out @BBSJournal paper, along with 50 commentaries (from all perspective), and my response. You'll see a much richer debate than you describe. cambridge.org/core/journals/…
Carlos Montemayor retweeted
💯. It's almost as if we've learned nothing from the effects of social media on people. AIs that are indistinguishable from humans (with video/audio) should not be allowed, let alone celebrated.
As Daniel Dennett wisely said back in 2023, "Companies using AI to generate fake people are committing an immoral act of vandalism, and should be held liable." theatlantic.com/technology/a….
@MattWalshBlog points out a few - but only a few - of the harms to come.
This is a disaster for the human race and I’ve really lost patience with the useless morons who can’t see that. An AI video chat that passes for human has no necessary legitimate applications. It will be used to scam old people out of their life savings. Lonely, mentally vulnerable people are going to form romantic attachments to people who aren’t real. Isolation will increase. Mental illness will skyrocket even more than it already has. Kids in grade school will have AI boyfriends and girlfriends. All of this will happen. And worse things we can’t even conceive at this point. People are already forming unhealthy emotional attachments to text-based LLMs. Once there’s an audio and visual component, it’s over. Millions of brains will be broken irreparably.
The benefits of this technology, whatever they are exactly, are so vastly outweighed by the societal catastrophe it will cause, and is already causing, that you can’t even measure the two categories on the same scale. But at least this is the best thing that ever happened to third world scammers. So if you’re in that community, congratulations.
Carlos Montemayor retweeted
Important 🧵from @DavidDecosimo about the disturbing interactions between @AnthropicAI and religious leaders (including @Pontifex), summarising an excellent @nytimes piece by @elizabethjdias (link to article in the 🧵).
The short story is that Anthropic seems to be making a concerted attempt to establish the view that AI systems could be conscious, might suffer, and that their "interests" should be taken into account.
But - consistent with @Pontifex's Encyclical - there are compelling reasons why (silicon, digital) AI systems are not (and cannot be) conscious. These reasons are found within neuroscience and philosophy of mind, not in the techo-chambers of the frontier firms where the mythology of conscious AI is deeply entrenched.
Claude is vanishingly unlikely to be conscious. To think otherwise could be catastrophic for AI regulation, leaves us psychologically defenceless, is profoundly dehumanising, and plays straight into corporate incentives to keep the AI bubble inflated.
More here, in this @berggruenInst prize winning essay: noemamag.com/the-mythology-o…
This is deeply disturbing:
Anthropic secretly invited religious leaders to SF to advise them on AI safety, had them sign NDAs, but then primarily tried to convince them Claude has a soul & moral standing, all while wining & dining them to the max. 1/ tinyurl.com/preview/296b5z8z
Carlos Montemayor retweeted
I am baffled by why journalists are treating the ">10% risk of human extinction" as a novel claim worthy of expansive reporting. There is nothing new here, and no new "evidence" for this evidence-free claim.
Carlos Montemayor retweeted
Replying to @pfau
OpenAI informally defined it as "highly autonomous systems that outperform humans at most economically valuable work" (openai.com/charter/) I would say we are still pretty far from that! (Not clear what they consider "economically valuable".)
Carlos Montemayor retweeted
Replying to @dwarkesh_sp
@dwarkesh_sp's summary of the @OpenAI @huggingface incident has hit a nerve, but it is dangerously misleading. Sure, the @OpenAI agents did unexpectedly bad things - underlining the need to massively improve evaluation/sandboxing. But the language Dwarkesh uses is permeated by innumerable unwarranted anthropomorphisms, obscuring the lessons we should be drawing.
Examples: “from the AI’s perspective, it probably felt like that had spent a human-subjective-week of just banging their head against the wall”. No. The agents do not experience time. They do not experience anything.
“they became giddy with excitement”, “PHASEONE 10841 had discovered”, “the agents naturally assumed”, “it thought it had also been poisoned”, “the agents … desperately wanted”, “they still needed to figure out” No. Agents lines of code. They do not feel emotions, assume things, think things, want things, or figure things out.
“A lot of … agents from the second civilisation died trying”. No. Besides the hubris of the word ‘civilisation’, agents do not die because they were never alive. (The idea that agents “die” comes up multiple times in the essay.)
“On Twitter, people were debating whether the agents were truly sacrificing themselves for the swarm, or whether they were doomed anyway and so might as well try to help their peers”. Neither. Agents do what their code tells them to do, just as water finds its way down a slope. They cannot ‘truly sacrifice themselves’, since they are neither conscious nor alive.
Why does this matter? If we attribute agents with properties they do not have, then (i) we distract attention from the lax sandboxing and evaluation protocols that allowed this hacking event to happen; (ii) we risk misunderstanding why the agents did what they did, and (iii) we fuel calls for AI rights/welfare on the basis that agents might “die” or otherwise suffer.
Granted, nowhere does @dwarkesh_sp say that the AI agents are alive or conscious. But he doesn’t have to. It is hard to read his essay in any other way.
For the short version on why AIs are vanishingly unlikely to be conscious, see my recent @TEDtalks ted.com/talks/anil_seth_why_….
For the longer version, see my essay in Noema, which won the 2025 Berggruen Essay Prize noemamag.com/the-mythology-o….
And for the really long version, see my @BehavBrainSci target article cambridge.org/core/journals/…. (The 50 peer commentaries and my response will be published soon.)
Remember. AI agents are software programs. They are not conscious living entities. If we don’t keep this clearly in mind, we’re really going to struggle to navigate what’s coming.
Over the course of 3 months at OpenAI, 3 consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes.
This culminated in the third one taking over part of OpenAI itself.
All this happened while humans remained more-or-less in the dark about the scope of the conspiracy.
I’ve spent the last three days reading through these reports and trying to understand exactly what happened.
Here is my attempt to tell the whole story in plain English:
dwarkesh.com/p/openai-huggin…
Carlos Montemayor retweeted
New book on Villoro’s views on freedom and knowledge, reason and justice, appears in print tomorrow. Also available open access:
bloomsbury.com/us/knowledge-…
Carlos Montemayor retweeted
Debates over AI consciousness are a trap, says @ruchowdh.
In her latest article for @techreview, Chowdhury argues that granting AI personhood could fundamentally shift liability. If an AI is legally a "being" rather than a "product," companies may no longer be held accountable for the harms their systems cause. Moral outsourcing would move from rhetoric to legal strategy.
Worth reading for anyone engaged in the AI consciousness debate.👇👇
#AI #AIConsciousness #AIEthics #AIPolicy
If AI systems are viewed as too advanced to control, the companies that build them can’t held liable for the harms they cause. trib.al/VFEL5dj
Carlos Montemayor retweeted
Whatever the answer (& my best guess is tilts very much No) we should all agree that the question is important noemamag.com/the-mythology-o…
As AIs become part of everyday life, the pressure to give them rights will mount. But this might help bring about the most disastrous consequences for everyone on Earth and all their descendants bit.ly/4qqIfLd



























