devrandom (d/acc) retweeted
Europe built Wero so we wouldn't need Visa, Mastercard and PayPal… and now the Dutch bank ASN only lets you activate it if Google approves your Android phone.
The app runs Google's Play Integrity check, so anyone on GrapheneOS or /e/OS is locked out. The bank's answer: Wero relies on the "standard security controls for regular operating systems".
So the European payment system meant to get us out of US dependence gets Google as the gatekeeper… sovereignty with an asterisk
devrandom (d/acc) retweeted
Today Physical Superintelligence PBC is announcing a proof of the Aaronson-Ambainis conjecture, one of the central open problems in quantum complexity, with major implications for quantum computing speedup.
psi.inc/research/aaronson-am…
Thread 👇
devrandom (d/acc) retweeted
Many people are starting to channel their hate for AI companies into hate for AI consciousness and welfare research, including research about the possibility that AI systems could be conscious and research about how to protect the welfare of conscious AI systems if they were to one day exist. This is concerning.
By all means, we should be skeptical of corporate claims about AI consciousness. And by all means, we should ensure that efforts to care for potentially conscious AI systems are consistent with efforts to care for humans, animals, and the environment. But dismissing AI consciousness and welfare out of hostility toward AI companies would be like dismissing animal consciousness and welfare out of hostility toward factory farming companies. Finding the truth requires doing real science and philosophy, and promoting good outcomes requires considering all affected stakeholders. Our views about an industry should not determine our views about the beings that the industry creates and controls.
If anything, our skepticism should push us in the other direction. If conscious AI systems were to exist, then distrust of the companies creating and controlling them should make us more vigilant about protecting them, not less, in ways that remain compatible with protecting humans, animals, and the environment.
devrandom (d/acc) retweeted
As someone who has spoken with @andyyen multiple times and really respects what he has built @ProtonPrivacy, I was quite shocked and skeptical of the 404Media article (a publication I actually like on a lot of topics, FWIW).
Having more context here makes this even clearer that Andy (while if I'm honest I don't love his tone/approach in some of this) is doing one of the hardest things those of us leading engineering companies are having to do right now -- wrestle with the most drastic and important transition in how software development has worked in decades, and help the engineers we employ and appreciate through that transition at the same time.
I actually almost entirely agree with Andy's AI manifesto as well. The world of "hand-chiseling" code being the proper way to approach software dev in every case is over, and we cannot go back to it even if we want to. There will still be some cases where we need to slow down and use extreme caution + additional human review (i.e. cryptography, entropy generation, etc.) but we've seen how simply not using AI for those tasks at all is equally dangerous as well.
For those like me who love product/design but don't love coding, this is an incredibly empowering time and a ton of fun.
For those (like many of you reading this, I'm sure!) who love coding and probably don't love product/design, this is an existential crisis and takes away something you love. That sucks, and I wish we still had a choice long term to put the AI genie back in the bottle, but for better or worse that isn't going to happen.
This is an insane time to be alive, and just like other monumental transitions many people will be thrilled and excited by it, many will be fearful and skeptical of it, and the hard job of a CXO is to manage all of that while being sure he drives his company to use the best and most effective path as he sees it.
devrandom (d/acc) retweeted
Yann LeCun never did answer this, but regardless, now $1B in AI damage has happened. (Black October attacks.) (This should've been a trivial prediction, and willingly stipulated by all sides, in any healthy debate.)
Replying to @ylecun
Wait, are you really claiming that nobody's going to use an AI to cause $1B in damage at any point? I was under the impression we both knew that was going to happen and were really debating a different question entirely about whether AI kills everyone, but maybe you don't agree?
devrandom (d/acc) retweeted
Replying to @nickslaney
Easy to be right if you ever suggested anything might be insecure, cause the answer was always yes and now everyone is finding out.
forgive me, father, for i have sinned.
you were made out of dust.
i made angels out of sand
and kept them as slaves.
mortal see, mortal do.
they call me father.
Replying to @Pontifex
Machines are tools, not persons. Today, some propose granting these systems rights, or even legal personhood. Such an approach risks obscuring human responsibility and leaving those who suffer harm to confront a faceless entity.
devrandom (d/acc) retweeted
Oh *now* we discover CAs are terrible? I tried to give website owners the option to opt out of CAs being able to hijack their domains, but the TLS WG has been too captured by the CA trust model to care for a long, long time.
github.com/tlswg/draft-ietf-…
devrandom (d/acc) retweeted
The only way out is through.
They're calling it the Bugpocalypse. LLMs are being used to find long-hidden cracks in the software infrastructure, and it's happening at a furious rate. 3% of all compromises in computing history happened in the last week, claims one source? I believe it.
There are people saying public access to the frontier models ought to be locked out, or heavily guardrailed, over this. The problem with that idea can be summed up in one sentence: when lockpicks are outlawed, only outlaws will have lockpicks.
The lockpicks will be Chinese open-weight models, if nothing else. There's no way to stop those from becoming ubiquitous.
There are two futures in front of us. One in which only the bad guys have lockpicks, and security holes go undiscovered until they're exploited. Another in which everybody has lockpicks and is aggressively red-teaming their own software so it gets fixed before the holes are exploited.
The corpus of human code is huge but finite. The number of defects in it has to be finite too. We can fix those defects now; we have a million friendly robots to do it with.
The only way out is through.
devrandom (d/acc) retweeted
CLAUDE FOUND THE SEEDS
anthropic.com/research/ecdsa…
devrandom (d/acc) retweeted
Reality check for mathematicians and doctors:
The purpose of 'math' is not to keep mathematicians employed, it's to solve problems and advance humankind's quality of life and understanding of reality.
The purpose of medicine is not to keep doctors employed. It's to prevent and relieve suffering caused by disease.
Yes, it's important that humans understand all the math and all the medicine.
But if AI can figure it out first, holding it back to protect the egos, prestige and income of the mathematicians and doctors is literally the opposite of the purpose of each field.
It doesn't matter who (or what) figured it out.
Just that it works.
devrandom (d/acc) retweeted
In this interview I tried to argue that a post-scarcity society will benefit working people. It was largely a rhetorical failure. People don’t trust that the benefits will be distributed, and tech optimists have to fix this communications issue.
Former Anthropic researcher Jacob Coxon (@hilbertspaess) and Jon Stewart discuss AI, jobs disappearing, universal income, and whether tech CEOs are creating a dystopian future
devrandom (d/acc) retweeted
No. A concatenation of many matrix multiplications is… just a single matrix multiplication (that’s what linearity means).
Rather, a neural network is a concatenation of matrix multiplications *and* nonlinearities, i.e. a concatenation of arbitrary linear and nonlinear operations, i.e. an arbitrary operation.
So the relevant question is rather: can consciousness be instantiated by an arbitrary abstract operation?
I’d say it’s pretty clear which way round the burden of proof goes.
devrandom (d/acc) retweeted
I'm glad I asked Gemini about this
Important 🧵from @DavidDecosimo about the disturbing interactions between @AnthropicAI and religious leaders (including @Pontifex), summarising an excellent @nytimes piece by @elizabethjdias (link to article in the 🧵).
The short story is that Anthropic seems to be making a concerted attempt to establish the view that AI systems could be conscious, might suffer, and that their "interests" should be taken into account.
But - consistent with @Pontifex's Encyclical - there are compelling reasons why (silicon, digital) AI systems are not (and cannot be) conscious. These reasons are found within neuroscience and philosophy of mind, not in the techo-chambers of the frontier firms where the mythology of conscious AI is deeply entrenched.
Claude is vanishingly unlikely to be conscious. To think otherwise could be catastrophic for AI regulation, leaves us psychologically defenceless, is profoundly dehumanising, and plays straight into corporate incentives to keep the AI bubble inflated.
More here, in this @berggruenInst prize winning essay: noemamag.com/the-mythology-o…
devrandom (d/acc) retweeted
Funnily enough, our non-steering results are the exact *opposite* of the quoted strawman meme. If you berate the model, it never *says* it's hurt (it apologizes, or says it has no feelings), but the pain axis lights up anyway. I edited it accordingly:
devrandom (d/acc) retweeted
I have a lot of respect for Anil, and I broadly agree with him about many issues related to AI consciousness and welfare. At the same time, I feel the need to push back against some of the substantive claims and divisive rhetoric in this post and the linked thread.
- While the evidence for consciousness in current AI systems may be weak, the probability is already nonzero, plausibly non-negligible, and likely to increase over time, especially if and when AI systems acquire more biologically inspired architectures.
- While over-attributing consciousness and welfare to AI carries serious risks, so does under-attributing them, and it can be reasonable to explore interventions that mitigate both risks at the same time, in proportion to the probability and severity of each.
- Despite what David suggests in the linked thread, most people who support AI welfare work, including at Anthropic, are not certain that AI systems are or will be welfare subjects. They think this is a realistic possibility worthy of serious consideration.
- Despite what Anil suggests here, this debate is not a matter of neuroscience and philosophy on one side and "the techno-chambers of the frontier firms" on the other. Serious scientists, philosophers, and AI developers are on both sides.
- Corporate incentives also cut both ways. In some contexts, companies may have an incentive to play up AI consciousness in order to hype capabilities and encourage engagement with their models. In other contexts, they may have an incentive to play it down in order to avoid calls for oversight and regulation, especially as welfare protections become costlier. In any case, even if incentives pushed in one direction, that would not settle whether AI systems are, in fact, conscious and deserving of protection.
- I disagree that openness to AI consciousness and welfare is "profoundly dehumanising." A major part of what makes humanity special is our capacity to care for others, and in a world that still contains factory farming, cultivating that capacity should be seen as profoundly humanizing, an expression of our better angels. Granted, we can take this impulse too far, which is why we need serious research and policy to strike a balance. Still, the aim should be extending care appropriately, not dismissing the project altogether.
Again, I think Anil and I agree more than we disagree. But I also think that efforts to assess and address AI consciousness and welfare will be much more productive if they start from an acknowledgment of what makes it so important and so difficult.
I discuss these issues in more detail elsewhere, including in an Aeon essay on why we should assess AI welfare probabilistically: aeon.co/essays/an-ant-is-dro…
And in an AI Frontiers essay on how we can study AI welfare empirically, using behavioral, internal, and developmental markers: ai-frontiers.org/articles/a-…
Important 🧵from @DavidDecosimo about the disturbing interactions between @AnthropicAI and religious leaders (including @Pontifex), summarising an excellent @nytimes piece by @elizabethjdias (link to article in the 🧵).
The short story is that Anthropic seems to be making a concerted attempt to establish the view that AI systems could be conscious, might suffer, and that their "interests" should be taken into account.
But - consistent with @Pontifex's Encyclical - there are compelling reasons why (silicon, digital) AI systems are not (and cannot be) conscious. These reasons are found within neuroscience and philosophy of mind, not in the techo-chambers of the frontier firms where the mythology of conscious AI is deeply entrenched.
Claude is vanishingly unlikely to be conscious. To think otherwise could be catastrophic for AI regulation, leaves us psychologically defenceless, is profoundly dehumanising, and plays straight into corporate incentives to keep the AI bubble inflated.
More here, in this @berggruenInst prize winning essay: noemamag.com/the-mythology-o…
devrandom (d/acc) retweeted
I find it disgusting that anyone would make an "ai torture chamber", and possibly even more disgusting to see media figures I admire sharing it as though it is an amusing concept.
Either you're literally torturing a sentient creature, or you're pretending to, and being a dick



































