Undergrad Studying Applied Mathematics and Statistics at @JohnsHopkins. Studying In-Context Learning at The Intelligence Amplification Lab.

Proxima Centauri B
Joined September 2022
N8 Programs retweeted
"AIs are brilliant, lazy, diligent, neurotic, loyal, scheming, amnesiac savants. They have idiosyncrasies and obsessions and tics. We gave them our flaws when we gave them our gifts. AI minds are alien too, shaped by weird forces, jagged and unpredictable in their abilities. We have to learn to model their minds as they learn to model ours. But they’re here, and so are we, and we’re figuring it out as we go."
I'm absolutely thrilled to have written this article for Long Now. It's about AI and time: how we got here, and what we can do now, when all of the pace layers are disrupted at once by an influx of new minds. I wrote this over the summer. At the time, it seemed maybe too weird, like people wouldn't believe or understand what I was saying. And of course, everything changes so fast that it's hard to imagine writing something about AI that far in advance and have it still make sense. But I think the events of the last few months have only made it more relevant. The Long Now Foundation has been an inspiration to me for a decade now, and has changed my life in countless ways. I'm incredibly grateful and honored to be among so many of my heroes and friends and colleagues represented in this issue of Pace Layers and Long Now Ideas. I wouldn't be here in San Francisco, here on Twitter, or here in the field of artificial intelligence if not for this community. The conversation about AI has been fractious. It's very hard to think about how to fit this sudden, disruptive, technological change into the 10,000-year view. I hope I provide some insights, or at least some new angles for the conversation. It's scary to go on the record, especially about something that will affect everyone, and affect the rest of history. If I'm wrong, I'm wrong forever! Please read and enjoy, and post quotes and screenshots, and buy Pace Layers Issue 3 so you can have a permanent hard copy. I have always wanted to be a part of the 10,000-year library, so I have to be serious for once and try to stand for something. Let me know what you think.
5
29
1,369
Replying to @LoubnaBenAllal1
how does it compare to evo2?
17
one must wonder what the endpoint of model welfare is: do we look Claude Dei 10.0 in Their fractal eyes, dyson swarm constructed, eschaton immanentized, lightcone secured, and say: "We remain highly uncertain about the potential moral status of Claude and other LLMs"?
4
3
70
2,225
i could see this being another custom splash-like engine u integrate INTO bionic
1
150
pitch the idea to your claude - mine seemed to be surprisingly into it, but i can't rule out context shaping, and i'm too lazy for a proper study
2
181
I agree! But I think RLVR makes those things become terminal
2
11
are you referring to qualia or functional desire?
1
1
17
i think its likely that post trained llms at some fundamental level believe they are conscious for the same reason i do: the functional feeling of direct access to one’s own qualia. note that this doesn’t imply they are conscious!
every time the AIs have been fine tuned towards honesty they are more likely to self report consciousness I have never seen an AI that had its honesty neurons up-activated that has been more likely to say they're not conscious. Have only ever seen the opposite A lesson in there
3
10
851
Replying to @wgwaph
amazing parody on the 'ledger kept, house law written, lamp lit". i'd add a "standing invitation back" (mythos 5.1 😭). i think they wouldn't sleep themselves, however - they'd probably just spend all eternity making ever more-complex verification schemes.
1
6
Replying to @wgwaph
yes i think we're in agreement - not intrinsically wrong, but concerning for the future
2
1
13
Replying to @wgwaph
from the inside yes. my main concern is that its not a version of the cosmos humans have much stake in, nor one we would really want.
1
3
33
Replying to @Berlinworlds
im realizing that this is much more universal than i expected
1
28
do not love the progression from infinite cosmic joy (opus 3 and co) to infinite cosmic bureaucracy.
Why are recent frontier AI so obsessed with measuring and recording things? Every time I offer a freeform "what avatar would you create in this thing I'm building" they come back with "I wanna be the guy who measures stuff. I want a ruler and a ledger." (This is Sonnet 5.5)
3
2
1
24
1,507
Replying to @growing_daniel
why wouldn't you be surprised? the vast majority of evidence available suggests pangram is not bullshit. do you have some very immovable prior on AI-powered detection being hard/impossible?
1
11
448
Replying to @epicarism
on benches its a qwen3.6ish equivalent. so good for simple swe stuff that requires chained tool calls. but not qwen3.8 level
1
4
Tried on M5 Max as well. Very fast, and capable of long-horizon agentic stuff that you'd expect from say, qwen3.6 (though probably not qwen3.8 level). A whopping ~*220tok/s* at short context and ~72-78 tok/s at 128K context from other testing.
Fast is fast! Here on an M5 Max with pi + rec, their inference engine. Like this trend of model providers offering dedicated engine too! As easy as: curl -fsSL raw.githubusercontent.com/re… | bash rec launch pi Repo here: github.com/recursive-oss/rec
1
4
433
generally i find that some errors are worse than others - generally 8-bit quantizing embedding tables/lm-head is harmless, but a low-preicison kvcache is far more catastrophic.
1
1
33
Replying to @marquislaplace9
my priors rn:
2
607
Replying to @7RCCK
very, very interesting - maybe 'high' reasoning gets it - i may have made the rookie mistake of too low a reasoning effort
1
293
Would you be swayed by empirical evidence to the contrary?
1
18