A surprisingly convincing P-zombie

Melbourne, Australia
Joined July 2009
Andy Kitchen 🧠🤖 retweeted
Introducing Anatomy Describe a machine in one line. Claude brings it to life. - Interactive isometric wireframes you can rotate, inspect and explore - WebGL shaders for fire, water, plasma and more - Real 3D motion, with individual parts that rotate and move Install it as an agent skill. Fully open source.
423
1,577
647
17,896
2,587,163
Andy Kitchen 🧠🤖 retweeted
134 pages from ETH and EPFL on training a multimodal reasoning model I’ve had a lot of fun putting off various fires there, given the fully open source and data requirements, you won’t find a better report, especially a multimodal one
11
40
4
362
15,926
Andy Kitchen 🧠🤖 retweeted
David Silver is one of the all-time greats. He was the creator of AlphaGo, which changed the course of history by showing that neural nets could achieve superhuman performance for the first time. He also has a unique intuition and knack for forecasting when things will happen in AI. With computer Go, he predicted the Lee Sodol outcome 10 years before, right to the year. He got the year right for Starcraft and won a bet inside Deepmind. Same for AlphaProof. Same for the IMO. David's prediction for superintelligence: 3 years. !!! He has a strong sense that now is the time to build a superleaner, and that superlearners are now possible, thanks to the enormous progress in compute, simulators, autoresearch, and the sophistication of technology in the stack since the AlphaGo days. What is a “super learner”? A super learner discovers all knowledge from its own experience. Start from nothing (no internet pre-training), and go beyond human knowledge. Drop it into any stream of experience, simulated or physical, and the superlearner learns. He expects the progress will be rapid. When you get the recipe for a superlearner just right and remove humans from the development loop altogether, a superlearner can learn extremely quickly. Just look at AlphaGo. AlphaGo took two years to develop with humans in the loop. When David and his team at @GoogleDeepMind got the formula for AlphaZero correctly, it surpassed the human-developed algorithms in just a few hours. Human data is a shortcut, but you have to let go of the human data to shoot beyond it. In January, David left GDM to found @IneffableLabs, a research-led lab with one mission: build a "super learner" that discovers all knowledge from its own experience, and make first contact with superintelligence. He joins us with co-founder Lasse Espeholt, who built IMPALA and SEED RL, the foundations of scaled-up RL, and now runs Ineffable's compute. A few things we cover in this conversation. — What a super learner is: depth (start from nothing, go beyond human knowledge) and breadth (drop it into any stream of experience, simulated or physical). The human brain is the only existence proof — Why they're giving up human data: AlphaGo took two years with humans in the loop. AlphaZero outperformed it in a few hours. "You have to let go of the human data to shoot past the competition" — Crucibles: simulated worlds with enough emergent complexity (physics engines, millions of interacting agents) for an agent to rediscover technology, science, maths and language on its own — Simple rewards, emergent complexity: evolution optimized fitness and got all of life. Don't breadcrumb the objective, give the agent something simple to optimize in a world with a lot to learn about — Go as the existence proof: one agent is the most boring game imaginable, two agents is "an infinite onion of layers of complexity" — Why human language is probably not the endpoint for reasoning, and how training on it bakes in a flat earth and the four humors — Can superintelligence be built in simulation? If the sim is Turing complete, computation, economics, language and maths are all expressible, and it happens 10-100x faster and safer — Alignment: language-based monitoring is reaching its limits as agents learn to say one thing and do another. Shadow actions, superintelligences monitoring superintelligences, and building a real science of how they interact peacefully — Accelerate in simulation, pace in the real world: Ineffable will gate real-world deployment on evidence that it goes well — Timing as the determinant: Silver called Computer Go to the year, then StarCraft, then the IMO. He thinks this is the moment — Predictions: True superintelligence within three years. Timestamps: 0:00 – Introduction 1:09 – What held true from Go to today, and what the LLM era changed 3:35 – Why leave DeepMind to start a new lab 5:58 – Why "Ineffable" (and the secret second reason) 7:03 – Lasse's path: scaling RL at DeepMind and Google Brain 9:31 – Defining a super learner and first contact 12:35 – Super learners vs. LLMs that make discoveries 13:59 – Day to day: the RL stack, crucibles and human-journey milestones 16:13 – Don't breadcrumb the objective: simple rewards, emergent complexity 21:16 – What a crucible looks like 24:14 – Go: one agent is boring, two is infinite 25:41 – Will agents rediscover language? 27:22 – Removing human priors: AlphaGo to AlphaZero 32:05 – Keeping human bias out of the crucibles 33:35 – Confidence, timing and super forecasting 36:24 – Is compute the driver? 38:13 – The ceiling on simulation and Rich Sutton's objection 43:44 – Alignment and the science of superintelligence 47:45 – Monitoring agents that don't think in English 51:01 – Pacing the frontier 52:54 – The compute setup: Vera Rubin on GCP 55:18 – Training, inference, simulation and RL scaling laws 57:40 – IMPALA and SEED RL 1:00:58 – 20 people and the compute-per-person ratio 1:04:49 – A research-led culture 1:05:47 – Predictions
18
97
31
763
126,016
Andy Kitchen 🧠🤖 retweeted
9
428
17
2,576
132,151
Andy Kitchen 🧠🤖 retweeted
What do you get when you combine future focused scientific exploration with an incredibly multidisciplinary and amazing team of people? Check out "Organoid intelligence: a new biocomputing frontier" on youtu.be/Dgihhl2SR20 And see the paper here: frontiersin.org/journals/sci…
3
22
67
10,130
Andy Kitchen 🧠🤖 retweeted
youtube.com/channel/UCRYEeDX… My friend @lewingtonpitsos makes fun AI videos on YouTube dot com. You should subscribe.
1
2
3
Andy Kitchen 🧠🤖 retweeted
Life is plumbing.
4
29
Andy Kitchen 🧠🤖 retweeted
Watch neurons play the video game #Pong, demonstrating learning in real-time. @ANeuroExplorer Read more @NeuroCellPress: cell.com/neuron/fulltext/S08… Video credit:@CorticalLabs
6
1
13
Andy Kitchen 🧠🤖 retweeted
Did you read the papers or are you jumping on the bandwagon? Computer models of neurons are not the same as biological neurons. Obscure conference proceedings with a sample size of 2... Yes, 2... Are easily missed & even if it had been seen there's more relevant work we did cite
1
1
4
Andy Kitchen 🧠🤖 retweeted
Let's talk language–specifically why we used the word ‘sentience’. Over time words can end up with multiple meanings, even conflicting meanings. Colloquially this isn’t a problem. Scientifically, it is. When you’re trying to use a term to describe something you have 3 options 1/7
3
3
5
22
Andy Kitchen 🧠🤖 retweeted
Meet DishBrain: human brain cells in a dish learn to play Pong. Our latest paper published today in @NeuroCellPress. Full paper at doi.org/10.1016/j.neuron.202….
43
100
60
372
Seems thousands of COVID tests got delayed in Melbourne. Almost missed out on travelling because of it. Met many people at the AP with delayed tests unable to fly.
1
1
3
Another poor couple I met may be missing their holiday because of a misplaced hyphen in a name on a vaccination certificate.
2
5
. @CorticalLabs @elonmusk Who would win? Your NeuralLink Monkey or our CorticalLabs Brain-chip? Does your monkey dare challenge our brain-chip in 1-vs-1 pong? Your monkey was merely implanted with an interface — our cultured neurons were born into the interface — molded by it.
1
14
1
12
Also people, I'm telling you RT this so Musky sees it. We must see Brain on a chip vs. the NeuralLink Monkey at pong. Make cyberpunk happen! newscientist.com/article/230…
4
12
Take the dishpill
This Post is from an account that no longer exists. Learn more
1
1
6
Fun fact, "dishpill" was also the internal codename for the neural interface driver code I wrote for this project.
8