Jizheng Dong retweeted
Simulating a fruit fly's neural network using custom WebGPU kernels, running locally in a browser.
The demo uses real connectivity data for 166,700 neurons from the MaleCNS connectome. Paint neurons and watch their activity drive the fly's movements.
Built with GPT-6 Astra.
Jizheng Dong retweeted
A speck in a dish—that’s all the nervous system of the fruit fly Drosophila melanogaster looks like to the naked eye.
But look closely enough, and it resolves into a network of 166,700 nerve cells connected through 124.2 million synapses.
The intricate map—called a connectome—has now been published, marking the end of an ambitious 20-year research project. Learn more: scim.ag/4zTLm2j
Jizheng Dong retweeted
The flywire/janelia brain was preserved with aldehyde fixation. @aureliasong just published how she scaled the same approach to whole large mammal brains: every synapse (randomly sampled, and verified by BPF), connectomically traceable.
Uploading is still years out. But preservation is step one, check out their article
Jizheng Dong retweeted
Our new paper brilliantly lead by @itamarlandau "A predictive theory of experimental design for inferring neural population geometry in large-scale recordings." biorxiv.org/content/10.64898…
Our theory can say a lot about the geometry of new data *before* it is collected, by extrapolating from past data. We quantitatively predict:
1) How neural dimensionality, and the reliability of neural correlations and individual neural PCA modes grows with neurons and trials. This allows one to design experiments before the data is collected.
2) We find a "blessing of dimensionality" whereby recording more neurons actually allows us to record *fewer* trials while still reliably inferring neural population geometry. This opens the door to new types of experiments with many more complex trial types.
3) We develop scaling laws for neural prediction using masked autoencoders - a key technology for building foundation models in neuroscience. In the simple setting of linear autoencoders on a single session, we find power law behavior of prediction performance and autoencoder size with neurons and trials, and we trace these power law exponents for neural prediction to power law signals in collective neural modes of the brain.
4) We test our theory across multiple species (mouse, monkey, human) and recoding modalities (electrophysiology, calcium imaging, and fMRI).
See @itamarlandau's excellent thread for more information: xitter.cf/itamarlandau/status/20…
Also, yet another fun collaboration with Mark Schnitzer!
Neuro experiments capture 10,000+ neurons but often with only a ~100s of trials. So the data is ~100s points in a 10,000-D space. Can we trust the extracted "population geometry"?
This motivates our new paper: a predictive theory of experimental design.
@SuryaGanguli
1/13
Jizheng Dong retweeted
同一の単一神経細胞における生体内活動/全脳形態/遺伝子発現を統合解析する基盤(IMC)を開発
mouse視覚野に於て形態と遺伝子の相補的な特徴が神経機能を正確に予測することを実証
#EI_balance
#papers
cell.com/cell/fulltext/S0092…
Jizheng Dong retweeted
Just published yesterday, the #BANC! A full central nervous system (CNS) connectome of a limbed animal enables us to trace sensory-motor arcs and understand how the CNS controls the body. rdcu.be/fncjS #neuroscience @Nature, Video by @quorumetrix, sound on! 1/18
Jizheng Dong retweeted
Our new paper is out in Current Biology!
We learn many things in parallel, and brain circuits are constantly rewiring across brain areas. It is notoriously difficult to understand which rewiring events are responsible for which type of learning.
sciencedirect.com/science/ar…
Jizheng Dong retweeted
I’m leaving MIT and not continuing into my PhD. AI is coming too fast for humans to keep up.
But there might be a way: I realized digital humans are more possible than most think. With capable AI researchers helping, maybe for $10B, maybe in less than 10 years, on 50k H100s.
The future of the digital brain is not only digital twins or Uploaded Intelligence, but a biologically grounded model that lets us modify neural parameters in virtual environments and search for more efficient forms of intelligence. 1/2
Jizheng Dong retweeted
To accelerate progress, the field should obviously proceed (at least in the early pre-competitive phases) with replicable science with methods and codes documented and explained, not just videos / teasers.
Last October, @E11BIO (led by @Andrew_C_Payne) released open methods for a family of optical connectomics approaches called PRISM, which have the potential to massively reduce the cost of acquiring connectomics data
xitter.cf/Andrew_C_Payne/status/…
PRISM will integrate with AI driven methods to further reduce the cost of proofreading with AI, e.g. PATHFINDER (Januszewski, Viren Jain @stardazed0, and colleagues):
biorxiv.org/content/10.1101/…
Replying to @E11BIO
@E11BIO is excited to unveil PRISM technology for mapping brain wiring with simple light microscopes. Today, brain mapping in humans and other mammals is bottlenecked by accurate neuron tracing. PRISM uses molecular ID codes and AI to help neurons trace themselves. We discovered a new cell barcoding approach exceeding comparable methods by more than 750x. This is the heart of PRISM. We integrated this capability with microscopy and AI image analysis to automatically trace neurons at high resolution and annotate them with molecular features.
This is a key advance towards economically viable brain mapping - 95% of costs stem from neuron tracing. It is also an important step towards democratizing neuron tracing for everyday neuroscience. Solving these problems is critical for curing brain disorders, building safer and human-like AI, and even simulating brain function.
In our first pilot study, we acquired a unique dataset in mouse hippocampus. Barcodes improved the accuracy of tracing genetically labelled neurons by 8x – with a clear path to 100x or more. They also permit tracing across spatial gaps – essential for mitigating tissue section loss in whole-brain scaling. Using molecular annotation, we uncover an intriguing feature of synaptic organization, demonstrating how PRISM can be used for systematic discovery 🧵
Jizheng Dong retweeted
We've uploaded a fruit fly. We took the @FlyWireNews connectome of the fruit fly brain, applied a simple neuron model (@Philip_Shiu Nature 2024) and used it to control a MuJoCo physics-simulated body, closing the loop from neural activation to action.
A few things I want to say about what this means and where we're going at @eonsys. 🧵
Jizheng Dong retweeted
There's a fruit fly walking around right now that was never born.
@eonsys just released a video where they took a real fly's connectome — the wiring diagram of its brain — and simulated it. Dropped it into a virtual body. It started walking. Grooming. Feeding. Doing what flies do.
Nobody taught it to walk. No training data, no gradient descent toward fly-like behavior. This is the opposite of how AI works. They rebuilt the mind from the inside, neuron by neuron, and behavior just... emerged. It's the first time a biological organism has been recreated not by modeling what it does, but by modeling what it is.
A human brain is 6 OOM more neurons. That's a scaling problem, something we've gotten very good at solving. So what happens when we have a working copy of the human mind?
Jizheng Dong retweeted
This is how brain cells look while growing—every memory reshapes neuronal circuits
Jizheng Dong retweeted
While much of machine learning is retrospective (learn the past distribution) learning in biology is prospective (learn for the future) - here we discuss some implications for neuroscience (with Tim Verstynen, @jovo, Pratik Chaudhari): cell.com/neuron/abstract/S08…
Jizheng Dong retweeted
👀 For more than 15 years, Janelia researchers have been on a mission to catalogue the neurons of the fly optic lobes & develop genetic tools to study them. This effort has culminated in a complete inventory of all the visual neurons in the fruit fly ➡️ nature.com/articles/d41586-0…
how big is the individual different of the fruit fly?
the experiment always shows a big SD, which means although they might seem the same for us humans, there are more complex things than we thought.
Jizheng Dong retweeted
Turns out, a simple sum operator might just render #deeplearning obsolete. Solid math-based ideas are proving once again to outperform gimmicks.
#kolmogorovarnoldnetwork
























