@PierreOrhan

Exploring with giants’ treasure maps. PhD student with Yves Boubenec and Jean-Rémi King

 ENS - McGill
Joined February 2020
  • Tweets98
  • Following294
  • Followers178
7Media
New result! A theory of @AdrianDu_'s data, where we model distributions of tuning curves. -Random connection brings symmetry 🌈 -SVD revealed the distribution of Fourier coefficients 🥳 -The model is a null-hypothesis usable anywhere in the brain With @apeyrache and @AdrianDu_
1
7
3
46
1/7 Does the infant brain have representational structure? 👶🧠In the FOUNDCOG project, we scanned 134 awake infants using fMRI. Published in Nature Neuroscience, our research reveals 2-month-old infants already possess complex visual representations in VVC that align with DNNs.
1
47
8
180
15,135
pierre orhan retweeted
Micha Heilbron@m_heilb18 Aug 2025
New preprint! w/ @dr_han_jones Adding human-like fleeting memory to transformers improves language learning, but impairs reading time prediction This supports ideas from cognitive science but complicates the link between model architecture and behavioural prediction
1
13
2
52
4,093
Jérémy Rapin and I are very happy to present you: exca A python decorator to eliminate the overhead of caching and cluster-based executions for complex pipelines. - install: `pip install exca` - doc: github.com/facebookresearch/… #python #DataScience #OpenSource 🙏 @AIatMeta
2
1
12
1,501
We grieve the passing of Dr. Yves Frégnac. Yves has shaped the study of cortical processing and plasticity. He heralded interdisciplinarity and was one of the founding fathers of our institute. Our thoughts go to his family and to his friends in the community and beyond. xitter.cf/NeuroPSI_saclay/status…
4
37
11
94
36,862
Feeling very inspired about ✨Using ANNs for Studying Human Language Learning and Processing (ANN-humlang.github.io)✨ after the workshop that @tamar_john1 and I organized this week at @ILLC_amsterdam! Many thanks to all our speakers and participants for such a great event,
1
4
3
28
4,619
pierre orhan retweeted
SueYeon Chung
@s_y_chung20 Oct 2023
👋@FlatironCCN is currently hiring Flatiron Research Fellows! For openings in Neuro-AI and Geometric Data Analysis group, you can find more information here: apply.interfolio.com/134616 P.S. This is a great job in an incredible environment for computational research. If you know, you know😉 Email me if you have any questions!
1
19
1
64
20,181
🔥New paper accepted to ACL 2023! “Language acquisition: do children and language models follow similar learning stages?” With @lakretz and @JeanRemiKing arxiv.org/abs/2306.03586 Very happy to share this work from my internship at @MetaAI ! Three key results below 👇 1/8
2
13
2
67
14,946
The season finale of the mixed 🍝 vs. modular 🧱 selectivity debate will take place this year at #cosyne2023 workshops! Join us to hear what our stellar lineup thinks about single-neuron interpretability and disentangled representations! Co-org w @wjeffjohnston @jcrwhittington
March 13th, Cosyne Workshop on neuron interpretability featuring Morning session 8:00 - Lea Duncker 8:30 - Adrian Valente 15 min break 9:15 - Takuya Ito 9:45 - Christine Constantinople Afternoon session 4:00 - Adam Kepecs 4:30 - James Whittington 15 min break 5:15 - Kiah Hardcastle 5:45 - Stefano Fusi 6:20 - Panel discussion

ALT March 13th, Cosyne Workshop on neuron interpretability featuring Morning session 8:00 - Lea Duncker 8:30 - Adrian Valente 15 min break 9:15 - Takuya Ito 9:45 - Christine Constantinople Afternoon session 4:00 - Adam Kepecs 4:30 - James Whittington 15 min break 5:15 - Kiah Hardcastle 5:45 - Stefano Fusi 6:20 - Panel discussion

2
12
4
83
20,655
Our paper is out in Nature Human Behaviour🔥🔥 ‘Evidence of a predictive coding hierarchy in the human brain listening to speech’ 📄nature.com/articles/s41562-0… 💡Unlike language models, our brain makes distant & hierarchical predictions with @agramfort and @JeanRemiKing Thread👇
11
188
19
722
145,207
We have 2 open calls for a fully-funded PhD in #NeuroAI at Ecole Normale Supérieure: 1. euraxess.ec.europa.eu/jobs/6… w/ Pierre Bourdillon 2. euraxess.ec.europa.eu/jobs/6… w/ Yair Lakretz.
1
23
53
8,127
Major update on our "dual" feature encoding by excitatory and inhibitory cortical cells, now including simulations and super cool theoretical work by @PierreOrhan. And again, kudos to @AdrianDu_ for all the hard work! biorxiv.org/content/10.1101/…

Reciprocal feature encoding by cortical excitatory and inhibitory neurons

In the cortex, the interplay between excitation and inhibition determines the fidelity of neuronal representations. However, while the receptive fields of excitatory neurons are often fine-tuned to...

biorxiv.org
9
1
36
4,055
Just take your favorite music hits, and walk between them through diffusion, new year mix set will be 👌
AK
@_akhaliq15 Dec 2022
Riffusion, real-time music generation with stable diffusion @huggingface model: huggingface.co/riffusion/rif… project page: riffusion.com/about
1
220
pierre orhan retweeted
AK
@_akhaliq15 Dec 2022
Riffusion, real-time music generation with stable diffusion @huggingface model: huggingface.co/riffusion/rif… project page: riffusion.com/about
53
576
166
2,404
🔥Our work has now been accepted to NeurIPS 2022 !! `Toward a realistic model of speech processing in the brain with self-supervised learning’: arxiv.org/abs/2206.01685 Let’s meet in New Orleans on Tue 29 Nov 2:30pm PST (Hall J #524). A recap of the 3 main results below 👇
21
257
25
1,200
1/ Our new preprint biorxiv.org/content/10.1101/… on when grid cells appear in trained path integrators w/ Sorscher @meldefon @aran_nayebi @lisa_giocomo @dyamins critically assesses claims made in a #NeurIPS2022 paper described below. Several corrections in our thread ->

When and why grid cells appear or not in trained path integrators

Recent work has claimed that the emergence of grid cells from trained path-integrator circuits is a more fragile phenomenon than previously reported. In this note we critically assess the main...

biorxiv.org
Rylan Schaeffer@RylanSchaeffer1 Nov 2022
Very excited to announce our #NeurIPS2022 paper No Free Lunch from Deep Learning in Neuroscience: A Case Study through Models of the Entorhinal-Hippocampal Circuit. It's a story about NeuroAI, told through a story about grid & place cells. Joint w/ @KhonaMikail @FieteGroup 1/15
1
14
3
68
the lineup and the spot 🤯⛷ (p.s: and lots of train to go to Les Houches 🚅 ✅ )
Sebastian Goldt@sebastiangoldt31 Oct 2022
🎉Applications are open for our #workshop on the theory of neural networks in Les Houches (France) from 20.-24.02.23, organised w/ @s_y_chung & @marc_mezard. Check out our fantastic set of speakers from neuro & ML and apply until Dec 1st statphysneuro.github.io/ (and pls retweet!)
6
I have with one area chair (AC) at @iclr_conf 2023 some difficulties to find reviewers for papers at the interface between physics/PDEs and ML. If you have a few spare cycles to help us in the next 3 days send me a DM. Thanks a lot 🙏 — 🚒🚑 senior area chair at @iclr_conf
5
15
1
38
We don't yet know what learning rules are implemented in the brain. Can we understand the representation and function dynamics induced by candidate learning rules in deep networks? New preprint with @CPehlevan arxiv.org/abs/2210.02157
1
20
1
96
pierre orhan retweeted
Chris Olah
@ch40227 Sep 2022
A few people have asked me how our recent superposition paper (transformer-circuits.pub/202…) relates to classical ideas in neural coding / connectionism / distributed representations. I wanted to share a few thoughts, although I'll caveat I'm very much not an expert on these topics!
2
24
3
156
Our article on the perturbative approach is out on Nature communications. Check out how perturbations can be used to study the way neurons perceive the world. Work in collaboration with @matigoldin, @RetinaGeek and @alxecker Thread below: nature.com/articles/s41467-0…
1
22
6
98
Load more