Nicolas Patry (@narsilou) header
Nicolas Patry (@narsilou) profile picture

ML Engineer @huggingface. Anything ML inference related. Maintaining `pipeline` in `transformers`. Loving Rust.

Joined June 2009
Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)Photo by Nicolas Patry (@narsilou)
I find it quite amusing to see the AI slop teams, and AI believers team fighting like this is something totally new. The exact same fight happened over the invention of compilers and people had the same arguments on both sides...
2
4
399
Nicolas Patry retweeted
We are back again :) After three weeks of quiet building. Introducing Genesis World 1.0, our latest simulation platform, the second release in our full-stack suite. Open-sourced. Robotics is still bottlenecked by the 1× speed of the physical world. Every model, checkpoint, and data recipe eventually needs to be tested on physical hardware, slowly, expensively, and with limited coverage. One hour in reality can become 100 days in simulation. That is how robotics model iteration moves from a wall-clock bottleneck to a compute problem. To make this work, simulation has to be both fast and trustworthy. Over the past year, we rebuilt the entire stack: a GPU-accelerated cross-platform compiler, penetration-free multi-physics contact solvers, unified rigid and deformable physics, and a photo-realistic renderer purpose-built for physical AI applications. We built Nyx, a high-performance path-traced rendering engine for robotics application. Genesis World 1.0 achieves near realtime performance with our latest development for penetration-free IPC solver, supporting various types of deformables beyond rigid bodies. It supports contact-rich, dexterous manipulation simulation across different embodiments: unitree, sharpa, wuji, genesis hand and various types of grippers. Under the hood is Quadrants, our effort in pushing forward cross-platform GPU-accelerated computation. Quadrants started as a fork of Taichi, and we rebuilt most of the critical parts for optimizing simulation workloads, giving 10x faster launch time and up to 4.6x runtime performance compared to the initial Genesis release. Together, they bring us to an unprecedentedly low sim-to-real gap, enabling zero-shot real-to-sim model evaluation and much faster iteration of GENE. All available today. Genesis World 1.0: github.com/Genesis-Embodied-… Quadrants: github.com/Genesis-Embodied-… Nyx: github.com/Genesis-Embodied-…
70
176
66
993
327,214
Nicolas Patry retweeted
Robotics is a systems problem. Every layer matters, and every detail must integrate across the full stack. So bringing real scale to robotics requires building the full stack from the ground up: hardware, data, model, and simulation. Over the last year, we built a global team with world-class depth across every layer to make this possible. I’m excited to share GENE-26.5, our first robotics foundation model, and a path to the next level of scale in robotics.
We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.
26
30
1
319
673,147
So Sick !
We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.
2
410
Nicolas Patry retweeted
We are back. After one year of quiet building. Introducing GENE-26.5, our first robotic brain that takes a major step toward human-level capability. For years, robotics has struggled to learn from the world’s largest and valuable data source: Humans. Solving it means rethinking the whole stack from the ground up: - A robotics-native foundation model. - A 1:1 human-like robotic hand. - A noninvasive data collection glove for motion, force, and touch. - A simulator that turns weeks of experiments into minutes. GENE-26.5 is trained across language, vision, proprioception, tactile, and action. We designed a set of tasks to test how far we can go with this new paradigm. Fully autonomous, 1x speed, one model, same weights. (Enjoy with sound on) We are approaching the endgame for robotics. And this is just a beginning.
280
1,112
425
5,789
2,750,825
Github is becoming an increasingly pain in my daily life. Any substitute people recommend ? Ideally some gerrit workflow (for stacked PRs) And a simple CI loop that works (and does spend 90% of its time downloading dependencies over and over)
1
261
Amazing work here ! Having very small embedding models is really key to nailing context management (among other things ofc).
🤗 Welcome EmbeddingGemma — a multilingual embedding model from @GoogleDeepMind, built for on‑device use cases, leading the MTEB leaderboard for models < 500M! Supported with @huggingface Text Embeddings Inference v1.8.1 for fast and efficient inference! More in the thread! 🧵
1
9
1,426
🤗 Welcome EmbeddingGemma — a multilingual embedding model from @GoogleDeepMind, built for on‑device use cases, leading the MTEB leaderboard for models < 500M! Supported with @huggingface Text Embeddings Inference v1.8.1 for fast and efficient inference! More in the thread! 🧵
4
9
2
86
5,218
Is it just me, or the propension of Claude Code to ALWAYS add new files new functions everywhere is insanely annoying. There is a propension to ALWAYS create new things despite prompting otherwise. It's infuriating.
2
4
539
Today is one of these days....
1
1
326
Coding with AI be like:
1
1
24
1,065
🔵 @openai just released GPT OSS (20B and 120B) on the @huggingface Hub, their first open-source LLM since GPT2 in 2019! Here's what you need to know! - 🤏🏻 21B with 3.6B active, for lower latency, on-device and consumer hardware usage - 🏗️ 117B with 5.1B active, for production, general purpose, high reasoning scenarios - 📝 Text-only reasoning models with Chain-of-Thought (CoT) and adjustable reasoning effort levels - 👥 Mixture-of-Experts (MoE) with MXFP4 as the 4-bit quantization scheme - 🚢 Available in Transformers, vLLM, Ollama - 📑 Licensed under Apache 2.0 with a small complementary use policy
1
5
14
1,326
Amazing work !
🦀 @huggingface just released Text Embeddings Inference (TEI) v1.8.0, bringing a mix of brand new features and the latest additions from recent 1.7 patch releases—including powerful improvements and expanded model support! More in the thread 🧵
3
299
🦀 @huggingface just released Text Embeddings Inference (TEI) v1.8.0, bringing a mix of brand new features and the latest additions from recent 1.7 patch releases—including powerful improvements and expanded model support! More in the thread 🧵
1
4
1
16
1,321
Was demoing to a collegue my usage of claude. Cute demo that I showed while having casual discussions: Time to MVP 15mn. Add 1h of discussion, just messing with it, and another 15mn of UI cleaning up. huggingface.co/spaces/Narsil…
1
272
Nicolas Patry retweeted
We optimized LLM inference kernels for AMD’s MI300X GPUs (192GB 😮) using ROCm/HIP — and it’s all open source. 🔧 Tuned GEMM and fused kernels 📊 Benchmarked vs other GPUs 🚀 Big perf gains 🤝 Open-sourced everything Full write-up: huggingface.co/blog/mi300ker… #LLM #AI #AMD #MI300X
1
33
1
142
7,058
Nicolas Patry retweeted
Had the honor to present diffusion transformers at CS25, Stanford. The place is truly magical. Slides: bit.ly/dit-cs25 Recording: youtu.be/vXtapCFctTI?si=dlcE… Thanks to @stevenyfeng for making it happen!
19
137
12
1,106
194,568
Hmm latest pet project. I coded a fully fledged compiler (using LLVM) in a single day, doing mostly prompting to cursor. github.com/Narsil/dcc This thing seamlessly cross compiles like zig (no libc.) The simplest version was a one shot, 15mn agent interaction, functional.
1
1
24
1,043
Pretty insane. I've done my toy compilers in the past, let's say it was much more than a single day. Speaks a ton about the evolution of tools. That means AI, but also zig and LLVM.
3
239
Me: This function is too slow. Find a faster algorithm. Cursor: Hold my beer. Me: *Slacking off with colleagues* Cursor: Ping. Me: 🤯
13
672