Niladri Dutt (@niladridutt) header
Niladri Dutt (@niladridutt) profile picture

ML PhD @ucl | @adobe | ex @nvidia | @ELLISforEurope | Interested in visual generation

London, UK
Joined July 2012
Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)Photo by Niladri Dutt (@niladridutt)
🎉 LoST: Level of Semantics Tokenization (CVPR 2026) What if 3D generation didn’t start from coarse geometry, but from semantics? We introduce LoST, a semantic-first 3D tokenizer that orders tokens by semantic salience, so even very short prefixes can already decode into complete, plausible, recognizable 3D shapes 🧩 Early tokens capture the principal semantics. Later tokens refine the details. Result: Generate 3D shapes starting from as few as 1 token! The goal is to have high fidelity shapes even with very few tokens, with more tokens semantic alignment increases. Project: lost3d.github.io/ Paper: arxiv.org/abs/2603.17995 @CVPR @AdobeResearch @Adobe
4
20
117
6,669
Really cool work and shows how one can enable various levels of detail during generation. Checkout our #CVPR 2026 work on 3D generation-- Level of Semantics Tokenization for 3D Shapes lost3d.github.io/ Code is now released.
Diffusion models spend the same compute on a blank wall as on a face. But you often know in advance where the detail will be. Introducing Level-of-Token (LoT) Diffusion: we turn that knowledge into a multiresolution token layout, with fine tokens where detail is needed and coarse tokens elsewhere. 1/9🧵
4
226
Excited to announce the @TheBMVA Symposium on World Models! 🌍 📍 London | 🗓 Nov 18, 2026 We have an amazing lineup of speakers joining us! Check out the full program, registration, and poster submission details:bmva.org/meetings/26-11-18-W… #AI #worldmodels #computervision
1
14
1,476
Join us at the Visual Concepts Workshop at CVPR!
The Visual Concepts Workshop is coming soon to @CVPR 2026! Join us on June 4 for an exciting discussion on all aspects of visual concepts: from discovery and reasoning, to controllable generation, robotics, and more! Hope to see you in Denver! #CVPR
3
247
Excited to share the 3rd Workshop on Visual Concepts at @CVPR 2026! Call for papers is now open till April 1. We welcome submissions on the following topics. See our website for more info: sites.google.com/stanford.ed… Join us in Denver! #CVPR2026
6
23
4,004
Animation brings characters to life 🎬✨ Introducing our #SIGGRAPHAsia '25 (TOG) paper: Self-Supervised Motion Fields (SMF) that can transfer motion from any source (even 2D video) to any stylized character! 🚫 No Rigging 🚫 No Templates (SMPL) ✅ Any source 🧵Thread👇
2
1
7
487
Using our proposed Kinetic Code space trained on human motions alone (AMASS) it generalizes to stylized cartoons & creatures. 🤖👹 Here's a motion from Mixamo (out-of-distribution) source
1
44
Can an LLM learn professional photo retouching by solving puzzles? Our new work, MonetGPT, presented at #SIGGRAPH2025, shows it can. By solving visual puzzles, our MLLM becomes operation-aware and develops image aesthetics. Check out our blog from @AdobeResearch & code below👇 #AI #MLLM
2
7
322
🧵1/10 Excited to share our @siggraph paper "MonetGPT: Solving Puzzles Enhances MLLMs' Image Retouching Skills" 🌟 We explore how to make MLLMs operation-aware by solving visual puzzles and propose a procedural framework for image retouching #SIGGRAPH #MLLM
1
2
1
9
675
🧵2/10 MLLMs lack the visual understanding to plan edits. 🧠 So, we use expert photos as our ground truth and work backward, procedurally creating puzzles by assuming any change to an expert edit makes it less optimal
1
62
Hi Londoners Join us on April 15 for an evening on Gen AI for 3D at UCL! We have an amazing list of keynote speakers and lightning talks. Register at londongenai.github.io Very excited to co-organize this with Michael and Preddy!
1
96
Come check out our #ECCV2024 poster today- Temporal Residual Jacobians for Rig-free Motion Transfer 📅 10/1 (Today) 4:30 PM - 6:30 PM 📍Poster #216 🔗 temporaljacobians.github.io/
13
328
Thanks @_akhaliq for featuring our paper on @huggingface Excited to share that our work-Temporal Residual Jacobians has been accepted at #ECCV'24! @eccvconf
Temporal Residual Jacobians For Rig-free Motion Transfer We introduce Temporal Residual Jacobians as a novel representation to enable data-driven motion transfer. Our approach does not assume access to any rigging or intermediate shape keyframes, produces geometrically and
1
8
652
🧵I'm excited to share that our paper "Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Features" has been accepted at @CVPR 2024! A big thank you to my co-authors. Project page- diff3f.github.io/ arXiv- arxiv.org/abs/2311.17024 #CVPR2024
8
6
1
39
4,466
Diff3F is a feature distiller that harnesses the expressive power of inpainting diffusion features and distills them to points on 3D surfaces. The descriptors allow zero-shot shape correspondence and part segmentation and lead to excellent performance on multiple datasets.
1
3
271
Thank you for sharing our work! You can find more details and visual results on our project website- proteusnerf.github.io/
ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context Binglun Wang, Niladri Shekhar Dutt, Niloy J. Mitra tl;dr: simple, fast, and lightweight NeRF editing setup arxiv.org/pdf/2310.09965.pdf
1
1
10
810
1. Basic 2. Java 3. C 4. Python 5. Matlab 5. C++ 6. Assembly 7. JavaScript 8. Go
in what order did you learn your languages? 1. python 2. R 3. haskell 4. C 5. rust 6. scheme 7. {java,type}script 8. clojure 9. scala 10. java 11. idris 12. go
1
172
We were a team of 6 when we started building @nftport_xyz . Can't believe how far we've come in just 1 year! 🚀🌚
⚡🎉 We are excited & grateful to announce we’ve raised $26M to become the leading #NFT infrastructure! ⚡🎉 Our mission is to enable developers to build an Internet owned by citizens Thank you for trusting us @taavet @seikatsu @atomico @IDEOVC @protocollab & more in 🧵
2
1
1
17
The dogefather doing dogestats
Introducing Elon-sampling
3
Andrew Ng's latest newsletter just arrived! Here's some wisdom on the difference between thinking tactically and thinking strategically.   @deeplearningai_
1
7
Oooof
Saying you will solve general AI is a bit like saying you will solve computer science: generality in artificial intelligence is not a riddle to be solved. It isn't a single problem, it isn't a single technology.
1
1