Joined January 2024
Excited to share our latest breakthrough! We trained sparse autoencoders to decompose intermediate results of SDXL Turbo's forward pass. These autoencoders learn highly interpretable features that can be used to manipulate the image generation process. arxiv.org/abs/2410.22366
4
12
7
67
14,759
Viacheslav Surkov retweeted
I am very excited to share that our paper, "One-Step is Enough: Sparse Autoencoders for Text-to-Image Diffusion Models" will be presented at #NeurIPS2025! @ViaSurkov is presenting it at #MexIPS2025: ๐Ÿ“๐ˆ๐Ÿ ๐ฒ๐จ๐ฎ ๐š๐ซ๐ž ๐š๐ญ๐ญ๐ž๐ง๐๐ข๐ง๐  ๐๐ž๐ฎ๐ซ๐ˆ๐๐’ ๐ข๐ง ๐Œ๐ž๐ฑ๐ข๐œ๐จ ๐‚๐ข๐ญ๐ฒ, ๐ฉ๐ฅ๐ž๐š๐ฌ๐ž ๐ฌ๐ญ๐จ๐ฉ ๐›๐ฒ! Date: Thursday, Dec 4, 2025 Time: 11:00 AM โ€“ 2:00 PM PST Location: Foyer (Mexico City Poster Session) Come visit @ViaSurkov it's his first conference and he will be happy to explain his amazing work. Sadly, #NeurIPS2025 does not allow for parallel presentation in San Diego. However, I am in San Diego and happy to meet up / chat. Please don't hesitate to reach out here or via [email protected]. Once again, a big shout out to our brilliant students Viacheslav Surkov and Antonio Mari who did phenomenal work here and pushed this work (that started as a class project more than a year ago) all the way to pass the high threshold of #NeurIPS2025. Also, I want to thank manifund.org/ (@andyarditi and @ryan_kidd44 in particular) for helping us to finance Viacheslav Surkov's conference trip. Please find more information about our work below. We have so many amazing interactive materials (e.g., 3x huggingface demo spaces) for you to check out. Most of our implementations are open-sourced (RIEBench on FLUX, which we added to our appendix during the NeurIPS rebuttal is currently missing but we plan to add it ASAP). Me demoing the demo attached.
How do diffusion models create images and can we control that process? We are excited to release a update to our SDXL Turbo sparse autoencoder paper. New title: One Step is Enough: Sparse Autoencoders for Text-to-Image Diffusion Models Spoiler: We have FLUX SAEs now :)
12
1
78
12,018
Viacheslav Surkov retweeted
How do diffusion models create images and can we control that process? We are excited to release a update to our SDXL Turbo sparse autoencoder paper. New title: One Step is Enough: Sparse Autoencoders for Text-to-Image Diffusion Models Spoiler: We have FLUX SAEs now :)
3
18
4
65
14,448
Viacheslav Surkov retweeted
We also have a website sdxl-unbox.epfl.ch and a paper arxiv.org/abs/2410.22366 Also I should have probably provided some of the results already at the first post...
In case you ever wondered what you could do if you had SAEs for intermediate results of diffusion models, we trained SDXL Turbo SAEs on 4 blocks for you. We noticed that they specialize into a "composition", a "detail", and a "style" block. And one that is hard to make sense of.
8
2
52
10,237
Viacheslav Surkov retweeted
In case you ever wondered what you could do if you had SAEs for intermediate results of diffusion models, we trained SDXL Turbo SAEs on 4 blocks for you. We noticed that they specialize into a "composition", a "detail", and a "style" block. And one that is hard to make sense of.
2
6
2
52
7,036
Viacheslav Surkov retweeted
9th highest scored ICLR 2025 paper 8,8,8,10. Worth noting all reviewers increased their scores by 2 after rebuttals tldr: they introduce a bunch of architectural changes to a diffusion transformer, getting 100x speed improvements with no real quality impacts
8
99
6
1,129
133,172
We also found that transformer blocks play different roles in the generation process: down.2.1 - scene composition up.0.1 - texture and style up.0.0 - local details mid.0 - more abstract information
1
5
508
Kudos to the collaborators who made this possible! @wendlerch @MiTerekhov @jdeschena @cervisiarius @caglarml
1
7
400
Highly appreciate the initial contribution of Danila Zubko, the valuable discussions and feedback from @davidbau @im_td @NivCohenHuji @gytdau and Alexander Sharipov Many thanks to @StabilityAI for creating SDXL Turbo
1
7
428
Letโ€™s try to generate an image with an empty prompt and enable only one feature. This results in meaningful images highlighting the same concepts as above: faces, dishes, lights and tents!
1
1
5
402
Take a look at images where these features are most prominent. They correspond to similar objects as above. E.g. 4539 activates on funny animal faces, while 450 highlights dishes.
1
6
441
First, we generate an image with a fun prompt. Below are the SAE features that are most active during a forward pass through one of transformer blocks.
1
3
458
Stable Diffusion XL Turbo can generate images in 1-4 denoising steps We trained Sparse autoencoders (SAEs) on updates of 4 transformer blocks within SDXL Turbo's U-net This resulted in 20480 features Explore these features in our demo! huggingface.co/spaces/surokpโ€ฆ
1
1
6
813
Viacheslav Surkov retweeted
This summer, a students' team from EPFL's @BernoulliCenter traveled to Bulgaria for the International Mathematics Competition. They came back with several medals and prizes and took the 7th place as a team. Congratulations to all of them! bernoulli.epfl.ch/epfl-studeโ€ฆ
4
18
2,124
Viacheslav Surkov retweeted
shout out to my amazing collaborators: @ViaSurkov, @VminVsky, @russogiusep, @cervisiarius, and @caglarml paper link: arxiv.org/abs/2407.06946
1
2
6
662