
PhD candidate @northwesternu. Prev. student researcher @google, alum of @ucberkeley and @utaustin computer science.
Chicago
Joined September 2019
- Tweets124
- Following168
- Followers170
- Likes706
Luke Strgar retweeted
Our new work, The AI Picbreeder Experiment, explores the use of frontier models as drivers of synthetic open-endedness.
If we're serious about putting these things in the driver's seat of a new and automatic science, then we need to know what they're really made of in terms of the ability to create and discover through intuition. Giving shape to the formless, making decisions based on vibes, having "taste"—whatever you want to call it—Can they do it? Do they have the sauce?
Picbreeder, a website where human users collaborated to spontaneously evolve images, is just the sauce-bearing test we need. Here, images were represented as neural networks that could be bred and mutated, with humans playing the role of natural selectors. By design, this interface prohibits the creative baggage of premeditation, of having goals in advance, and demands the artist patiently follow the flow of the work and seize upon serendipitous opportunities when they arise. It's more like catching fish from a stream than drawing a picture. And yet, distributing their work across many sessions, and branching and remixing each other's creations, humans were ultimately able to bend these neural networks into all manner of interesting, evocative, and striking images.
So, can large vision language models do the same? On the blog, we've built an interactive archive viewer that allows visitors to walk through galleries of Picbreeder images created by both humans and AI, and judge for themselves.
Call us old fashioned, but we're pretty sure the human output has something special that the AI can't quite yet replicate. We design a number of evaluation metrics to get at this quality. We ask: "How visually different are the images in the archive? How much do they look like real things? How different are the things they look like?"
The numbers show the humans coming out on top. And looking at the AI-generated archives and lineages, we find traces of an anxious attachment to plans and objectives. Often, even when the AI makes an apparent creative leap—e.g. transforming an image of a hood ornament into a side view of a car—it really stays stuck in place in some broader semantic/thematic space. And that's to say nothing of the handful of archives littered almost entirely with top-down views of soda can pull tabs, or high frequency circular patterns that appear chaotic and uninteresting to us, but apparently scratch some perceptual itch in the agents.
And yet we're optimistic. Though the AI's output is less refined, its movement through the stream of images less graceful and vivacious than our own, what we have here is a plausible model organism of open-endedness. The agents indeed (re)discover distributions of novel and interesting images when left to their own devices. They display a keen eye (even sometimes discovering optical illusions that might slip by a casual glance from a human), and explore persistently under considerable creative constraints. This allows us to model factors that are consequential to such open-ended exploration; i.e. injecting noise into the agents' decision making process, playing with their memory, and seeding them with subtly distinct personalities—all of which can be beneficial in the right doses.
And there's something to be said for searching without objectives. Prior work shows that if we optimize Picbreeder's pattern-producing neural networks to resemble a particular image (say, a skull), these representations will be fractured (meddling with their internal weights will immediately explode the skull beyond recognition), while the same neural image found by humans via open-ended exploration is robust to such perturbations, and even shows meaningful variations across them (e.g. the jaw opening and closing). Our VLM agents also stumbled upon images of skulls. Their representations are not as neatly semantically factorized as those discovered by humans, but neither are they nearly as fractured as those discovered by optimization.
This suggests that if we want to have AI build the next generation of AI, then it will be crucial to let them attack this problem through aimless wandering. Without this freedom, future models will be brittle and myopic; with it, they will have developed a more thorough model of the world, and an improved capacity for the kind of creative insight that is so quietly fundamental to the most meaningful of human endeavors.
The AI Picbreeder Experiment: Can AI agents be creative when nobody tells them what to create?
Blog: pub.sakana.ai/picbreeder-vlm
In our new #GECCO2026 paper, "In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models", in collaboration with MIT and NYU, we revisit Picbreeder, a lost website where people collaboratively evolved images without any predefined objective. Users simply selected images they found interesting, allowing unexpected forms such as faces, animals, vehicles, and skulls to emerge gradually across many generations and many different people.
We recreated this process using vision-language model agents. The agents explore a shared archive, choose images to branch from, evolve new candidates, publish their favorites, and evaluate the creations of other agents. There is no target image and no explicit definition of what counts as progress.
The results reveal both the promise and current limitations of AI-driven open-ended discovery.
Compared with humans, VLM agents tend to keep circling back to the same kinds of images and concepts. They repeatedly select similar parents, make smaller conceptual leaps, and often refine an existing idea rather than abandoning it in search of something genuinely unexpected.
However, introducing a diverse population of agent personalities substantially improves exploration. In some runs, diverse agent populations approached or matched the human archive on measures of semantic diversity and produced more balanced evolutionary trees.
We also find intriguing evidence that open-ended evolution can produce more robust representations. A skull evolved by the agents changes smoothly when its underlying neural representation is perturbed, less fractured than a skull directly optimized with gradient descent, although still less cleanly disentangled than one evolved collectively by humans.
But perhaps the most interesting result is the gap that remains.
Humans appear better at turning fortunate accidents into sustained creative discoveries: recognizing when something unexpected is worth pursuing, refining it, and then making a larger conceptual leap. The AI agents often notice interesting patterns too, but are more likely to become trapped in them.
We still do not fully understand what enables humans to navigate open-ended search in this way, or what ingredient(s) current AI systems are missing. For now, the results suggest that there remains something important about human creativity that AI agents have not yet learned to reproduce.
This paper will be presented at #GECCO2026 and is nominated for a best paper award! Please check out the interactive blog and technical paper for more details!
Read our full paper: arxiv.org/abs/2605.23908 🐟
Luke Strgar retweeted
Neural CAs are amazing, but they've never scaled past low resolution.
We propose a simple solution that allows an ~8x resolution boost with minimal extra parameters.
The core idea: Treat cells as local neural fields instead of pixels.
Try the demo: cells2pixels.github.io/
🧵
Luke Strgar retweeted
Replying to @LukeStrgar @iclr_conf
The code is now available! Please reach out if you have any questions about usage or just want to chat 🧑💻
github.com/lstrgar/codesign-…
Luke Strgar retweeted
Replying to @iclr_conf
@iclr_conf this week! P3-1109 at 3:15 on Saturday. Reach out or swing by if you want to hang or talk universal controllers x robot co-design 🦾🇧🇷🏖️ – at Rio de Janeiro, Brazil
Luke Strgar retweeted
New essay: Beyond Slop
Reflections on 6 years making creative AI tools and why the field feels stuck on content production rather than personal expression.
We're building molds with dials rather than new clay.
On embracing craft, process, and open-ended mediums (with some new demos!)
joelsimon.net/beyond-slop
Luke Strgar retweeted
A massive new study on peak performance included 34,000 international top performers: Nobel laureates, renowned classical music composers, Olympic champs, and the world’s best chess players. It shows early specialization is a trap, and the road to greatness is long and varied.
Luke Strgar retweeted
Excited to announce our MIT Press book “Neuroevolution: Harnessing Creativity in AI Agent Design” by Sebastian Risi (@risi1979), Yujin Tang (@yujin_tang), Risto Miikkulainen, and myself.
We explore decades of work on evolving intelligent agents and shows how neuroevolution can drive creativity in deep learning, RL, LLMs and AI Agents!
📖 Free open-access edition: neuroevolutionbook.com
In addition to our own works, this video features work by Jürgen Schmidhuber (@SchmidhuberAI), Seth Bling (@SethBling), Igor Karpov, Jacob Schrum, Yulu Gan (@yule_gan), Ken Stanley (@kenneth0stanley), Joel Lehman (@joelbot3000), Jeff Clune (@jeffclune), Nick Cheney (@CheneyLab), Richard Song (@XingyouSong), Chelsea Finn (@chelseabfinn), Julian Togelius (@togelius), Sam Earle (@Smearle_RH), Hod Lipson (@hodlipson), and Jean-Baptiste Mouret (@jb_mouret).
Luke Strgar retweeted
We built a robot brain that nothing can stop.
Shattered limbs? Jammed motors? If the bot can move, the Brain will move it— even if it’s an entirely new robot body.
Meet the omni-bodied Skild Brain:
Luke Strgar retweeted
A world model inside a world model 🌏
Luke Strgar retweeted
"I promise to not raise your taxes" and "I promise to not cut your benefits" are the two popular political promises that are inconsistent with the much more needed promise "I promise to cut the budget deficit to about 3 percent of GDP" that is required to prevent a big debt/dollar crisis. There is no way that the deficit/debt bomb problem can be sustainably dealt with unless there is a mix of tax revenue increases and spending decreases that are determined in a bipartisan way. Our representatives in Washington, DC, both Republicans and Democrats, know this is true. They understand the need to reduce the deficit by having those from both sides chip in a bit (e.g., a 4 percent increase in tax revenue and a 4 percent spending cut) which would lead to a supply/demand balance improvement for US debt which in turn would lower interest rates. Lower interest rates would help reduce the budget deficit as well as help the markets and the economy. But because politics have become so absolutist, they feel they can't go down this obviously best path because both their constituents and their parties will throw them out of office if they explored this more balanced approach. To me, that’s a tragedy.
Luke Strgar retweeted
It's already the case that people's free will gets hijacked by screens for hours a day, with lots of negative consequences. AI video can make this worse, since it's directly optimizable.
AI video has positive uses, but most of it will be fast food for the mind.
Very impressed with Veo 3 and all the things people are finding on r/aivideo etc. Makes a big difference qualitatively when you add audio.
There are a few macro aspects to video generation that may not be fully appreciated:
1. Video is the highest bandwidth input to brain. Not just for entertainment but also for work/learning - think diagrams, charts, animations, etc.
2. Video is the most easy/fun. The average person doesn't like reading/writing, it's very effortful. Anyone can (and wants to) engage with video.
3. The barrier to creating videos is -> 0.
4. For the first time, video is directly optimizable.
I have to emphasize/explain the gravity of (4) a bit more. Until now, video has been all about indexing, ranking and serving a finite set of candidates that are (expensively) created by humans. If you are TikTok and you want to keep the attention of a person, the name of the game is to get creators to make videos, and then figure out which video to serve to which person. Collectively, the system of "human creators learning what people like and then ranking algorithms learning how to best show a video to a person" is a very, very poor optimizer. Ok, people are already addicted to TikTok so clearly it's pretty decent, but it's imo nowhere near what is possible in principle.
The videos coming from Veo 3 and friends are the output of a neural network. This is a differentiable process. So you can now take arbitrary objectives, and crush them with gradient descent. I expect that this optimizer will turn out to be significantly, significantly more powerful than what we've seen so far. Even just the iterative, discrete process of optimizing prompts alone via both humans or AIs (and leaving parameters unchanged) may be a strong enough optimizer. So now we can take e.g. engagement (or pupil dilations or etc.) and optimize generated videos directly against that. Or we take ad click conversion and directly optimize against that.
Why index a finite set of videos when you can generate them infinitely and optimize them directly.
I think video has the potential to be an incredible surface for AI -> human communication, future AI GUIs etc. Think about how much easier it is to grok something from a really great diagram or an animation instead of a wall of text. And an incredible medium for human creativity. But this native, high bandwidth medium is also becoming directly optimizable. Imo, TikTok is nothing compared to what is possible. And I'm not so sure that we will like what "optimal" looks like.
Luke Strgar retweeted
The 80-year recipe stoking America’s Prosperity:
1) Free-market capital investments in brilliant ideas…
2) enabled by Engineering Innovations…
3) based on Science Research in Universities…
4) funded by Grants from the US Government.
It’s time more people understood this.
Luke Strgar retweeted
We can do so much better in robotics than five fingers and two arms.
We're just getting started optimizing that outer loop of form factors.
Luke Strgar retweeted
HAND ERC will develop dexterous robot hands with the ability to assist humans with manufacturing, caregiving, handling precious or dangerous materials, and more.
The NSF grant marks the first time Northwestern has led an Engineering Research Center. spr.ly/6013lvCIt
Luke Strgar retweeted
Historically, there has been an inverse relationship between how human-like a robot looked and how useful it turned out to be.
A simple explanation would be that the morphology of a robot is a critical affordance available to the robot's maker to make it more useful on its target tasks, and by not leveraging it, the robot ends up at a huge functional disadvantage (while looking cool and futuristic)...
By making robots that are human-like, you're signaling that you're mostly interested in sci-fi vibes, at the expense of solving a specific set of useful problems
























