Yann LeCun's latest talk at ETH Zürich "You should not work on LLM. At least if you're in academia, you should absolutely not work on LLMs. There is nothing you can bring to the table. If you're interested in making real progress in AI, in sort of grounded AI for the real world, if you want physical AI, don't work on LLMs, and don't work on generative models either. So, as you can probably guess, this does not make me very popular in Silicon Valley." ---- From "Perfology Clips" YouTube channel, (link in comment)

We are excited to share our latest work, together with @nyuniversity: "Dream-Cubed: Controllable Generative Modeling in Minecraft by Training on Billions of Cubes." Blog: pub.sakana.ai/dream-cubed Paper: arxiv.org/abs/2604.22847 Code: github.com/SakanaAI/DreamCub… Generative AI has made incredible progress in language modeling, far beyond other modalities, where words and tokens offer a natural compositional unit for scalable training. This is similar to Minecraft and many other popular video games, where developers rely on cubes, tiles, and other discrete primitives to build rich, interactive worlds. In this work, we show that using cubes as tokens allows large transformers to do the same. Our contribution is two-fold: 1/ We release Dream-Cubed to the research community, a large-scale dataset of Minecraft worlds designed for generative modeling. Our data comprises tens of billions of carefully-balanced cubes from procedurally generated Minecraft terrain and high-quality human-authored maps (obtained with the authors' consent). 2/ We use our data to train a family of powerful transformers for efficient generation of interactive 3D environments at cube resolution. We show how our models allow players to mold the world around them by generating structures, terrain, and maps that are immediately editable and playable. Using high-quality data, we demonstrate that these models can be successfully trained with different training objectives, including both continuous and discrete diffusion, unlocking targeted inpainting, large-scale outpainting, and user-conditioned generation of infinitely sized worlds with fine-grained block-level control.