Christophe Combelles

LLMs accumulate a lot of declarative knowledge. That's how they can answer a large number of questions. That's also why they require so many parameters and hence so much memory. But one can replace the accumulation of knowledge by *understanding* That what JEPA world models do. That's one reason they can be useful with considerably less memory and training data than LLMs. This paper merely shows that the underlying similarity structure of the data, whether text or image (e.g. co-occurence of words in text or objects in images) uniquely determines the shape of the representation point cloud, when the encoder is trained trained with a common anti-collapse criterion like SIGReg or VCReg (not by reconstruction).

Unveiling our new startup Advanced Machine Intelligence (AMI Labs). We just completed our seed round: $1.03B / 890M€, one the largest seeds ever, probably the largest for a European company. We're hiring! [the background image is the Veil Nebula - a picture I took from my backyard, most appropriate for an unveiling] More details here: techcrunch.com/2026/03/09/ya…