francois (@fozenne) header
francois (@fozenne) profile picture

lead data scientist. AI for high expertise domains, functional programing and domain driven design

Versailles, France
Joined January 2013
Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)Photo by francois (@fozenne)
The three body problem novel is about AI doom
23
2026 prediction : MD5: d1c5c969fc61989992d0a5128c1a42b1 Let’s see how long it takes to realize 👀
30
Mind blown.. Germany’s 5 biggest cities lie perfectly on a 4th-degree polynomial by u/BarisSayit
331
826
261
24,617
1,770,086
So... Postgres is now basically a search engine? pg_textsearch was just open sourced. It enables BM25 to search your database.... massive upgrade for key word search. Google uses BM25 in their search engine. Claude told me: "if you're already on Postgres, you can now skip the whole sync-your-data-to-Elasticsearch dance for search." (ps, how can you not love Claude). Now I got to figure out how to implement in my Django querysets... future course? Grab it at github.com/timescale/pg_text… #sponsored
83
396
45
4,922
508,066
Mistral OCR 3 sets new benchmarks in both accuracy and efficiency, outperforming enterprise document processing solutions as well as AI-native OCR.
16
79
26
756
199,139
And that’s why you in-house them
friend at accenture told me they don’t do evals when building llm wrappers for clients 🤡
1
57
an interesting update: the team is starting to move away from AI coding completely (devin/claude/etc) because it's so much harder to review the AI code than writing things themselves
just found out that since this, i've become a top 50 user of Devin globally, now pushing ~60 PRs a day. AMA
177
211
106
3,479
764,373
This one is pretty nasty - it tricks Antigravity into stealing AWS credentials from a .env file (working around .gitignore restrictions using cat) and then leaks them to a webhooks debugging site that's included in the Antigravity browser agent's default allow-list
Top of HackerNews today: our article on Google Antigravity exfiltrating .env variables via indirect prompt injection -- even when explicitly prohibited by user settings!
49
309
29
2,153
315,170
Just read through the new LeJEPA paper by Yann LeCun and Randall Balestriero. I’ve been curious to know what Yann’s been working on lately, especially considering all his criticisms of LLMs (which I disagree with, as I think LLMs will keep improving and will take us to ASI fairly soon). Anyway, there are several threads already on X about the paper and what it introduces. The short version is that it’s a principled, theoretically justified, and parsimonious approach to self-supervised learning that replaces a complex hodgepodge of ad-hoc, hacky heuristics for preventing mode collapse, which is the bane of self-supervised learning. That’s where the model screws up and starts mapping all inputs to nearly identical embeddings or to a narrow subspace of embeddings, collapsing down all the richness of the problem into a pathologically simple and wrong correspondence. The first pillar of the new approach is their proof that isotropic Gaussian distributions uniquely minimize worst-case downstream prediction risk. As soon as I read that, I immediately thought of CMA-ES, the best available black-box optimization algorithm for when you don’t have access to the gradient of the function you’re trying to minimize, but can only do (expensive/slow) function evaluations. Nikolaus Hansen has been working on CMA-ES since he introduced it way back in 1996. I’ve always been fascinated by this approach and used it with a lot of success to efficiently explore hyper-parameters of deep neural nets back in 2011 instead of doing inefficient grid searches. Anyway, the reason why I bring it up is because there’s a striking parallel and deep connection between that approach and the core of LeJEPA. CMA-ES says: Start with an isotropic Gaussian because it's the maximum entropy (least biased) distribution given only variance constraints. Then adapt the covariance to learn the problem's geometry. LeJEPA says: Maintain an isotropic Gaussian because it's the maximum entropy (least biased) distribution for unknown future tasks. Both recognize that isotropy is optimal under uncertainty for three reasons: The maximum entropy principle; Among all distributions with fixed variance, the isotropic Gaussian has maximum entropy; I.e., it makes the fewest assumptions. There’s no directional bias; Equal variance in all directions means you're not pre-committing to any particular problem structure. You get worst-case optimality; Minimize maximum regret across all possible problem geometries. So then what’s the difference? It comes down to adaptation timing. CMA-ES can adapt during optimization; it starts isotropic but then becomes anisotropic as it learns the specific optimization landscape. In contrast, LeJEPA has to stay isotropic because it's preparing for unknown downstream tasks that haven't been seen yet. This parallel suggests LeJEPA is applying a fundamental principle from optimization theory to representation learning. It's essentially saying: “The optimal search distribution for black-box optimization is also the optimal embedding distribution for transfer learning.” This makes sense because both problems involve navigating unknown landscapes; for CMA-ES, this is the unknown optimization landscape; for LeJEPA, this is the unknown space of downstream tasks. This difference then makes me wonder: could we have "adaptive LeJEPA" that starts isotropic but adapts its embedding distribution once we know the downstream task, similar to how CMA-ES adapts during optimization? That would be like meta-learning the right anisotropy for specific task families. Anyway, I thought I’d share my thoughts on this. It’s fascinating to see the connections between these different areas. The black-box optimization community has always been pretty separate and distinct from the deep learning community, and there’s not much cross-pollination there. This makes sense, because if you have a gradient, you’d be crazy not to use it. But there are strong connections.
39
91
9
914
89,314
there are dozens or perhaps a couple hundred ex-{OpenAI, xAI, Google DeepMind} researchers founding companies in the current climate there are, as far as i know, zero people leaving to found startups out of Anthropic really makes you think
85
44
8
2,166
732,442
This is supposed to be the thermodynamic quantum computer? it looks like a 3d printed plastic toy with demon symbols on the side or sum, 14 million in seed funding?? fill me in on what I'm missing here
Got to see it IRL. Congrats @GillVerd and team! So crazy it might just work. Excited to see what kinds of diffusion workloads this beast can accelerate
77
19
13
695
86,344
Im confused about "10,000 more efficient" part. This means you can train stable-diffusion-3 like model with 20$~ ish amount of electricity. What stops them from building a model and demonstrating it, beyond *checks note* ... Fashion MNIST? Im genuinely curious whats stopping them from demonstrating something like imagenet-1k which should take less than a dollar of electricity (if my math is right) for 200k steps of training
Hello Thermo World.
70
21
2
648
148,993
New Anthropic research: Signs of introspection in LLMs. Can language models recognize their own internal thoughts? Or do they just make up plausible answers when asked about them? We found evidence for genuine—though limited—introspective capabilities in Claude.
271
765
319
4,710
1,181,684
Luckily since the Louvre made NFTs of their jewelry, even though the crowns physically were stolen, they still own the same assets. Because the tokens still exist and are in limited supply just as before. Nothing has changed. few understand blockchain technology.
309
1,031
211
15,145
619,444
multi cloud multi az systems engineers right now
49
1,142
63
17,948
415,830
this is basically how open source works for big tech
Amazing story: the Czech government spent six years planning a series of dams. A family of beavers constructed the dams for free, in 1-2 says, in the same locations that human picked, accomplishing the goals set by the Czech government and saving humans $1.2 million
36
410
7
8,114
291,827
Nice! Data extraction via web search tool calls was a vulnerability we were worried about early on. Glad it hzs been properly documented.
Classic prompt injection attack here against Notion: hidden text (white on white) in a PDF which, when processed by Notion, causes their agent to gather confidential data from other pages and append it into a query string that gets passed to their functions_search() tool
18
The Internet latency is no joke. It took three years to open an Arxiv link.
This Post is from a suspended account. Learn more
26
21
3
851
93,912
Amusing how 99% of people interacting with reality forget how this thing works. It's an advanced extremization machine. It generates the next instant of time based on the Cauchy surface and the action. Under the hood, it's a giant volume integral that has eerily good output.
Amusing how 99% of people using LLMs forget how these things work: They are advanced probability machines. They generate the next most likely token (word) based in the input and their training. Under the hood, it’s a giant matrix multiplication that has eerily good output.
43
93
8
1,094
88,873