Lightly retweeted
The ducks are on the move! 🦆✈️
Off to #ICCV in Hawaii 🌴
Excited to meet the CV community, learn, and share what we’ve been building at Lightly.
Spot two yellow ducks at the airport or the conference? That’s us - come say hi!
#ICCV25 @ICCVConference
Lightly retweeted
Also: yes, it's a JEPA. Yes, you hated on @ylecun , but he was right. Yes, as usual
Lightly retweeted
Turns out you don't need that much data or compute to get a reasoning model from a high quality base model.
@ylecun was right
Lightly retweeted
Always find it amazing to contemplate this chart (just updated for Wednesday's class).
Lightly retweeted
📊 Key findings:
Two-layer MLP beats simple tasks like MNIST reveal VLM blind spots, even with tailored prompts or vast training data.
Lightly retweeted
Llama 3.3 70B is now live on Cerebras Inference!
Meta's new 70B model reaches 405B accuracy and Cerebras gives it a 10x speed boost.
Available via chat & API: inference.cerebras.ai
Lightly retweeted
Paper discussion happening now (in 10mins) live on Discord. We'll discuss
"Convolutional Differentiable Logic Gate Networks"
ykilcher.com/discord
Lightly retweeted
The discrete Fourier basis is a sampling of the continuous Fourier basis. They are both orthogonal. This is (almost) magic! en.wikipedia.org/wiki/Discre…
Lightly retweeted

Yann LeCun@ylecun6 Nov 2024
United States
United StatesConnected via United States Android AppAccount-level information, not a live location or per-post device.
Not a surprising result.
But good that someone tried this out.
Curious whether video generation models (like #SORA) qualify as world models?
We conduct a systematic study to answer this question by investigating whether a video gen model is able to learn physical laws.
Three are three key messages to take home:
1⃣The model generalises perfectly for in-distribution data, but fails to do out-of-distribution generalization. For combinatorial scenarios, scaling law is observed.
2⃣The models fail to abstract general rules and instead tries to mimic the closest training example.
3⃣The model prioritizes different attributes when referencing training data: color > size > velocity > shape.
This work is a joint effort with our outstanding intern @YangYue_THU.
Paper: arxiv.org/abs/2411.02385
Webpage: phyworld.github.io/
Lightly retweeted

Andrej Karpathy@karpathy28 Oct 2024
United States
United StatesConnected via United States App StoreAccount-level information, not a live location or per-post device.
Voting season is upon us! For those living in SF / Bay Area, each time I recommend the @GrowSF voting guide as a great starting point for the local elections - it is long, detailed, educational, and sensible. O(~hundreds) of votes matter on local elections
growsf.org/voter-guide/
Lightly retweeted

Steve Rattner@SteveRattner29 Oct 2024
United States
United StatesConnected via United States App StoreAccount-level information, not a live location or per-post device.
Global oil supply is set to outpace demand in 2025, making a fall in energy prices likely whether or not Trump gets the chance to implement his big drilling plans.
cc: @axios
Lightly retweeted
The l^p functional is convex and hence a norm for p>=1. It is sparsity-inducing for p<=1. The l^1 norm is the heart of the lasso, aka basis pursuit. en.wikipedia.org/wiki/Basis_… en.wikipedia.org/wiki/Lasso_…
Lightly retweeted
Come chat with us about the paper
"Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo"
6pm UTC (in 15mins) ykilcher.com/discord
Lightly retweeted
Come chat with us about Representation Editing!
6pm UTC on discord (30mins from now): ykilcher.com/discord
Lightly retweeted

Brian Chau@brianchau5727 Sep 2024
United States
United StatesConnected via China Android AppAccount-level information, not a live location or per-post device.
Hi @lessig. Here's the bill cosponsor talking about how his "priority" is purely speculative "risk of extinction from AI".
Let's debunk this lie. SB 1047 would not exist in ANY form if not for doomsday science fiction and the billionaire backers of this bill. 🧵
Lightly retweeted
Come chat with us about "Neural Operator: Learning Maps Between Function Spaces" tonight on discord!
6pm UTC (1h from now) ykilcher.com/discord
Lightly retweeted
The continuous wavelet transform was introduced by Grossman and Morlet. The decay of wavelet coefficients across scales characterizes the local regularity of a function. en.wikipedia.org/wiki/Contin…
Lightly retweeted
🚨New paper: Source2Synth🚨
- Generates synthetic examples grounded in real data
- Curation step makes data high quality based on answerability
- Improves performance on two challenging domains: Multi-hop QA and using tools: SQL for tabular QA
arxiv.org/abs/2409.08239
🧵(1/4)
Lightly retweeted
Great feature in the @NYUDataScience blog on "LiveBench"—a new method for challenging lanuage models from Yann LeCun (@ylecun), Micah Goldblum (@micahgoldblum), Chinmay Hegde (@chegday), Ravid Shwartz-Ziv and others... nyudatascience.medium.com/li…































