Improve machine learning models by curating vision data. Join our Discord https://xitter.cf/t.co/u8EYR81dE1

San Francisco
Joined February 2020
The ducks are on the move! 🦆✈️ Off to #ICCV in Hawaii 🌴 Excited to meet the CV community, learn, and share what we’ve been building at Lightly. Spot two yellow ducks at the airport or the conference? That’s us - come say hi! #ICCV25 @ICCVConference
1
5
265
Also: yes, it's a JEPA. Yes, you hated on @ylecun , but he was right. Yes, as usual
Want strong SSL, but not the complexity of DINOv2? CAPI: Cluster and Predict Latents Patches for Improved Masked Image Modeling.
3
39
4
353
87,543
Turns out you don't need that much data or compute to get a reasoning model from a high quality base model. @ylecun was right
13
23
2
187
35,954
Always find it amazing to contemplate this chart (just updated for Wednesday's class).
28
39
15
294
75,605
The key insights from @ylecun's speech at the #WEF2025 At a very interesting debate on technology he covered: - The perspectives of AI in the next 3-5 years - What intelligent AI systems need - Why LLMs are not enough - True diversity in AI - Open source importance and more 🧵
6
33
4
131
43,475
📊 Key findings: Two-layer MLP beats simple tasks like MNIST reveal VLM blind spots, even with tailored prompts or vast training data.
1
9
3
45
30,355
Llama 3.3 70B is now live on Cerebras Inference! Meta's new 70B model reaches 405B accuracy and Cerebras gives it a 10x speed boost. Available via chat & API: inference.cerebras.ai
14
51
6
358
41,287
Paper discussion happening now (in 10mins) live on Discord. We'll discuss "Convolutional Differentiable Logic Gate Networks" ykilcher.com/discord
2
28
257
19,373
The discrete Fourier basis is a sampling of the continuous Fourier basis. They are both orthogonal. This is (almost) magic! en.wikipedia.org/wiki/Discre…
12
161
8
1,193
120,945
Lightly retweeted
Yann LeCun
@ylecun6 Nov 2024
Not a surprising result. But good that someone tried this out.
Curious whether video generation models (like #SORA) qualify as world models? We conduct a systematic study to answer this question by investigating whether a video gen model is able to learn physical laws. Three are three key messages to take home: 1⃣The model generalises perfectly for in-distribution data, but fails to do out-of-distribution generalization. For combinatorial scenarios, scaling law is observed. 2⃣The models fail to abstract general rules and instead tries to mimic the closest training example. 3⃣The model prioritizes different attributes when referencing training data: color > size > velocity > shape. This work is a joint effort with our outstanding intern @YangYue_THU. Paper: arxiv.org/abs/2411.02385 Webpage: phyworld.github.io/
146
57
16
864
385,996
Lightly retweeted
Andrej Karpathy
@karpathy28 Oct 2024
Voting season is upon us! For those living in SF / Bay Area, each time I recommend the @GrowSF voting guide as a great starting point for the local elections - it is long, detailed, educational, and sensible. O(~hundreds) of votes matter on local elections growsf.org/voter-guide/
55
29
4
371
105,238
Lightly retweeted
Steve Rattner
@SteveRattner29 Oct 2024
Global oil supply is set to outpace demand in 2025, making a fall in energy prices likely whether or not Trump gets the chance to implement his big drilling plans. cc: @axios
25
272
6
666
50,261
The l^p functional is convex and hence a norm for p>=1. It is sparsity-inducing for p<=1. The l^1 norm is the heart of the lasso, aka basis pursuit. en.wikipedia.org/wiki/Basis_… en.wikipedia.org/wiki/Lasso_…
2
99
4
596
45,577
Come chat with us about the paper "Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo" 6pm UTC (in 15mins) ykilcher.com/discord
1
7
63
6,708
Come chat with us about Representation Editing! 6pm UTC on discord (30mins from now): ykilcher.com/discord
1
11
1
81
12,150
Lightly retweeted
Brian Chau
@brianchau5727 Sep 2024
Hi @lessig. Here's the bill cosponsor talking about how his "priority" is purely speculative "risk of extinction from AI". Let's debunk this lie. SB 1047 would not exist in ANY form if not for doomsday science fiction and the billionaire backers of this bill. 🧵
The more I read the words of these #SB1047 opponents, the more I'm convinced they've never read the bill. The only people talking about "science fiction" risks are the lobbyists opposing the bill. #RTFB
4
18
4
88
45,933
Come chat with us about "Neural Operator: Learning Maps Between Function Spaces" tonight on discord! 6pm UTC (1h from now) ykilcher.com/discord
2
39
6,815
The continuous wavelet transform was introduced by Grossman and Morlet. The decay of wavelet coefficients across scales characterizes the local regularity of a function. en.wikipedia.org/wiki/Contin…
4
91
3
519
49,250
🚨New paper: Source2Synth🚨 - Generates synthetic examples grounded in real data - Curation step makes data high quality based on answerability - Improves performance on two challenging domains: Multi-hop QA and using tools: SQL for tabular QA arxiv.org/abs/2409.08239 🧵(1/4)
1
55
6
250
56,168