Jacob Van Meter (@jacobvm04) header
Jacob Van Meter (@jacobvm04) profile picture

robotics/ai research | unc dropout | prev @plasticlabs

San Francisco, CA
Joined April 2023
Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)Photo by Jacob Van Meter (@jacobvm04)
We're excited to release the first open-source VIO to beat Aria on LaMAria! Industry level SLAM for everybody will power tons of applications, can't wait to see what people build :) So how did we beat Aria's SLAM? (1/4)
when LaMAria was introduced a year ago, Meta's closed-source Aria SLAM was far ahead of academic systems. one year later, we've surpassed it in 3/5 categories: medium, long, and low light. here's what closing that gap looks like:
32
80
11
857
435,098
Jacob Van Meter retweeted
a camera gives you 2d pictures, not 3d measurements. how do you figure out where you are from that? turns out SLAM (simultaneous localization and mapping) is one of the hardest problems in robotics. applications range from AR glasses to drones and autonomous cars! 1/5
We're excited to release the first open-source VIO to beat Aria on LaMAria! Industry level SLAM for everybody will power tons of applications, can't wait to see what people build :) So how did we beat Aria's SLAM? (1/4)
1
3
69
2,992
Modeling camera calibration drift is increasingly important as trajectories grow longer. We find that the ratio between the error of the constant calibration system and the time-varying camera calibration system strongly increases with trajectory length. (3/4)
1
1
39
19,856
Jacob Van Meter retweeted
how well can fable 5.2 and gpt-6 astra act as air traffic controllers? in light of recent atc closures, i wondered how efficiently the most chaotic, high-consequence tasks could be carried out by frontier models. results below :)
JUST IN: 🇺🇸 FAA issues nationwide ground stop for all flights. All flight departures have been halted.
3
1
17
945
Jacob Van Meter retweeted
fable 5.2 is surprisingly good at spatial reasoning! here's it scanning and bagging groceries across multiple pick and place steps. seems like the labs are beginning to scale physical post-training. excited to see where this goes.
Replying to @claudeai
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do. On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
21
42
20
378
65,362
Jacob Van Meter retweeted
i got gpt-2 running purely in css! all 124m parameters inferencing at 15 sec/tok, with zero lines of js. i also used a custom font as a BPE tokenizer, and variable fonts for matmuls :)
80
106
44
1,757
104,206
Jacob Van Meter retweeted
saw that @meetgranola was trying to compete with @WisprFlow on dictation so i ran a quick test. overall formatting and quality seems better on wispr!
5
1
25
2,000
dm for early access. write up coming soon!
when LaMAria was introduced a year ago, Meta's closed-source Aria SLAM was far ahead of academic systems. one year later, we've surpassed it in 3/5 categories: medium, long, and low light. here's what closing that gap looks like:
2
2
21
2,425
when LaMAria was introduced a year ago, Meta's closed-source Aria SLAM was far ahead of academic systems. one year later, we've surpassed it in 3/5 categories: medium, long, and low light. here's what closing that gap looks like:
wow @jacobvm04 and i just took first place on one of robotics’ hardest problems. machines knowing where they are in the world. slam dunk.
8
42
7
540
92,912
Jacob Van Meter retweeted
I just checked the current LaMAria leaderboard. The gap to Aria's SLAM is much smaller. All methods in the sceenshot except Aria's SLAM are posted within one month. Wild. #SLAM #VIO #LaMAria
3
4
5
56
15,512
Jacob Van Meter retweeted
Jev harness for robot navigation
Building a new harness to control robots with TypeSafe AI Jev and Cloudflare Clairic. Prompt "Go to the kitchen and find the stove"
1
13
588
faith is all you need
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
8
1,023
working on this
This is the real gpt 3 moment for robotics by the way. Astra has essentially perfect vision. What’s left is latency (gpt 3.5 moment). Once that is solved, we can just rl on a bunch of robotics tasks.
1
6
941
Jacob Van Meter retweeted
Coding Agents like Codex and Claude Code can now orchestrate physical robots.
2
1
24
2,694
Jacob Van Meter retweeted
when a RL researcher does SFT for you, it is a sign of great respect in their culture
15
22
4
616
55,537
Jacob Van Meter retweeted
Told a friend I did RL but not for LLMs and he said “not that weird shit with Atari” 😭
10
6
2
395
35,829