@AndreTI

Making games and robots and sometimes other things. (Formerly: 1X, Meta)

Bay Area
Joined January 2009
I wrote my first substack piece about AI's economic impact, and some reasons why models seem to underperform in the real world.
5
3
3
44
11,376
This is not a good reason to make laws precluding people's rights to run successful businesses and develop new technology. Concrete risks or costs from further near term development, yes. A general feeling that it's all too fast, absolutely not.
Mathematician Terence Tao: "we have to slow down AI. the pace is insane, and there's no reason to be this fast — no reason at all" It's amazing how willing we are to change everything without any idea what happens afterward These are extremely nonlinear dynamics
1
110
There is always a large constituency opposed to progress, especially progress that disrupts their established careers and lifestyles. This constituency is almost universally bad.
1
26
This is not a universal argument against all tech regulation. Sometimes you really should stop putting radium paint on the watch dials. But it does mean you should pretty viscerally reject this specific flavor of argument.
24
Pretty cool! Unseen environments isn't nothing. But worth paying attention to what tasks are actually shown where they cut. The tasks are fairly simple, and each task is cut separately, rather than one robot following him around doing all these things in sequence.
The holy grail for robotics is being able to generalize: doing work in unseen places We rented 30 homes in the Bay Area and are doing tasks without any new training
3
8
1,027
Also worth noting that this is something PI showed last year on a mobile manipulator.
24
My guess is the success rate on each of these is not that high, so the cumulative sequence with inter-room navigation would be poor. Dividing it up lets you retake each section as many times as you need to get a good rollout.
2
58
Ah, to their credit, they are up-front about this in the actual writeup:
20
Still, some indication they're moving beyond overfitting!
37
*shown and where
36
Andre Infante retweeted
This is the real Turing test if you think about it
Two days ago, GPT-6 Astra broke a yet unsolved German Army Enigma message from 1941. Amazingly Astra was able to autonomously: - Search historical archives - Compare uncertain letters - Find contextual clues - Build an Enigma simulator - Write cryptanalysis code - Run parallel experiments - Test competing keys - Recover the plaintext - Cross-check the results 1/n
71
425
9
5,626
284,302
Andre Infante retweeted
GPT-6 Astra can solve some seriously tricky spatial constraint tasks: from unlocking interlocked parts to threading a rope through three rings. Try it yourself now 👇 qinengwang-aiden.github.io/d…
64
216
39
2,536
641,838
Andre Infante retweeted
I taught a robotic hand to walk on its fingertips. Usually an arm takes the hand to the work. We wanted it to get there without one, then use the same fingers to do the job. Meet Fingers as Legs. Video: youtu.be/yGoW5WHBf20 Paper: arxiv.org/abs/2609.17172
34
58
28
379
68,334
Andre Infante retweeted
Zero-shot navigation of complex terrain. The true advantages of humanoid robots are their ability to work in the true difficulty of human environments. All using onboard sensing and compute. Take a look ->
One of the key advantages of legged robots like humanoids should be how effectively they can move across a wide variety of terrain types to accomplish their task. But Light-Loco-Parkour from the team at Light Origins aims to change that: using only onboard sensing, they show a policy which can decide when to walk, vault, climb, or otherwise traverse as it moves through a complex environment. Unlike many others, it uses sparse seeds instead of relying on a large motion corpus, learning when to use its skills to move around without specific sub-task labels. @ChemXiaodao and @Yuntao144 join us to go into the details. Watch Episode 104 of RoboPapers now, with @micoolcho and @chris_j_paxton, to learn more!
5
12
2
95
10,855
Was able to tweak the harness and hardware setup and get it to ~succeed at the snack tray test on attempt 3 (first attempt cancelled due to a system prompt issue, second attempt killed because it dropped the OJ and couldn't reach it) Pretty crazy how well it works, considering.
4
2
3
58
26,276
(I cut it off before it could get deep into trying to get the bottle back upright, the policy / IK solver are really bad at grabbing from above and I didn't want to spend the tokens on it)
1
456
There are definitely issues. Its understanding of dynamics is weak. It really struggled to understand the limits of the IK solver when trying to do the overhead grasp to get the bar out of the drawer. But this is a very non-trivial task for a robotics model.
1
5
819
This task took almost 6 minutes when a human could have done it in one or two. However, that's still a massive improvement over "not at all," and a lot of this would go away with robotics-specific training. It's a hell of a proof of concept.
1
560
I still think someone's eventually going to do the dexcap / UMI idea with myoelectric hand tracking and it's gonna be awesome. Occlusion proof, force aware, no glove awkwardness.
1
103
That said, you can clearly get very good results with a fairly kinematically limited glove.
64
Hill climbed the setup here a bit. Gave it limb collision detection, RGB-D cameras, and a boom cam, which makes it much less clumsy about its physicality. Seems much better at reasoning about stuff it can see. I also told it it was being graded on speed, is now much faster.
2
178
I do think (at this speedup) this is handily the best robotics foundation model in the world.
1
36
And I think you could increase the speed-up and hill climb harder on the harness and input affordances and make it significantly better than this.
30