Skip to content
Sign in
Artwork for The Sentient Code: AI and Robotics
The Sentient Code: AI and Robotics · October 15 · 22 min

How Human Videos Teach Robot Hands

A new AI system called PointWAM teaches robot hands by watching over a million videos of people using their hands. Instead of guessing from blurry images, it predicts how fingertips and objects move in 3D space, then copies that motion onto a robot. In tests, this boosted success rates by nearly 57 points and beat strong existing models — including on a real robot arm. This episode includes AI-generated content.

0:00-22:28
Play in
Transcript file

transcript

No transcript — this publisher did not publish one.

show notes

A new AI system called PointWAM teaches robot hands by watching over a million videos of people using their hands. Instead of guessing from blurry images, it predicts how fingertips and objects move in 3D space, then copies that motion onto a robot. In tests, this boosted success rates by nearly 57 points and beat strong existing models — including on a real robot arm.

This episode includes AI-generated content.

more episodes

All episodes