Skip to content
Artwork for Intellectually Curious
Intellectually Curious · Today · 6 min

VFlash: How Robots Plan a Move in One Pass

A robot reaching for a block needs a path for its gripper. A vision-language model can describe that path as a series of coordinates, but writing them one token at a time takes time while the scene keeps changing. What if the model could sketch the whole path in one go? NVIDIA researchers built VFlash around that idea. A small model learns from examples of geometry and predicts all the coordinates of a path or a bounding box together. We explore why that approach produced faster plans and more accurate robot trajectories in the team’s tests, and how the same idea applies to a vehicle planning its next turn. Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information. Sponsored by Embersilk LLC

0:00-6:18

transcript

No transcript — this publisher did not publish one.

show notes

A robot reaching for a block needs a path for its gripper. A vision-language model can describe that path as a series of coordinates, but writing them one token at a time takes time while the scene keeps changing. What if the model could sketch the whole path in one go?

NVIDIA researchers built VFlash around that idea. A small model learns from examples of geometry and predicts all the coordinates of a path or a bounding box together. We explore why that approach produced faster plans and more accurate robot trajectories in the team’s tests, and how the same idea applies to a vehicle planning its next turn.


Note:  This podcast was AI-generated, and sometimes AI can make mistakes.  Please double-check any critical information.

Sponsored by Embersilk LLC

links1