NeoWorld-3: Can Executable 3D Programs Improve Sim-to-Real Robotics?
transcript
show notes
Can a robot turn pictures of its workspace into a world it can actually plan inside? This episode explains NeoWorld-3's approach to executable 3D programs and what its experiments reveal about their value for robotics. We cover three questions: why shared geometric parameters help preserve object structure, what the reconstruction and tooling comparisons measure, and how to interpret the real-to-sim-to-real demonstration. The method combines agentic program authoring, numerical refinement, and geometry inspection through NeoMCP and NeoSDK. We examine the reported shape-reconstruction improvement and place the approach alongside Real2Code, VIGA, Articraft, and RialTo. The episode spans simulated asset reconstruction and physical bimanual manipulation with AgileX Piper arms. Its central limitation is an evaluation gap: the hardware demonstration does not isolate how much better reconstruction improves robot task success. For researchers building digital twins, simulation infrastructure, or manipulation pipelines, the discussion focuses on representation design and the evidence needed to connect asset quality with deployment value. What changes when a robot's perception system produces a world it can edit and execute?
