Show-Harness: Can Small VLMs Replace Frontier Models in Robot Control?
transcript
show notes
Can a small vision-language model take over robot control from a frontier agent? This episode explains what Show-Harness actually compresses, how its semantic action interface works, and where its strongest results come from. We cover three central questions: why a compact movement vocabulary changes the learning problem, how GUMI turns browser-based demonstrations into policy-training examples, and what the real-robot evaluation establishes. The method combines supervised action imitation with LoRA adaptation of Qwen3.5-2B, using demonstrations from Franka and AgileX robots alongside a separate ManiSkill and RoboLab simulation corpus. ([huggingface.co](https://huggingface.co/showlab/Show-Harness-VLMs)) We examine the manipulation results, the action-representation ablation, and the relationship to Code as Policies and SmolVLA. The key limitation is that the standalone compact controller does not preserve the frontier system's reasoning-task performance. ([arxiv.org](https://arxiv.org/html/2609.10522v1)) For roboticists working on data-efficient imitation learning and local robot control, the episode offers an architectural takeaway: the interface between model and machine can be as important as the model itself. What becomes easier to learn when the robot's actions become easier to express?