3 252 contexts showed how agents lose instruction binding
Researchers constructed 3,252 route-fork contexts to test if action choices depend on text instructions or visual cues. Analysis shows many models rely on navigation history rather than commands.
#vlm#robotics#navigation#instruction following#reinforcement learning



