IEEE Spectrum AIsafety4h agoenergy 116

Your Robot’s Safety Functions Already Work. What If the Input Lies?

image: IEEE Spectrum AI

This article is brought to you by VicOne . A mobile robot slows for someone in a hallway. A collaborative arm eases its movement as a worker approaches. A humanoid pauses to let a person pass. Each response depends on information about the robot or its surroundings: a distance reading, a position estimate, or a stop signal. But what happens when one of those inputs is wrong, and the robot still responds exactly as designed? The mobile robot reads the hallway as clear while someone is still there. The arm estimates that the worker is farther away. The humanoid does not receive a stop signal as a person crosses its path. In each case, a fault could cause that mismatch. So could deliberate manipulation . At VicOne LAB R7 , we examine how manipulated inputs can change robot behavior — and what that means for the systems meant to keep people safe. How an untrusted input can change a robot’s behavior A robot does more than measure its surroundings. It may interpret what it sees and hears to decide what to do next. Information placed in its environment can therefore influence its actions. Published research shows how this can happen. In a study of vision-language-action (VLA) models , a p

read the original at IEEE Spectrum AI →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.