Algos guiding self-driving cars don’t expect to see a STOP sign next to food. So if someone put showing apples at a busy intersection …
Black Hat Asia Computer vision systems display “correlation bias” that makes it possible to create adversarial images, that could have real-world consequences such as messing with self-driving cars’ ability to accurately interpret road signs. That assertion was made today at the Black Hat Asia conference by Paul Ziegler, CEO of risk management software vendor Redflare, and Yin Minn Pa Pa, a senior researcher and manager at Deloitte Tohmatsu Cyber LLC and Deloitte Japan. Masaki Kamizono, CTO and partner at Deloitte Tohmatsu Cyber LLC and Deloitte Japan also worked on the research. In a talk titled “Hiding Objects From Computer Vision By Exploiting Correlation Biases” the Ziegler and Pa explained that they used computer vision systems, including those offered online by Microsoft and Google, to survey images from the Common Objects In Context ( COCO). In their speech, the pair said that one way computer vision systems recognise objects is to consider them in context, and said their work has detected odd outcomes resulting from that practice.
