We’re used to AI assistants being able to respond to our voice, like Siri, Alexa and Google Assistant can, but Samsung’s upcoming assistant (believed to be called Bixby) might go one further and respond to what we’re looking at, or at least what our phone’s pointing at.
That idea is based on information obtained by SamMobile , which claims the standard camera app on the Samsung Galaxy S8 will have a Bixby button, which will allow the assistant to analyze whatever the camera’s pointing at and identify objects and text.
If an object is recognized, Bixby could then search for it online, and even purchase it for you if applicable.
It’s less clear what it would do with any text it recognizes, but it’s easy to imagine uses for it, perhaps for example it would bring up related search results, much like Google Now on Tap does with on-screen text, or if the text is in a foreign language Bixby may be able to translate it.
