Copilot Voice for the dedicated Microsoft Copilot app will also seek to lower the friction for users when interacting with chatbots
Microsoft has announced sweeping updates for its Copilot offering, aimed at making Copilot easier to use on Windows PCs and integrated within apps like the Edge browser.
Copilot Vision is a new feature built into the Microsoft Edge browser as a native feature, allowing users to ask questions about the web pages they’re navigating. Users can use voice inputs to ask Copilot Vision questions in real-time, with low-latency responses derived from the content on their screen.
Microsoft clarified that users need to actively give Copilot permission to view their active webpages and that there is a clear indication when Copilot is active. It added that no data is stored beyond the active session or used for training, meaning a user’s history is not stored within the app.
This is a new era of technology that doesn’t just “solve problems”, it’s there to support you, teach you, help you,” wrote Mustafa Suleyman, CEO at Microsoft AI. “In this sense, Copilots really are different to that last wave of the web and mobile.
“This is the beginning of a fundamental shift in what’s possible for all of us. It’s a long journey that will take years. With our latest updates to Copilot, you are seeing only the first careful steps in this direction.”
Another new feature for the Copilot mobile app is Copilot Voice, which aims to streamline interactions with the chatbot.
