Array
Google’s Live captions are becoming richer with new AI-driven “Expressive Captions” that convey more than basic language, including sounds and actions. Google is also bringing Gemini 1.5 to Image Q&A in the Lookout app.
Live Caption has been a staple of Google’s Pixel lineup since 2019. The feature allows users to insert captions where there are normally none using the phone’s Tensor SoC and onboard processing. When a voice is heard through a video or other media playing audio, the Pixel phone will pick up on that speech and display it as it hears it. It’s useful for a variety of users, especially those who are deaf/hard of hearing.
Live Captions are getting an overhauled mode for processing audio more dynamically.
