Google launches new Gemini features for working with video in real time
Google has begun gradually rolling out new AI features to Gemini Live that allow the assistant to "see" your screen or the view through your smartphone camera and answer questions in real time. These features are arriving almost a year after Google first introduced "Project Astra", which forms the basis of these new capabilities.
What do the new features enable?
Screen reading - Gemini can see and interpret what is displayed on your screen and provide answers based on this content
Live video - Allows Gemini to interpret a live feed from your phone's camera and answer questions in real time
For example, in a video from Google, a user leverages the live video feature to have Gemini help choose a color for freshly glazed pottery.
Availability
The new features are currently being rolled out to Google One AI Premium subscribers with access to Gemini Advanced. One user on Reddit confirmed that the feature had already appeared on their Xiaomi phone.
A lead over the competition
This move further solidifies Google's lead in the AI assistant space at a time when Amazon is preparing limited early access to its Alexa Plus update and Apple has postponed an enhanced version of Siri. Samsung still offers Bixby, but Gemini is now the default assistant on its phones.
These new features represent another step in integrating artificial intelligence into everyday life and show how quickly the capabilities of AI assistants are evolving in the real world.
