Google enhances AI Mode with multimodal search and image recognition
Google has announced a significant expansion of its AI Mode in Search, which now enables advanced multimodal search. This update gives users the ability to combine images, text, and other formats for more complex and intuitive search queries.
What’s new in AI Mode?
The most significant new feature is that AI Mode now allows users to upload a photo and ask a question about it, similar to how Google Lens worked. The system can interpret the content of an image and answer questions about what is visible in it.
For example, you can:
- Take a photo of a plant and ask how to care for it
- Upload an image of a building and learn about its history
- Share a picture of a product and ask about its reviews
How does it work?
Google has integrated image recognition technology directly into its AI search mode. The search begins the same way as before with text, but you can now add an image during a conversation with the search engine. The system combines information from the image with the context of your query and provides relevant answers. The technology uses advanced multimodal AI models that can analyze and interpret different types of data simultaneously – text, images, and, in the future, probably audio or video as well.
Here is a demonstration video.
According to information from The Verge, this feature significantly expands search capabilities. Users can now ask more complex questions about visual content, such as: "What model of car is this, and what are its reviews?" or "What is this insect, and is it dangerous?" or "How much does this clothing cost, and where can I buy it?" The answers include relevant information, images, and links where users can learn more.
When will this feature be available in Czech?
The new multimodal search in AI Mode is gradually being rolled out to users in English-speaking countries. Google plans to expand the feature to additional languages over the coming months. The feature is available on mobile devices and in desktop browsers, and users can find it directly in the AI Mode interface, which is part of standard Google Search.
