Google brings multimodal search to AI mode. This allows users to delve deeper into the topic by asking complex multipart questions and follow-ups. Users with access to AI mode can tap on the feature to ask questions about photos taken using the camera or upload them.
The new AI mode image analysis feature will feature Google Lens multimodal capabilities, Google said in a blog post Monday.
According to Google, AI modes allow you to understand the entire scene in an image, including how objects relate to each other, their material, color, shape, and arrangement. Using a technique called “query fan-out,” AI mode asks multiple questions about both the image and the objects shown therein, providing more detailed information than traditional Google searches.
For example, you can take a photo of your bookshelf and enter a query. “If you enjoyed these, what are the similar books that are being rated?” AI mode identifies each book and provides a list of recommended books with links to learn more about them and buy them.
In AI mode, you can also ask follow-up questions to narrow down your search, such as “I’m looking for a quick read. Which of these recommendations is the shortest?”
As part of Monday’s announcement, Google said it is making AI mode available to millions of users registered with Labs, Google’s home, for its experimental features and products. Prior to this, AI mode was only available to one Google Premium Subscriber.
The AI Mode, released last month, aims to tackle popular services such as Perplexity and Openai’s ChatGPT search. Google says it plans to continue to improve the user experience and expand the functionality of its features.