As part of its efforts to add generative AI to search, Google has introduced a new twist: video. Gemini will let you upload a video demonstrating the problem you’re trying to solve, then explore user forums and other areas of the web to find a solution.
As an example, Google’s Rose Yao talked about the used turntable she bought on stage at I/O 2024 and how she couldn’t get the needle to set the record. Yao uploaded a video showing the problem, then Gemini quickly found an explanation for how to balance the arm on that make and model.
Google wrote: “Search is more than just words in a text box. Often, your questions relate to what you see around you, including objects in motion.” “Video search saves you the time and trouble of finding the right words to describe this problem, and you get an AI overview with troubleshooting steps and resources.”
If the video alone doesn’t make it clear what you’re trying to get across, you can add text or draw arrows that point to the point in question.
OpenAI just introduced ChatGPT 4o with the ability to annotate live video in real time, then describe the scene or even sing about it. However, Google is currently taking a different tack with video, focusing on its Search product. Video search, Search Labs, is starting in English for US users, but will roll out to more regions over time, the company said.
Stay up-to-date with all the news from Google I/O 2024 here!
