Google is rolling out a bundle of new features for Gemini Live, its real-time AI assistant. Starting next week, the assistant will be able to highlight objects directly on your screen while using your phone’s camera, making it easier to identify specific items.
Read: Bandwidth Blog & Smile 90.4FM Tech Tuesday: Geothermal power boost!
For example, if you’re looking for a particular tool in a toolbox, you can point your camera at it and Gemini Live will highlight the correct one for you. This visual guidance feature will be available on the new Pixel 10 devices at launch on August 28 and will roll out to other Android devices at the same time. Support for iOS will follow in the coming weeks.
Google is also adding new app integrations that will allow Gemini Live to interact with apps like Messages, Phone, and Clock. This means you’ll be able to have seamless, multi-step conversations. For instance, you could be talking about directions and then interrupt Gemini to say, “This route looks good. Now, send a message to Alex that I’m running about 10 minutes late.” The assistant can then draft the text for you.
Finally, Google is launching an updated audio model that will “dramatically improve” how Gemini Live uses the key elements of human speech, such as intonation, rhythm, and pitch. The assistant will soon be able to change its tone based on the topic of conversation, and you’ll be able to adjust its speaking speed. The updated model will also allow Gemini to adopt an accent for more engaging storytelling.
