Google is updating Gemini to complete tasks such as booking appointments, analyzing bills and shopping, and says the update is rolling out free to hundreds of millions of people in the U.S., Japan, Korea, Canada, Australia and India on its new Gemini 4 Hydrogen model. Users switch the app from Chat to Task, text Gemini or forward emails to gemini@google.com. Advanced features start in the U.S.
Gemini now uses the Agent Payments Protocol (AP2) for purchases, and Google says it is working with Mastercard and Visa, with American Express coming soon, on digital tokens for supported cards. Users can set a hard spending cap, and Google says Gemini is designed to stay within budget and asks for confirmation before buying. In an example from Vice President Josh Woodward, Gemini compared products with the Shopping Graph and checked out with Google Pay. Google says Gemini connects with more than 60 apps, including Instacart, and plans to add the Universal Commerce Protocol (UCP). Google acknowledges that on some sites Gemini hands the screen back to the user for the final click.
A Google Research post says Duplex, the calling technology Google introduced in 2018, is now part of Tasks in Gemini. Every call opens by disclosing it is an automated system from Google, and merchants can opt out in Google Business Profile settings or by asking it to stop calling. Google said in 2023 that business information from Duplex calls had been shown in Search and Maps over one trillion times.
