Google is expanding the capabilities of its Gemini AI by testing a new feature that allows the assistant to make phone calls on behalf of users. The feature, named "Call for Me," is designed to handle a variety of tasks ranging from restaurant reservations to checking product availability at retail stores.
Initially, the tool is rolling out as an experiment to a limited group of users. This group includes owners of the Pixel 11 in the United States who maintain a paid Gemini subscription. To access the functionality, participants must also use the beta version of the Google Phone app for Android.
This move represents a significant step in the transition from basic AI chatbots to functional "AI agents" that can perform real-world actions independently. While Google has experimented with automated calling technology for years, "Call for Me" introduces deeper integration with personal user data and a more robust interface for monitoring automated interactions.
How the technology works
The "Call for Me" feature is distinct from previous automated calling tools because of its ability to use approved personal information. Google says this allows the AI to take a broader set of actions than earlier iterations. For instance, when rescheduling an appointment, the AI can reference specific details provided by the user to ensure the new time slot is accurate and valid.
When a user initiates a call through Gemini, the assistant dials the business directly from the user's personal phone number. Once the call is connected, the AI introduces itself to the person on the other end, explaining that it is a virtual assistant calling on behalf of the user.
The system is designed to handle several technical hurdles that typically make automated calling difficult:
- Navigating interactive voice response (IVR) systems and automated menus.
- Waiting on hold until a human representative becomes available.
- Engaging in back-and-forth dialogue to complete specific tasks.
To maintain user control, Google provides a live transcript of the conversation on the smartphone screen. This allows the user to watch the interaction as it happens. If the conversation becomes too complex or if the user simply prefers to speak for themselves, they can take over the call at any time.
Practical applications for users
Google claims that the AI is capable of handling nuanced tasks that previously required human intervention. By automating these "micro-errands," the company hopes to save users significant amounts of time. Some of the primary use cases identified during this testing phase include:
- Checking inventory: Calling a local shop to ask if a specific product is currently in stock.
- Managing reservations: Making or modifying bookings at restaurants.
- Scheduling: Moving an existing appointment to a different date or time based on the user's availability.
- Placing holds: Requesting that a business set aside an item for later pickup.
By integrating these features into the Phone app, Google is positioning Gemini as a proactive assistant rather than just a passive search tool.
The problem the company is trying to solve
Phone calls to businesses remain a friction point in the digital age. Many small businesses do not have online booking systems, and larger companies often force callers to wait through long hold times or navigate confusing automated menus.
By using Gemini as a proxy, Google aims to eliminate the frustration of waiting on hold and the repetitive nature of basic inquiries. The goal is to provide a seamless bridge between the user's digital intent and the business's analog or voice-based communication systems.
The competition in this space is intensifying. Other AI agents, such as Meta’s Muse and Instinct, have also demonstrated the ability to make calls for users. Google’s advantage lies in its existing hardware ecosystem and the long history of its Phone app, which is already installed on millions of Android devices.
A history of automated calling at Google
The "Call for Me" feature is the latest evolution in a long line of AI-assisted calling projects from Google. The company first generated significant interest in this field years ago at its I/O developer conference when it demonstrated Google Duplex. During that presentation, the AI called a hair salon to book an appointment, using natural speech patterns including filler words like "um" and "ah" to sound more human.
Since then, Google has released several related features for Pixel owners:
- Hold for Me: A tool that waits on hold for the user and alerts them when a live representative joins the line.
- Talk to a Live Rep: An experiment that navigates phone trees and holds the line until a human is available.
- Direct My Call: A feature that transcribes automated menu options in real-time, allowing users to tap on-screen buttons instead of listening to long lists of numbers.
- Ask for Me: A 2024 feature that allowed Gemini to inquire about general information like services and pricing.
"Call for Me" builds on these foundations by allowing the AI to go beyond merely asking questions. With the addition of approved personal data, the assistant can now execute transactions and commitments, such as finalizing a booking or changing a scheduled service.
What happens next?
Google is currently keeping the "Call for Me" feature within a tightly controlled experimental environment. According to the company, the small-scale launch is necessary because "real-world conversations are nuanced."
Automated voice interactions face high stakes; a misunderstanding during a call could lead to a missed medical appointment or an incorrect reservation. Google says it needs time to refine the technology and ensure the AI can handle the unpredictability of human speech and business-specific jargon before a wider rollout occurs.
As the test continues, the company will likely look for feedback on how well the AI handles complex accents, background noise in busy stores, and the hand-off process between the AI and the user. If successful, the feature could eventually become a standard part of the Gemini suite across a wider range of Android devices and regions.
The development of "Call for Me" signals a clear direction for the industry. AI is moving away from simply generating text or images and toward taking meaningful action in the physical world. For Google, the phone call is a logical place to start, turning the smartphone back into a communications hub where the user doesn't always have to be the one doing the talking.
Filed under: AI, TechNews, Gadgets, Software, Google, Gemini, ProductLaunches