Supervised customer support
Voice experiences that authenticate users, answer bounded questions, call narrow read-only tools, and quickly hand off to a human for exceptions or consequential requests.
Independent tool overview
Gemini 3.1 Flash Live Preview is Google's low-latency audio-to-audio model for real-time voice and multimodal agents. It can listen to audio, receive text, images, and video, respond with speech or text, use Google Search grounding, and call synchronous functions. It is compelling for conversational support, coaching, and guided workflows, but it remains a preview with important session, feature, privacy, consent, and cost constraints.
Visit the official Gemini 3.1 Flash Live site ↗
Overview
Gemini 3.1 Flash Live powers real-time dialogue in Google's Gemini Live and Search Live experiences and is available to developers through the Gemini Live API under the model ID `gemini-3.1-flash-live-preview`. Google also offers it in Gemini Enterprise for Customer Experience.
The model is designed to understand acoustic cues such as pitch, pace, interruptions, hesitation, and noisy input while maintaining a natural spoken response. It accepts streaming text, images, audio, and video, produces text or 24 kHz audio, supports thinking levels, Google Search grounding, and synchronous function calling.
This is not a general Gemini endpoint with every tool. The current model page says code execution, file search, URL context, structured output, image generation, caching, Maps grounding, and batch processing are not supported. Asynchronous function calling, proactive audio, and affective dialogue are also absent in this model.
A production voice agent is a safety and operations system, not just a prompt. It needs disclosure, consent, authentication, escalation, tool allowlists, spend controls, interruption handling, transcript and recording rules, adversarial-audio testing, and a clear response when the model is uncertain or the connection fails.
Use cases
The strongest fit depends on the job you need the product to complete, not the size of its feature list.
Voice experiences that authenticate users, answer bounded questions, call narrow read-only tools, and quickly hand off to a human for exceptions or consequential requests.
Language practice, product guidance, accessibility, brainstorming, and step-by-step help where low latency and tone awareness matter but a mistaken answer is recoverable.
Applications that combine a live conversation with camera or screen context for troubleshooting, inspection, or guided tasks under human control.
Teams evaluating turn-taking, interruption behavior, multilingual quality, tool calling, latency, cost, and user acceptance before committing to a production architecture.
Capabilities
Streams speech directly to and from the model for more natural timing and vocal nuance than a simple speech-to-text, text-model, and text-to-speech chain.
Accepts text, still images, streaming audio, and video so an agent can discuss what a user says and shows in the same session.
Supports automatic or custom voice-activity detection and streaming turn control for conversational back-and-forth. Applications must tune sensitivity and silence thresholds for their environment.
Uses `minimal`, `low`, `medium`, or `high` thinking levels, defaulting to minimal for low latency. More reasoning can improve hard tasks but increases time and token cost.
Can request application tools during a conversation, but waits for the tool result before responding and does not support the model's asynchronous nonblocking tool mode.
Can query Google Search for current information. Each user request can trigger multiple billable search queries, and grounding data has separate retention terms.
Google says all audio produced by 3.1 Flash Live carries an imperceptible SynthID watermark intended to support detection of AI-generated audio.
Can resume across periodic WebSocket reconnections and compress the context window to support longer sessions, with explicit cost and data-retention tradeoffs.
Process
Step 1
State what the agent may discuss, what tools it can use, what it must never decide or change, how it discloses AI use and recording, and the exact triggers for human or emergency escalation.
Step 2
Authenticate the user on your backend and issue a constrained short-lived ephemeral token for direct client WebSocket access. Never ship a long-lived Gemini API key in a browser or mobile app.
Step 3
Collect only necessary audio, video, images, transcripts, and identifiers; obtain required consent; document recording and retention; redact sensitive fields; and keep regulated data out unless the governing contract and controls explicitly allow it.
Step 4
Use server-side authorization, narrow schemas, read-only defaults, amount and frequency limits, confirmation for external effects, and fresh identity checks before exposing accounts, placing orders, making payments, scheduling, or modifying records.
Step 5
Evaluate accents, languages, background noise, cross-talk, silence, interruptions, children, distress, numbers, addresses, names, prompt injection spoken aloud or shown on camera, tool failures, network drops, and repeated reconnects.
Step 6
Set context-window compression, monitor input and output audio minutes, account for transcription and grounding surcharges, handle GoAway messages, resume connections, and stop idle sessions promptly.
Step 7
Measure task completion, escalation accuracy, latency, hallucinations, unsafe tool attempts, demographic quality gaps, cost, abandonment, complaints, and consent failures without retaining more raw conversation data than necessary.
Cost
The paid Gemini Developer API charges separately for text, image or video, audio, and output. For a rough audio-only minute, published rates are $0.005 per minute of input and $0.018 per minute of generated audio before context reprocessing, transcripts, thinking, Search grounding, and application infrastructure. Persistent context compounds billing across turns, so a long conversation costs more than simply multiplying wall-clock minutes.
No token charge within available quota
For testing in AI Studio and limited developer evaluation, subject to eligibility and changing preview quotas.
$0.75 per 1M tokens
Text instructions, conversation context, and other text sent to the live model.
$3 per 1M tokens or about $0.005/minute
Streaming microphone or other audio sent while input is active.
$1 per 1M tokens or about $0.002/minute
Visual context supplied during the live session.
$4.50 per 1M tokens
Text responses, thinking tokens, and enabled transcription text.
$12 per 1M tokens or about $0.018/minute
Model-generated spoken responses.
5,000 shared searches/month, then $14 per 1,000
Optional current-web grounding shared across Gemini 3.x models.
Pricing checked . Check current pricing at the source ↗
Assessment
Compare
The right alternative depends on the specific output, workflow, controls and budget your project requires.
Miscellaneous
Choose GPT-Realtime-2 to evaluate OpenAI's current real-time voice model, tool behavior, safety controls, pricing, and ecosystem against Google's Live API.
Explore GPT-Realtime-2 →Agents
Choose Grok Voice Agent when xAI's voice model, tool calling, and real-time data stack better fit the application and governance requirements.
Explore Grok Voice Agent →Sales
Choose Vapi when the bigger need is provider-agnostic voice-agent orchestration, telephony, routing, observability, and swapping underlying speech or language models.
Explore Vapi →Marketing
Choose ElevenLabs when voice quality, voice design, speech generation, and its broader audio platform matter more than using Google's native multimodal model.
Explore ElevenLabs →Questions
It is Google's preview low-latency audio-to-audio model for real-time voice and multimodal applications. It accepts text, images, audio, and video; returns text or speech; and supports thinking, Google Search grounding, and synchronous function calling.
Published paid rates are $0.005 per minute of audio input and $0.018 per minute of audio output, or token-based equivalents, plus any text, visual input, thinking, transcription, context, grounding, and infrastructure charges.
The pricing table shows free usage within available quota and says free-tier data can improve Google products. Preview availability can require an active paid project or change, so verify the actual project quota before designing around free access.
Yes, through synchronous function calling. It waits for the tool result before continuing. The application must independently authenticate, authorize, validate, rate-limit, and confirm any consequential action.
Without compression, about 15 minutes for audio-only and two minutes for audio-video. Context compression can extend a session, while session resumption handles WebSocket connections that reset around ten minutes. Both features affect cost or retention.
No permanent key should be shipped client-side. Google recommends authenticating the user with your backend and issuing a short-lived, constrained ephemeral token for a direct client-to-Live-API WebSocket.
The pricing table says free-tier data is used to improve products and paid-tier data is not. Paid traffic can still be logged temporarily for abuse monitoring. Data retention also changes if Search grounding or session resumption is enabled.
Not automatically. Google says a paid project needs approved ZDR controls, must avoid session resumption to prevent up-to-24-hour state retention, and cannot use Search grounding if it requires zero retention because grounding stores data for 30 days.
Only with an appropriate contract, jurisdictional consent, strict data minimization, identity checks, bounded tools, human escalation, quality testing, and qualified legal and security review. A capable voice model alone does not establish HIPAA, financial, recording-law, or consumer-protection compliance.
Bottom line
Gemini 3.1 Flash Live is a strong foundation for natural, multimodal voice experiences when a team wants Google's models, grounding, and function-calling stack. The product decision should hinge less on a demo voice and more on production controls: preview tolerance, session engineering, compounding context cost, ephemeral authentication, consent, data retention, tool authorization, and human escalation. It is well suited to bounded assistance; it should not autonomously make consequential decisions or actions.
Visit Gemini 3.1 Flash Live website ↗
Voxtral TTS - Mistral's voice cloning model for building multilingual AI speech agents

Lovable Payments - Lovable's one-conversation setup for adding payments, tax, and multi-currency support to AI-built apps

Claude Marketplace - Anthropic's enterprise hub for buying Claude-powered partner tools

Cofounder 2 - General Intelligence's agent orchestrator that manages full business operations across engineering, sales, marketing, and design

Get access to all our AI courses, hundreds of real-world AI use cases, live expert-led workshops, an exclusive network of AI early adopters, and more.
Get unlimited access to all of our current & upcoming industry-specific AI courses for the duration of your subscription.
To keep up with the rapid pace of AI, our team publishes AI implementation guides daily. Our library contains 300+ practical use cases to automate real-world work.
Join weekly, live, interactive sessions with industry leaders who are at the forefront of AI for hands-on implementation guidance and exclusive insights.
Network with an exclusive community of AI-first professionals who are working smarter with AI. Learn how early adopters are using AI in their work and businesses.