News · Gemini 3.1 Flash Live and the shift toward function-calling voice agents

Mar, 264 min to read
AI Products

Gemini 3.1 Flash Live and the shift toward function-calling voice agents

Google's newest audio model leads on multi-step function calling, doubles conversational memory, and ships watermarked audio by default.

The benchmarks Google chose to lead with

The two numbers Google puts forward tell you what this model is meant to do. On ComplexFuncBench Audio — described as a benchmark for multi-step function calling under various constraints — 3.1 Flash Live scores 90.8%. On Scale AI's Audio MultiChallenge, which tests instruction following and long-horizon reasoning amid the interruptions and hesitations of real audio, it reaches 36.1% with 'thinking' turned on.

Those are not benchmarks about voice quality. They measure whether a voice system can hold a plan across several turns and call the right tools while a user talks over it. The framing signals that Google sees the near-term value of audio AI in task completion, not in producing pleasant-sounding speech.

The 36.1% figure is worth noting precisely because it is low in absolute terms. Long-horizon audio reasoning through interruptions remains hard, and Google is comfortable leading with a number that shows the ceiling is still far off.

Three distribution channels, three different buyers

Google shipped the same model into three places at once: developers get it in preview through the Gemini Live API in AI Studio, enterprises get it inside Gemini Enterprise for Customer Experience, and everyone gets it through Search Live and Gemini Live.

The enterprise framing is specifically about customer experience. Google claims 3.1 Flash Live is better than 2.5 Flash Native Audio at recognizing acoustic nuances like pitch and pace, and at adjusting when a user sounds frustrated or confused. That is a support-desk pitch — the model detecting a caller's tone and shifting its response is a call-center feature, and the named references (Verizon, LiveKit, The Home Depot) sit in that world.

Doubled context and a 200-country language reach

For the consumer-facing Gemini Live, Google's concrete claim is that the model follows a conversation thread twice as long as its predecessor and responds faster. Doubled conversational memory is a specific, testable improvement rather than a vague quality gain — it targets the failure mode where a voice assistant loses the thread during a longer brainstorm.

The multilingual claim underpins a distribution move: Google says the model is inherently multilingual, and on that basis Search Live now reaches more than 200 countries and territories with real-time conversation in a user's preferred language. Language coverage, not raw capability, is the lever driving the global rollout here.

Watermarking as a default, not an option

All audio generated by 3.1 Flash Live is watermarked with SynthID, embedded directly into the output for reliable detection. Google frames this as a misinformation safeguard.

The detail that matters for anyone building on this: the watermark is described as always-on and imperceptible, not a toggle. Teams deploying synthetic voice through the Live API inherit a provenance signal by default, which shapes how audio from these agents can later be verified or contested.

What a function-calling voice model asks of builders

The implication of leading with ComplexFuncBench Audio is that Google expects developers to wire this model to real tools and actions, not just transcription and reply. A voice agent that scores 90.8% on multi-step function calling is being sold as something you connect to systems that do things — bookings, lookups, troubleshooting.

That raises the bar on the surrounding engineering. Handling interruptions, mid-call frustration, and long threads reliably is a system-integration problem as much as a model problem. The preview-only status of the developer API is the honest signal: the capability is real, but production voice agents will still hinge on how carefully teams design the tool layer and error handling around it.

Find this story relevant to you?

Contact us to find a unique solution

Contact us

Need an AI engineering partner that can actually build?

We help businesses integrate AI, build AI-powered products, automate high-value workflows, and modernize the software systems behind them.

Get in touch

Related reading

More analysis around product delivery, operational AI, and the systems work that makes deployment hold up in reality.

Jul, 144 min to read
AI Products

How Google DeepMind rebuilt Pelé's unfilmed 1959 goal from archives and stunt footage

Jul, 134 min to read
AI Products

Expedia's image-selection automation is the concrete piece behind its AI marketing story

Jul, 134 min to read
AI Products

ENEOS Materials built over 1,000 custom GPTs and put ChatGPT Enterprise in front of every employee