News · Gemini 2.5 moves audio from post-processing to native generation
Gemini 2.5 moves audio from post-processing to native generation
Google folds speech generation and real-time dialog into the model itself, exposing both through the Gemini API in AI Studio and Vertex AI.
Speech as a model output, not a downstream stage
The framing Google uses here is that Gemini reasons and generates speech natively in audio, rather than converting text to speech as a separate stage. That distinction is the whole announcement. Instead of a pipeline where a language model produces tokens and a separate TTS engine reads them aloud, the model itself emits audio. The practical payoff Google claims is expressivity and prosody delivered at low latency, because there is no handoff between components.
This is why features like affective dialog and style control are even possible in this release. If the model is reasoning directly in audio, it can respond to the user's tone of voice and adjust its own delivery mid-conversation through natural language prompts, including whispering or adopting an accent. Those behaviors are hard to graft onto a text-first pipeline where the emotional signal is stripped out before synthesis.
Function calling and 'knowing when not to speak'
Two features stand out as more than demo material. First, tool integration during dialog: Gemini 2.5 can use function calling and pull real-time information from Google Search or developer-built tools while a conversation is underway. That turns a voice interface into something that can act, not just talk, without breaking the conversational flow to run a separate query step.
Second, what Google calls proactive audio — the system is trained to discern and disregard background speech, ambient conversation and other irrelevant audio, responding only when appropriate. Google summarizes it bluntly:
Basically, it understands when not to speak.Montana Labs
For anyone who has built a voice product, the interruption and false-trigger problem is often what makes real deployments feel broken. Treating restraint as a trained capability rather than a hardcoded push-to-talk gate is a meaningful design choice, though the announcement offers no metrics to judge how well it works.
Two tiers for text-to-speech, one product pattern generalized
On the generation side, Google splits controllable TTS across Gemini 2.5 Pro Preview for state-of-the-art quality on complex prompts and Gemini 2.5 Flash Preview for cost-efficient everyday use. The controls include delivery speed, pronunciation accuracy for specific words, emotional performance, and multi-speaker dialogue generation. That last item is explicitly the 'NotebookLM-style' two-person audio overview being exposed as a generic capability.
That is the more interesting move: NotebookLM's Audio Overviews and Project Astra are cited as existing products built on these models, and now the same two-voice conversational generation is offered to developers directly. Google is effectively productizing an internal feature and letting anyone build announcements, stories, podcasts and game audio on top of it, with a clear cost/quality knob between Pro and Flash.
Watermarking and API access set the deployment terms
Every audio output from these models carries SynthID, Google's watermark, so generated audio is identifiable. Given that the release explicitly enables accent imitation, emotional performance and multi-speaker synthesis, embedding provenance by default is the necessary counterweight, and Google pairs it with red teaming and internal and external safety evaluations it references but does not detail.
The specific implication for teams building voice applications: the pieces that used to require stitching together ASR, an LLM, a TTS vendor and interruption logic are now converging into a single API surface in Google AI Studio and Vertex AI, with native dialog in the stream tab and TTS in the generate media tab. The engineering question shifts from integrating four systems to evaluating whether one model's latency, tool-calling reliability and turn-taking behavior hold up in your actual use case — claims the announcement asserts but does not yet quantify.
Find this story relevant to you?
Contact us to find a unique solution
Need an AI engineering partner that can actually build?
We help businesses integrate AI, build AI-powered products, automate high-value workflows, and modernize the software systems behind them.
Related reading
More analysis around product delivery, operational AI, and the systems work that makes deployment hold up in reality.