Gemini in Google Translate, Adds Live Audio, Context, and Duolingo-Style Practice Tools
Google Translate is getting a major update today, with it now using Gemini to improve translation quality by focusing on the nuance of language, giving it a new feature called Live Audio, and a new Duolingo-style language practice.
The new Gemini-built translations are designed to be a lot smarter, natural, and more accurate than previous versions. The update addresses complex language idioms, local expressions, and slang, like translating “stealing my thunder” contextually instead of just word-for-word, which is amazing that they can do this!
A new feature is launching with this new Gemini integration that is a beta experience using Gemini’s native speech-to-speech translation capabilities for real-time translation. The simple way to explain this is that users can put on any pair of headphones, open the Translate app, tap Live Translation, and hear a real-time translation in their preferred language. This is a clever feature, especially since many earphone brands have recently added it as a new update, encouraging people to buy new pairs. However, now that this feature is available in the Translation app, there's no longer a need to upgrade to new headphones just to get Live Translation.
The technology keeps the tone, emphasis, and cadence of each speaker, making conversations, lectures, and films easier to follow than before. The beta is currently rolling out on Android devices in the U.S., Mexico, and India, supporting over 70 languages, with plans to expand to iOS and more countries later in 2026.
Google is also expanding its language learning tools in the Translate app. The new tools provide improved feedback with helpful tips tailored to the user's speaking preferences. A key new feature is the introduction of streak tracking, allowing users to monitor how many days in a row they have been learning, which is very similar to popular language learning apps like Duolingo. So we’ll have to see if the streak will actually make people want to learn more!
All of these updates show that Google is still committed to using advanced AI models that not just capture words, but the meaning behind them. The new capabilities are rolling out to the Translate app, Search, and web, ensuring wide accessibility. Google plans to continue adding new ways for people to make progress in their language learning goals and refine the live translation model based on feedback from users, so let them know if you try it in Google Translate.
Do you think the streak tracking feature will be effective enough to keep people learning? Why do you think they didn’t bring all of these new features to iOS at the beginning? Let us know your thoughts in the comments!
Source and Images: Google