Today Google has expanded its translate app by two functions that are supposed to lift the translation and language learning to a new level. The integration of the Gemini-Ki models makes it possible that we can now have conversations in over 70 languages in real time. Theoretically. As so often: Germany is not a starting market.
The new live translation function is very easy to use: you open the app, tap on “Live Translate” and select the desired languages. The system automatically recognizes speech breaks, accents and emphasis and alternates intelligently between languages. The translations are both shown as text and output via the speakers.
The improved noise suppression also enables translations in noisy environments such as airports or cafés. At the start, the function in the USA, India and Mexico is available.
The second innovation aims at everyone who wants to learn a language. The app now generates personalized practice units that adapt to the respective language level. After selecting the level of difficulty and learning goals, interactive scenarios are created. These can be used for listening comprehension or speech practice.
The exercises were developed together with language learning experts and are based on current research results. The learning progress is recorded daily. First of all, the beta version for English-language users is available for learning Spanish and French. Spanish, French and Portuguese mother speakers can also practice English.
The improvements are based on the progress of the Gemini-Ki models, which not only enable text-to-text translations, but also master multimodal translations and text-to-language functions. Google states that about a trillion words are translated through its various translation services every month.
Transparency: This article contains partner links. By clicking on it, you get directly to the provider. If you choose a purchase there, we will receive a small commission. Nothing changes for you at the price. Partner links have no influence on our reporting.
