Google adds instant Japanese translation to Translate's iPhone camera-based Word Lens
Google Translate has received an update that adds support for Japanese to the iOS app's augmented reality Word Lens feature, one that allows users to see Japanese words and phrases replaced by English equivalents when viewed through an iPhone or iPad's camera.
The Word Lens function effectively allows for instant translations via the camera, with recognized text overlaid in the camera's live view by another selected by the user. The app is extremely useful for travelers needing quick translations of signs and menus, with translations all performed on the mobile device without requiring a data connection.
Google advises the app was previously capable of performing translations from Japanese to English via the camera, but only by taking a photograph and highlighting text areas that need to be translated. In today's update, this option is still available, but enables the live Word Lens function for the language.
The feature is meant for brief phrases and words, to convey the general meaning of the message rather than an exact translation. It is possible to get a live translation for a long passage of text, but the translation is likely to be inaccurate and disjointed when viewed in this way.
Word Lens was originally its own standalone app, but Google acquired developer Quest Visual in 2014 before quickly incorporating the app's technology into Google Translate. Shortly before the acquisition, Word Lens was promoted in an ad for the iPhone 5, with the "Powerful" commercial briefly demonstrating the app translating a road sign for the user.
The addition of Japanese support means the app can now translate text live through Word Lens in 30 languages. Google Translate is also able to translate a total of 103 languages by typing, and has offline translation abilities for 52 languages.
The Word Lens function effectively allows for instant translations via the camera, with recognized text overlaid in the camera's live view by another selected by the user. The app is extremely useful for travelers needing quick translations of signs and menus, with translations all performed on the mobile device without requiring a data connection.
Google advises the app was previously capable of performing translations from Japanese to English via the camera, but only by taking a photograph and highlighting text areas that need to be translated. In today's update, this option is still available, but enables the live Word Lens function for the language.
The feature is meant for brief phrases and words, to convey the general meaning of the message rather than an exact translation. It is possible to get a live translation for a long passage of text, but the translation is likely to be inaccurate and disjointed when viewed in this way.
Word Lens was originally its own standalone app, but Google acquired developer Quest Visual in 2014 before quickly incorporating the app's technology into Google Translate. Shortly before the acquisition, Word Lens was promoted in an ad for the iPhone 5, with the "Powerful" commercial briefly demonstrating the app translating a road sign for the user.
The addition of Japanese support means the app can now translate text live through Word Lens in 30 languages. Google Translate is also able to translate a total of 103 languages by typing, and has offline translation abilities for 52 languages.
Comments
- Kanji - Japanese Names, Nouns and Verbs that have direct meanings. Some Kanji have multiple meanings, which is why context matters.
- Katakana - Foreign Names and sounds
- Hiragana - Everything but Foreign Names
So if it detects Kanakana, it knows to try and and sound out what the word is. Most Japanese sentences are a mixture of Kanji and Hiragana, and the younger the reader targeted, the less Kanji there will be. Try using this to read print shoujo/shonen manga, I bet it would get enough right.
Getting the nuances of the language however, AI is unlikely to get. This is why translating something like English or Korean tends to be a crapshoot, because of words like "their,there,they're" , "your,you're" and "its,it's" because these sound the same, and people use the wrong words all the time (especially online) so without knowing what that word sounds like in the context of the sentence the AI has to read the entire sentence to determine a meaning. With Kanji, we know Kanji isn't going to be used for onomatopoeia, and can be translated typically two-characters at a time.
(I've amateur translated stuff before, and while Japanese IS hard for a human to learn, English is in fact harder because of the tendency to use idioms and metaphors. So an AI is more likely to be mislead in English than it is with Japanese. However the one thing I did find in Japanese that neither Google or Bing could figure out, are phrases that roughly mean "I will do my best today" with an obscure dialect.)
I try not to use google services due to the data collecting and ads but translate and maps are unbeatable at the moment imho, for my needs anyway.
http://www.onenewspage.com/video/20170126/6666019/SM2398-Google-Translate-Japanese-03.htm
Note that in the last part of that video, the toilet part that is mistranslated VIDEO should actually be translated BIDET. With those toilets being so common everywhere in Japan and with "BIDET" being written on them too, it's rather surprising that translation was so wrong.