Google Assistant response speed getting improved by on-device processing
The Google Assistant will be quicker to respond to user queries faster by performing processing on the device, the search company revealed at Google I/O, with the next generation of the virtual assistant able to quickly switch between apps and help with multitasking in Android than for previous versions.
The promise of on-device processing of digital assistants offer the possibility of faster response times for queries based on locally-held data, without necessarily requiring an internet connection. It also has the prospect of fending off any potential privacy issues caused through dispatching requests to the cloud, where the data may be analyzed and used for other purposes.
At Google I/O, the search company suggested it was getting closer to the idea of on-device virtual assistants, with the next version capable of processing requests up to ten times faster.
An on-stage demonstration showed someone rattling through multiple queries in quick succession, with a small corner transcript of what was being heard revealing a lot of the processing was being carried out at a very high speed. Much faster than what would normally be expected by offloading processing to a separate server.
According to Google, it has reduced the size of the artificial intelligence models used for speech recognition and language understanding down from hundreds of gigabytes in size to less than half a gigabyte, making it more manageable to store on a smartphone. This enables the next generation Assistant to perform near real-time transcription without an Internet connection.
The Assistant also includes query features like Continued Conversation, where multiple queries could be made in a row without requiring the use of "Hey Google" every time. The examples also showed how a user could write a message out verbally and insert an image from a separate app, all without requiring any finger presses or vocal prompts to change task.
Google anticipates the next-generation Assistant will be arriving initially on its new Pixel smartphones later this year. It is unclear when it will roll out to other Android device, or even to the iOS app.
Google is not the only company grappling with the idea of on-device processing for virtual assistants.
Siri, Apple's digital assistant that is on a par with Google Assistant in terms of worldwide usage, could have an offline mode if a November patent application comes to fruition. Titled "Offline personal assistant," the Apple filing suggests the use of speech-to-text processing and validation to occur on the device, and if a connection was available, could perform both local and remote processing for two possible interpretations of a query, which could be used to further confirm a transcription as correct.
The promise of on-device processing of digital assistants offer the possibility of faster response times for queries based on locally-held data, without necessarily requiring an internet connection. It also has the prospect of fending off any potential privacy issues caused through dispatching requests to the cloud, where the data may be analyzed and used for other purposes.
At Google I/O, the search company suggested it was getting closer to the idea of on-device virtual assistants, with the next version capable of processing requests up to ten times faster.
An on-stage demonstration showed someone rattling through multiple queries in quick succession, with a small corner transcript of what was being heard revealing a lot of the processing was being carried out at a very high speed. Much faster than what would normally be expected by offloading processing to a separate server.
According to Google, it has reduced the size of the artificial intelligence models used for speech recognition and language understanding down from hundreds of gigabytes in size to less than half a gigabyte, making it more manageable to store on a smartphone. This enables the next generation Assistant to perform near real-time transcription without an Internet connection.
The Assistant also includes query features like Continued Conversation, where multiple queries could be made in a row without requiring the use of "Hey Google" every time. The examples also showed how a user could write a message out verbally and insert an image from a separate app, all without requiring any finger presses or vocal prompts to change task.
Google anticipates the next-generation Assistant will be arriving initially on its new Pixel smartphones later this year. It is unclear when it will roll out to other Android device, or even to the iOS app.
Google is not the only company grappling with the idea of on-device processing for virtual assistants.
Siri, Apple's digital assistant that is on a par with Google Assistant in terms of worldwide usage, could have an offline mode if a November patent application comes to fruition. Titled "Offline personal assistant," the Apple filing suggests the use of speech-to-text processing and validation to occur on the device, and if a connection was available, could perform both local and remote processing for two possible interpretations of a query, which could be used to further confirm a transcription as correct.
Comments
"Users in English-speaking countries will be able to stop ringing alarms and timers on Google Home and Smart Display devices simply by saying "stop," no hotword required."
Two years ago we were told onboard AI would be a major advance for low latency, ultra fast response situations and where privacy is paramount. It's becoming reality.
https://www.youtube.com/watch?time_continue=7&v=FDdorhY7fb8
As for Google, they're just trying to speed things up a bit -- no change in their privacy invasion.
As for Google, they're just trying to speed things up a bit -- no change in their privacy invasion.
=====================================
As a user of Google search (and Bing, too, actually)...I'm always interested to hear of how Google "invaded my privacy" today...? What exactly did Google do to me after several web searches today to make my private life less private?
”Modern ad tracking goes well beyond just profiling users into various demographics to show them "relevant ads." Ad networks exist to find cross-app and cross-site web browsing correlations they can market to ad buyers.
So when their user surveillance notices, for example, that a large number of users who install a specific workout app and also use a food delivery service are also statistically likely to pay for a subscription to Grindr, they can offer strategic ad placement to the vendor of that gay hookup app within every app that particular population of users will see.
...
The specific example above of an attempt at "relevant advertising" is potentially valuable to an advertiser seeking to target their ad budget at gay men willing to pay for a cruising tool, but it may make faulty assumptions about the user of a device. That could end up being embarrassing at best and plausibly even cause a person to lose their job in any number of states or countries where there is no legal protection from discrimination launched in the mere suspicion of a person's private life details.
That targeting could also destroy a relationship. And if you're traveling in some countries, it could potentially threaten you with detainment and even persecution at the border. All because your private behaviors were interpreted by an algorithm to imply a potential interest that others might notice. Targeted advertising can appear to reveal private things about you that may not even be accurate, yet with such confidence that it makes you look like you're hiding something.”
Perhaps this doesn’t reflect you or your habits, but it’s an example of what is going on behind the scenes that many people are unaware of.
canukstorm said: Google does not sell personal information. Period.
Google sells ad placement services that are made more valuable by being able to lump people with similar interests and/or demographics together into big de-personalized baskets of potential customers for a company's product/service.
You are far from the only person here who has misunderstood or been mislead about Google's ad services and how personal information that may be entrusted with them is protected and not sold.
It can play your music library, YouTube Recommanded, Spotify, Google Photos of the user asking, instantly, at the volume you commanded, and control the lighting, turning on/off fans and aircond as setup from Google Home app, all by voice.
Google Home also sync setting changes from Apple HomeKit for wherever changes, but not vice versa. That’s Apple HomeKit’s problem.
"We do not sell your personal information to anyone"
Been listening too much to the other tin foil types
I think the general idea is that Google is collecting all available information about you when you use its services. This information is then used to target ads to you. Some people think that invades their privacy; others do not.