Apple's 'directional audio' concept is like multitouch for the ears
Apple has worked on "directional audio" technology, specifically employed as an audio user interface, allowing users to make selections and navigate menus based on audio cues in a three-dimensional surround sound environment.
The concept was revealed this week in a new patent application made public by the U.S. Patent and Trademark Office named "Directional Audio Interface for Portable Media Device." Discovered by AppleInsider, the filing shows Apple's interest in creating advanced portable devices and accompanying headphones to augment the user interface of the device.
The concept includes one or more "audible control nodes," which are perceived by the user through sound to be located at different points around them. Like the multitouch interface Apple popularized with the iPhone, it's a new twist on an existing way to interact with a portable device, far more advanced than the Voice Over controls featured on the iPod touch.
Apple's application notes that in some contexts, such as driving or running, a user may need to interact with their device in a non-visual manner. While simple actions such as pressing an on/off switch or skipping to the next track may be relatively simple, more complex actions like searching for a particular media file are too difficult to accomplish without visual feedback.
The solution proposed by Apple is an "alternative user interface" that could supplement a device like an iPhone or iPod, allowing users the ability to interact with and control without seeing. This would be accomplished in part through audible cues to the user delivered in a three-dimensional space.
When an option is presented to a user, it could be selected by physically moving the portable device in the direction of the "audible control node." In essence, a user would hear a sound from a particular location via their headphones, and would point a motion-detecting device like an iPhone in that direction to select it.
The application notes that with binaural output to a user through a stereo headset, a portable device can reproduce "spatially distinct" sounds. Coupled with a motion sensor in the device, this audio-based user interface would supplement or perhaps even replace a visual user interface.
Menu items could be presented in a variety of forms, including synthesized text-to-speech, recorded speech, or samples of recorded music. Audio cues could also be played back sequentially or all at once.
Apple's patent application, made public this week, was first filed in December of 2009. It is credited to Aram Lindahl and Richard Powell.
The concept was revealed this week in a new patent application made public by the U.S. Patent and Trademark Office named "Directional Audio Interface for Portable Media Device." Discovered by AppleInsider, the filing shows Apple's interest in creating advanced portable devices and accompanying headphones to augment the user interface of the device.
The concept includes one or more "audible control nodes," which are perceived by the user through sound to be located at different points around them. Like the multitouch interface Apple popularized with the iPhone, it's a new twist on an existing way to interact with a portable device, far more advanced than the Voice Over controls featured on the iPod touch.
Apple's application notes that in some contexts, such as driving or running, a user may need to interact with their device in a non-visual manner. While simple actions such as pressing an on/off switch or skipping to the next track may be relatively simple, more complex actions like searching for a particular media file are too difficult to accomplish without visual feedback.
The solution proposed by Apple is an "alternative user interface" that could supplement a device like an iPhone or iPod, allowing users the ability to interact with and control without seeing. This would be accomplished in part through audible cues to the user delivered in a three-dimensional space.
When an option is presented to a user, it could be selected by physically moving the portable device in the direction of the "audible control node." In essence, a user would hear a sound from a particular location via their headphones, and would point a motion-detecting device like an iPhone in that direction to select it.
The application notes that with binaural output to a user through a stereo headset, a portable device can reproduce "spatially distinct" sounds. Coupled with a motion sensor in the device, this audio-based user interface would supplement or perhaps even replace a visual user interface.
Menu items could be presented in a variety of forms, including synthesized text-to-speech, recorded speech, or samples of recorded music. Audio cues could also be played back sequentially or all at once.
Apple's patent application, made public this week, was first filed in December of 2009. It is credited to Aram Lindahl and Richard Powell.
Comments
I will be impressed though if they release a device they can interpret me moving the divice in the direction to select something whilst running and changing direction.
WTF are they just trying to patent anything now even if its a completely dumb idea. So you hear the menu and move your device in the direction of where it sounds like it is, why not just press a button when you hear the menu item you want.
I will be impressed though if they release a device they can interpret me moving the divice in the direction to select something whilst running and changing direction.
Perhaps you are not... so the innovation is lost on you.
So essentially it's Google's Voice actions, Applefied and patented.
Hardly... Read the text of the patent. These are not voice controls.
So essentially it's Google's Voice actions, Applefied and patented.
No, because google voice actions are controlling the phone by voice. This apparently is control with the accelerometer, with sound as the display.
It's a bizarre idea, and I can't see how it would work in practice, but it's definitely not google voice actions.
Hardly... Read the text of the patent. These are not voice controls.
I see. It's using different types of cues, and not solely factoring in voice.
So essentially it's Google's Voice actions, Applefied and patented.
No. This is clearly a rip-off of Gmail Motion.
http://mail.google.com/mail/help/motion.html
No. This is clearly a rip-off of Gmail Motion.
http://mail.google.com/mail/help/motion.html
I remember that....and all the angry comments on how google just thrown away a perfectly good idea. good times(april fools
No. This is clearly a rip-off of Gmail Motion.
http://mail.google.com/mail/help/motion.html
You're right! Unbelievable! Hail Google, great invention, looking forward to this.
why not just press a button when you hear the menu item you want.
Because there is only one button and it doesn't do that.
WTF are they just trying to patent anything now even if its a completely dumb idea. So you hear the menu and move your device in the direction of where it sounds like it is, why not just press a button when you hear the menu item you want.
I will be impressed though if they release a device they can interpret me moving the divice in the direction to select something whilst running and changing direction.
The utility and practicality of this method for individuals with vision or speech inhibitors was apparently lost on you.
The "lets think of ourselves" mentality at its finest!
No. This is clearly a rip-off of Gmail Motion.
http://mail.google.com/mail/help/motion.html
It's not that either. Google motion is a set of gestures that control the computer, essentially a form of sign-language used to control a regular screen device with no keyboard or less keyboard - this replaces both screen and keyboard.
It's distinctly different.
It's distinctly different.
How is it that folks on this board cant see the obvious differences between what they think its like, and what this is?
Is it because they dont read before commenting, or because they lack basic critical thinking skills?
You're right! Unbelievable! Hail Google, great invention, looking forward to this.
If google was smart, one of the ICS features would technically allow this to be plausible. But like most things I'm guessing Google will miss the first time around, like with the ability to natively manage apps >_>.
Forgive me if I detect huge amounts of sarcasm in your post, nothing personal.
How is it that folks on this board cant see the obvious differences between what they think its like, and what this is?
Is it because they dont read before commenting, or because they lack basic critical thinking skills?
Dunno - but I do think it's interesting that Google Motion is effectively voice control for deaf people, and Apple have now patented what is kinda like a mouse for the blind.
Probably more amusement than sarcasm (but no offence taken!). I just thought this is a really funny page from Google. Although this is a very clear joke from Google, this doesn't necessarily mean they are not working on something serious with these kind of gestures.
Also if you are watching the accompanying videos and this wife: 'we are made for kill' - really very funny!
I don't know how well it will work with earbuds... Large driver over the ear headphones really make a difference with binaural output..