Apple patents eye-tracking gaze controls for iOS, Mac devices
Apple on Tuesday was granted a patent for an advanced gaze-tracking graphical user interface that could one day see implementation in Macs, iPhones, iPads or even a future version of the Apple TV.
Source: USPTO
As granted by the U.S. Patent and Trademark Office, Apple's U.S. Patent No. 8,937,591 for "Systems and methods for counteracting a perceptual fading of a movable indicator" deals with Troxler's fading, a problem unique to eye-tracking and gaze-based GUI solutions.
According to Apple, Troxler's fading, otherwise known as the Troxler Effect, is a phenomenon that affects visual perception of unmoving stimuli or objects in one's peripheral vision. As explained, one result of the phenomenon is a perceived fading of a visual stimulus when its location on the retina becomes fixed, making it a stabilized retinal image.
It is thought that the brain uses the mechanism to deal with blind spots on the retina, but in persistent gaze tracking systems, Troxler's fading can be detrimental to user experience. For example, when a user fixes their vision on a particular point, such as a computer cursor, and that object moves along with their gaze, it can quickly disappear.
Not accounting for the Troxler Effect in particularly effective and accurate gaze-based control systems can result in the perceived fade of a movable indicator. It should be noted that in order to invoke a stabilized retinal image, such a system would need to be accurate enough to detect slight shifts in a user's gaze and reflect those changes onscreen almost instantaneously.
Staring at the center cross of the so-called "lilac chaser" illustrates one effect of Troxler's fading.
Source: Wikipedia
Assuming Apple creates an adequately precise gaze-tracking GUI, today's patent offers a blend of hardware and software solutions to counter the Troxler Effect and any resulting perceived fluctuation in visual acuity.
In one embodiment, the invention employs eye-tracking hardware to follow a user's gaze and relay that information to an onscreen GUI. A movable indicator is associated with a user's point of gaze, thereby facilitating input through detection of eye movement.
To thwart perceived cursor fade, Apple suggests a system that measures possible perceptual fading by detecting time elapsed between eye movements, blinking or a combination of both. By measuring the time between eye movements, as per any number of predefined thresholds, the system is able to counteract fade before it starts.
Another method uses infrared sensors to detect when a user is blinking and moves the cursor during that short time span. The system may compare a sequence of images taken of a user's face or detect a user's pupil -- or lack thereof -- to determine an eye blink.
Finally, the patent describes a method by which the user's distance from the display or viewing angle is measured and tracked.
All three methods end with a repositioning of the onscreen movable indicator if the system determines a user is in danger of experiencing perceived fade, which in most cases can be established through lack of eye, body or facial movement. To preemptively counter perceived fade, a countermeasure generator may vary cursor positioning, apply animations to the indicator or otherwise provide visual modifications to prevent against a distracting user experience.
Apple notes a number of use case scenarios, including standard Mac laptops and multitouch iOS devices, but a gaze-tracking system could be an ideal input option for the company's long-awaited Apple TV refresh. If an eye-tracking feature is included, perhaps with voice control functionality for making selections and calling up menus, Apple would be ushering in a new breed of "hands-off" device control.
In April of 2014, rumors claimed motion controls would play a "key role" in next-generation Apple TV hardware, but that specific implementation is thought to incorporate technology acquired through Apple's then-recent purchase of 3D scanning firm PrimeSense.
While most recent Apple patents have focused on physical touch-based controls, such as last week's Touch ID "joystick," today's patent proves the tech giant is still experimenting with alternative forms of input.
Apple's gaze-based GUI with perceived fade countermeasures was first filed for in April 2012 and credits David P. Julian as its inventor.
Source: USPTO
As granted by the U.S. Patent and Trademark Office, Apple's U.S. Patent No. 8,937,591 for "Systems and methods for counteracting a perceptual fading of a movable indicator" deals with Troxler's fading, a problem unique to eye-tracking and gaze-based GUI solutions.
According to Apple, Troxler's fading, otherwise known as the Troxler Effect, is a phenomenon that affects visual perception of unmoving stimuli or objects in one's peripheral vision. As explained, one result of the phenomenon is a perceived fading of a visual stimulus when its location on the retina becomes fixed, making it a stabilized retinal image.
It is thought that the brain uses the mechanism to deal with blind spots on the retina, but in persistent gaze tracking systems, Troxler's fading can be detrimental to user experience. For example, when a user fixes their vision on a particular point, such as a computer cursor, and that object moves along with their gaze, it can quickly disappear.
Not accounting for the Troxler Effect in particularly effective and accurate gaze-based control systems can result in the perceived fade of a movable indicator. It should be noted that in order to invoke a stabilized retinal image, such a system would need to be accurate enough to detect slight shifts in a user's gaze and reflect those changes onscreen almost instantaneously.
Staring at the center cross of the so-called "lilac chaser" illustrates one effect of Troxler's fading.
Source: Wikipedia
Assuming Apple creates an adequately precise gaze-tracking GUI, today's patent offers a blend of hardware and software solutions to counter the Troxler Effect and any resulting perceived fluctuation in visual acuity.
In one embodiment, the invention employs eye-tracking hardware to follow a user's gaze and relay that information to an onscreen GUI. A movable indicator is associated with a user's point of gaze, thereby facilitating input through detection of eye movement.
To thwart perceived cursor fade, Apple suggests a system that measures possible perceptual fading by detecting time elapsed between eye movements, blinking or a combination of both. By measuring the time between eye movements, as per any number of predefined thresholds, the system is able to counteract fade before it starts.
Another method uses infrared sensors to detect when a user is blinking and moves the cursor during that short time span. The system may compare a sequence of images taken of a user's face or detect a user's pupil -- or lack thereof -- to determine an eye blink.
Finally, the patent describes a method by which the user's distance from the display or viewing angle is measured and tracked.
All three methods end with a repositioning of the onscreen movable indicator if the system determines a user is in danger of experiencing perceived fade, which in most cases can be established through lack of eye, body or facial movement. To preemptively counter perceived fade, a countermeasure generator may vary cursor positioning, apply animations to the indicator or otherwise provide visual modifications to prevent against a distracting user experience.
Apple notes a number of use case scenarios, including standard Mac laptops and multitouch iOS devices, but a gaze-tracking system could be an ideal input option for the company's long-awaited Apple TV refresh. If an eye-tracking feature is included, perhaps with voice control functionality for making selections and calling up menus, Apple would be ushering in a new breed of "hands-off" device control.
In April of 2014, rumors claimed motion controls would play a "key role" in next-generation Apple TV hardware, but that specific implementation is thought to incorporate technology acquired through Apple's then-recent purchase of 3D scanning firm PrimeSense.
While most recent Apple patents have focused on physical touch-based controls, such as last week's Touch ID "joystick," today's patent proves the tech giant is still experimenting with alternative forms of input.
Apple's gaze-based GUI with perceived fade countermeasures was first filed for in April 2012 and credits David P. Julian as its inventor.
Comments
“Like, dude, these arrows are so trippy… Imagine if I was a chameleon and could move two of ‘em at once…”
Yes, I know that’s not a smile.
Troxler's fading - love it.
We perceive the world visually via an eye-brain system. Together they do remarkable things, such as filling in missing or incomplete information but can be tricked too by the drive to make sense of the world. A bit like people in general really.
" src="http://forums-files.appleinsider.com/images/smilies//lol.gif" />
Troxler's fading - love it.
We perceive the world visually via an eye-brain system. Together they do remarkable things, such as filling in missing or incomplete information but can be tricked too by the drive to make sense of the world. A bit like people in general really.
" src="http://forums-files.appleinsider.com/images/smilies//lol.gif" />
But what's also interesting is that we have a perpetual blind spot. And I wonder where it is. I wouldn't be surprised to find that it conforms to the Golden Section.
That would depend if you mean literally or not. We all know and understand the eye's optic disc issue I am sure assuming one was awake in first grade biology ... the psychological version ... now there is a discussion! As to the Golden Section ... you lost me there.
I meant the literal blind spot that we all have. It's slightly to the side of our vision in each eye. There's an easy method of finding it, but I can't remember what it is.
The Golden Section is closely related to the Fibonacci Sequence. It's an algebraic formula commonly found in nature, that is also used to determine the sweet spot in photography and art generally. It’s roughly equal to about 5/8ths or 1.62.
I already mentioned that, it is caused by the optic nerve's junction with the retina, known as the optic disc. I am well aware what the Golden Section is, I meant you lost me in trying to link that to the area of the retina that has no rods and cones. I am assuming you didn't stay awake in biology class when you were 11. Here you go: http://en.wikipedia.org/wiki/Blind_spot_(vision)
How clear can I be?
The blind spot is the same for everyone, and may conform to the Golden Ratio. I suspect it probably is close, as I recall that it is fairly near the middle of the field of vision, but slightly off-centre.
No need for your snarkiness.