Apple shows continued interest in haptic touchscreen fingertip feedback
Future iPhones and iPads from Apple could feature advanced technology that would allow users to not only touch the screen, but also feel textures and other feedback on their fingertips.
Apple has shown interest over the years in making touchscreens more immersive and responsive to users with haptic feedback. In March, it was even suggested that Apple had been in contact with a company called Senseg, which sells technology that uses electric fields to simulate complex, context-sensitive textures on a touchscreen device.
A newly published patent application from Apple, and discovered by AppleInsider, aims to offer the same ability to make a touchscreen feel smooth, rough or otherwise, but through different methods. The proposed invention, entitled "Methods and Systems for Providing Haptic Control," features a tiered haptic system that would be formed by stacking haptic elements.
"One or more arrays of shape change elements such as, for example, piezoelectric elements may be used to actuate a screen surface," the filing reads. "Arrays may also be used to sense tactile interactions and stimuli on a screen surface.
"An embedded haptic system may be formed by inserting haptic elements into a contoured elastic sheet. The embedded haptic system may provide tactile interactions to a user. In some embodiments, both tiered and haptic arrangements may be used."
Apple's filing notes that tactile feedback systems allow users to ability to interact with a system on a deeper level than just using a simple touchscreen. Haptic feedback is most commonly found in video games, where console controllers will "rumble" in response to an event in the game.
But Apple's "layered" solution would go beyond simple vibration, and would also offer shape changes that would contour a flat surface. In this way, the touchscreen of an iPhone or iPad could physically move and allow users to feel certain textures on their fingertips when they touch the screen.
The latest application isn't the first time Apple has shown detailed interest in advanced haptic feedback technology. In March, AppleInsider was also the first to report on a similar patent application that described using piezoelectric actuators for "localized haptic feedback," allowing users to feel a virtual button on their fingertips.
n 2010, Apple also filed a patent application for what it called a "multi-haptic" system that would detect multi-touch gestures and provide a number of physical feedback responses accordingly. And in 2009, before the iPad was announced, one application described a tablet-style device with a dynamic surface that would give users tactile feedback when typing in order to identify individual keys on their fingertips.
The latest proposed haptic feedback invention from Apple, published this week by the U.S. Patent and Trademark Office, was first filed in October of 2011. It is credited to Michael D. Lampell, Francois-Yves Bertrand, Alan Berfield, Leo Lee, and Eric Snider.
Apple has shown interest over the years in making touchscreens more immersive and responsive to users with haptic feedback. In March, it was even suggested that Apple had been in contact with a company called Senseg, which sells technology that uses electric fields to simulate complex, context-sensitive textures on a touchscreen device.
A newly published patent application from Apple, and discovered by AppleInsider, aims to offer the same ability to make a touchscreen feel smooth, rough or otherwise, but through different methods. The proposed invention, entitled "Methods and Systems for Providing Haptic Control," features a tiered haptic system that would be formed by stacking haptic elements.
"One or more arrays of shape change elements such as, for example, piezoelectric elements may be used to actuate a screen surface," the filing reads. "Arrays may also be used to sense tactile interactions and stimuli on a screen surface.
"An embedded haptic system may be formed by inserting haptic elements into a contoured elastic sheet. The embedded haptic system may provide tactile interactions to a user. In some embodiments, both tiered and haptic arrangements may be used."
Apple's filing notes that tactile feedback systems allow users to ability to interact with a system on a deeper level than just using a simple touchscreen. Haptic feedback is most commonly found in video games, where console controllers will "rumble" in response to an event in the game.
But Apple's "layered" solution would go beyond simple vibration, and would also offer shape changes that would contour a flat surface. In this way, the touchscreen of an iPhone or iPad could physically move and allow users to feel certain textures on their fingertips when they touch the screen.
The latest application isn't the first time Apple has shown detailed interest in advanced haptic feedback technology. In March, AppleInsider was also the first to report on a similar patent application that described using piezoelectric actuators for "localized haptic feedback," allowing users to feel a virtual button on their fingertips.
n 2010, Apple also filed a patent application for what it called a "multi-haptic" system that would detect multi-touch gestures and provide a number of physical feedback responses accordingly. And in 2009, before the iPad was announced, one application described a tablet-style device with a dynamic surface that would give users tactile feedback when typing in order to identify individual keys on their fingertips.
The latest proposed haptic feedback invention from Apple, published this week by the U.S. Patent and Trademark Office, was first filed in October of 2011. It is credited to Michael D. Lampell, Francois-Yves Bertrand, Alan Berfield, Leo Lee, and Eric Snider.
Comments
Now I am getting interested in the iPad
These patents sound like they are years away from Apple even deciding if they WANT them in a product. Durability and other concerns would make me shy away from putting the early versions of anything like this in a product that ships in the tens of millions.
Still, I’m all for innovation and invention! Practical or not, I’m glad people are thinking in these ways. Apple patents a ton of new ideas, and a few of the most exotic ones might ship one day.
Quote:
Originally Posted by nagromme
These patents sound like they are years away from Apple even deciding if they WANT them in a product. Durability and other concerns would make me shy away from putting the early versions of anything like this in a product that ships in the tens of millions.
Still, I’m all for innovation and invention! Practical or not, I’m glad people are thinking in these ways. Apple patents a ton of new ideas, and a few of the most exotic ones might ship one day.
Perhaps Apple is a few years away from shipping tactile sensations on a touchscreen device but it is notable that Apple has been investigating tactile feedback for several years. A press release from Senseg in January 2012 is also notable:
Senseg Unveils First Feelscreen Product
Senseg’s Patented Technology Produces Tactile Sensations for
Touch Interface Devices
JANUARY 10, 2012, HELSINKI and CUPERTINO, CA – Senseg, the leader in next-generation haptic technology, today announced that it has unveiled the first production-ready product that adds tactile effects to touch interfaces with a completely solid state solution—turning touch screens into ‘feelscreens’. The company’s patented technology, which produces tactile sensations on users’ skin, will be integrated into a new generation of touch interface devices. Senseg’s solution delivers a new dimension of interactive experiences–including textured surfaces, contours and edges–that add the dimension of feel to touch interfaces.
Senseg expects its first customers, which will be Original Equipment Manufacturers (OEMs), to integrate Senseg’s technology into consumer products in the next year. Customers can license the Senseg hardware and software to create feelscreen applications in areas ranging from games to productivity applications, social shopping, and enhanced user interfaces.
According to DisplaySearch, the global touchscreen market will reach $9 billion by 2015, and the company lists twelve major technology areas for this market; Senseg’s technology plays in several of these areas. Senseg was recently named to TIME Magazine’s ’50 Best Inventions’ list.
When Senseg’s technology is incorporated into a touch interface device, application developers will have precise control over the specific location and type of haptic effects that users experience. Senseg effects have a very broad dynamic range, both in the type of effect delivered as well as the effect’s intensity. With Senseg, application designers can use feel to both guide and reward user actions, whether it is used to minimize visual focus required for accurate operation, or to enrich a multi-modal experience that incorporates graphics, sound and touch.
“Senseg provides a complete suite of patented technologies for hardware and software developers to provide immediate tactile responses, delivering a new dimension to any touch interface. We can enhance the visual content on a display with touch feedback that creates the sensation of moving a vinyl record on a DJ music app, feeling sand when accessing images of the Gobi Desert, or feeling the corner of a page when reading an e-book on a tablet,” said Ville Mäkinen, the founder and CTO of Senseg. “We have created highly efficient solutions that provide the precise tactile sensations right at the location of the user’s finger without shaking the whole device and yet consume very little power on mobile devices.”
If they could get the resolution high enough they could use the display to display brail. This would open up a whole new client base of blind people who could now use the iPad to read books and magazines.
Interesting. We're all used to iOS responding instantly to finger taps (or when we lift up from a tap.) But, if I'm reading the article right, haptic feedback displays would let iOS respond when users actually push down configurable buttons / keys. Not just when resting a finger on the screen.
This means that taps could, in theory, have two semantic meanings: 1. do something when a finger touches or lifts off from the screen, or 2. do something when a user physically clicks on a raised haptic button. So the SDK could in theory provide two different types of buttons: haptic and non-haptic. An example of a non-haptic button would be some kind of game-play button when the user taps something on the screen. Faster to not require a physical click, and some tappable items would be so big that making them into a raised button would make little sense. Haptic buttons could, of course, include keyboard keys, Done buttons, etc.
I'm not sure that Apple would want to add that extra level of complexity to the iOS UI. Oh, and by the way, you can change the letter you're typing (on the default keyboard) by tapping, holding, and dragging your finger until the right letter appears. The letter isn't added to the input field until you lift.
(@ KyleG: yes, maybe the haptic elements could be more for Accessibility features than for basic app interfaces.)
This is a porn thing, isn't it?
I think I prefer Smellavision.
The moment this is available in an iPad, I'm buying a tablet. The lack of feel is why touchscreens are terrible to type on and impossible to use without looking.
I really hope this will be available in the next iPad version. It's not impossible, considering the Senseg tech seems to work quite decently already based on the videos I've seen.
Haptic sounds pretty hectic!
Quote:
Originally Posted by KyleG
If they could get the resolution high enough they could use the display to display brail. This would open up a whole new client base of blind people who could now use the iPad to read books and magazines.
Stevie Wonder already owns and uses an iPad, and says that there's nothing he can't do on it that anybody else can.
Quote:
Originally Posted by elroth
I think I prefer Smellavision.
How about doing away with a touchscreen altogether? Carnegie Mellon developers working alongside Disney Research are creating ways to interact with nearly any conductive surface, even water.
"One potential application is a desk surface which is all touch-sensitive, allowing you to manipulate objects on your screen with far greater fidelity than even today’s best tablets. Fingers may be imprecise compared to a mouse pointer or a stylus, but that’s only because the tablet is small. Give your hands the entire surface of your desk to work on, and the results might be beyond our current imagination.
The researchers came up with their own neat concept uses: a music player that’s controlled by touching your own hand (hit a pinky to pause, two-fingers on the palm to play); doorknobs that lock, trigger lights, or display messages based on how you touch them; a sofa that turns on the TV when you sit down, then turns down the lights when you recline; and bowl of cereal that frightens a child who uses the wrong utensil.
Another use the research team is considering is to control and access our increasingly smaller computer interfaces, as well as the elimination of traditional input devices like keyboards or mice. Tools which currently need to be large enough to provide space for a manipulable user interface could continue to shrink."
http://venturebeat.com/2012/05/04/amazing-new-touch-technology-could-revolutionize-smartphones-doorknobs-your-sofa/
http://www.disneyresearch.com/research/projects/hci_touche_drp.htm
Very glad to support Apple, as they continue to offer the most adaptations for the disabled population! This is great news! I will continue to watch to see what they come up with in the future & will continue to recommend their products to my patients!!!
With haptic feedback, we truly enter the post-PC era.
A keyboard that enabled blind people to read brail books would be truly amazing - it would genuinely change people's lives (as well as making typing on iPads easier for the rest of us.
It also has a gaming application - what fun! In short, it would only add to the user experience. Come on, Apple, this is a win-win technology.