or Connect
AppleInsider › Forums › General › General Discussion › Apple new touchscreen tech would use IR light to discern hard presses from soft
New Posts  All Forums:Forum Nav:

Apple new touchscreen tech would use IR light to discern hard presses from soft

post #1 of 24
Thread Starter 
Using a combination of capacitive touch and infrared light sensing, Apple's newly revealed touchscreen technology concept allows users to accurately convey force applied to a touch surface without bulky physical hardware, opening new dimensions in GUI navigation and interaction.




Apple's proposed invention, as described by a patent application published by the U.S. Patent and Trademark Office on Thursday, uses frustrated total internal reflection in conjunction with other touch sensing technology to determine how hard a user is pressing on a device screen.

Perhaps the most well known implementation of FTIR is Microsoft's Perceptive Pixel touch displays made popular by television news networks and other public applications. Apple's solution builds on existing systems by affording granular data as to the amount of force being applied by the user.


Source: USPTO


In one embodiment, Apple's system deploys one or more IR transmitters beneath the bezels of a touchscreen to emit IR light into the cover glass at a specific angle. These angles may be selected so that 100 percent of emitted light is reflected between the top and bottom surfaces of a cover glass and ambient air or a finger.

After traveling within the cover glass, the emitted IR light hits a receiver that calculates amount of total internal reflection. Depending on whether the light interfaced with ambient air or a user's finger substantially touching the cover glass, the readings will be different.




Unlike other systems, Apple's invention does not require an exact transmission limit as long as a difference in internal reflection can be distinguished. Further, no particular requirement of internal reflection exists as long as the touch interface can distinguish the presence of a user's finger.

Importantly, measurement of attenuated reflection are used to determine whether infrared light reflected from a surface of a cover glass is absorbed by a finger or reflected by a glass-ambient air interface. In this way, the system is able to measure temporal touches that are then used to infer force.

Other embodiments include IR transmission that moves through vias or passageways beneath the top glass. Alternatively, instead of IR transmitters, Apple proposes the use of OLED layers that can output a "fourth color" in an infrared wavelength. Alternative embodiments include FTIR measurement via ultrasonic and other acoustic signals.




Capacitive touch input components, such as those seen in current iOS devices, can help determine positioning of multiple fingers. This aids the FTIR system by discovering "shadowing" of two or more fingers that could result in erroneous attenuation readings.

Finally, data from both the FTIR and capacitive touchscreen are combined to give an accurate reading of force applied to a device screen. Force values from attenuated reflection are compared against a baseline reading to determine how hard a user is pressing on the display. In addition to force, the system can also help the touch I/O device determine smudges or inadvertent wetting.

It is unclear if Apple intends to use the above FTIR technology in a future iOS device, but the addition of a force-sensing element would open new levels of interaction beyond existing static gestures like "tap" and "hold."

Apple's force-sensing patent application was first filed for in 2012 and credits Martin P. Grunthaner, Peter W. Richards, Romain A. Teil and Steven P. Hotelling as its inventors.
post #2 of 24
... and just like that, another big one in the repertoire.
Keep an eye on Samsung.
post #3 of 24
"In this way, the system is able to measure"... Is this a fill in the blank moment? 😊 Heading over to Patently Apple to get more information.
post #4 of 24

Maybe an expert can clarify this, but how does one reconcile the following two statements in the patent application?


"Perceptive Pixel, owned by Microsoft Corporation of Redmond, Wash., markets a multi-touch sensing device that uses FTIR, and which is said to use a force-sensitive technique."

 

"Each of these examples, as well as other possible considerations, can cause one or more difficulties for the touch device, at least in that inability to determine an amount of force applied by the user when contacting the touch device might cause a GUI or an application program to be unable to provide functions that would be advantageous."

post #5 of 24
Quote:
Originally Posted by AppleSauce007 View Post

... and just like that, another big one in the repertoire.
Keep an eye on Samsung.

They may mention something similar to Design Crisis : Ideas Crisis. :)

post #6 of 24
Quote:
Originally Posted by leavingthebigG View Post

"In this way, the system is able to measure"... Is this a fill in the blank moment? 😊 Heading over to Patently Apple to get more information.

From the description it is really making a time-resolved measurement of contact location and area, from which it will infer relative contact force. Nothing in that technique would permit absolute force measurements.
post #7 of 24
Quote:
Originally Posted by AppleSauce007 View Post

... and just like that, another big one in the repertoire.
Keep an eye on Samsung.

Ahh, yes, the next next big thing.  At this point, Apple may want to "patent" a sensor that detects how forceful a middle finger is projected at them by Samsung.

post #8 of 24
Quote:
Originally Posted by d4NjvRzf View Post
 

Maybe an expert can clarify this, but how does one reconcile the following two statements in the patent application?


"Perceptive Pixel, owned by Microsoft Corporation of Redmond, Wash., markets a multi-touch sensing device that uses FTIR, and which is said to use a force-sensitive technique."

 

"Each of these examples, as well as other possible considerations, can cause one or more difficulties for the touch device, at least in that inability to determine an amount of force applied by the user when contacting the touch device might cause a GUI or an application program to be unable to provide functions that would be advantageous."


Perhaps Microsoft's solution can measure that a force is present but not the magnitude of the force

post #9 of 24
Quote:
Originally Posted by johnnyb0731 View Post


Perhaps Microsoft's solution can measure that a force is present but not the magnitude of the force

I would assume that the harder you press the more skin of your fingertip comes in contact with the screen. It might take a little learning like it does for Touch ID but once you've set the parameters the device will know when it's a light press or a hard one.
Edited by dasanman69 - 4/3/14 at 8:16am
"Few things are harder to put up with than the annoyance of a good example" Mark Twain
"Just because something is deemed the law doesn't make it just" - SolipsismX
Reply
"Few things are harder to put up with than the annoyance of a good example" Mark Twain
"Just because something is deemed the law doesn't make it just" - SolipsismX
Reply
post #10 of 24
Any improvements in this area would be welcome, especially for improving the accuracy of subtle pressure and after-touch information for musical instrument simulation.

Proud AAPL stock owner.

 

GOA

Reply

Proud AAPL stock owner.

 

GOA

Reply
post #11 of 24
The device in the patent drawings looks suspiciously like.... The new iPhone 6! It looks wider than the iPhone 5s. Somebody do some measurements and write an exposé.

"Apple should pull the plug on the iPhone."

John C. Dvorak, 2007
Reply

"Apple should pull the plug on the iPhone."

John C. Dvorak, 2007
Reply
post #12 of 24
Quote:
Originally Posted by Suddenly Newton View Post

The device in the patent drawings looks suspiciously like.... The new iPhone 6! It looks wider than the iPhone 5s. Somebody do some measurements and write an exposé.

Good eye. I was too busy looking at the detection lines, and windows to notice the device.
"Few things are harder to put up with than the annoyance of a good example" Mark Twain
"Just because something is deemed the law doesn't make it just" - SolipsismX
Reply
"Few things are harder to put up with than the annoyance of a good example" Mark Twain
"Just because something is deemed the law doesn't make it just" - SolipsismX
Reply
post #13 of 24

Force-sensitive? Gettin' a bit sci-fi here, aren't we

post #14 of 24
Where would this be useful other than music and drawing?
Yeah, well, you know, that's just, like, my opinion, man.
Reply
Yeah, well, you know, that's just, like, my opinion, man.
Reply
post #15 of 24

Force-sensing for touchscreens is of course not necessarily something new, Motorola f.e. has force-sensing touch technology (which uses a transparent force-sensing layer) but it is always nice to see companies develop new/alternative methods. :)

post #16 of 24

btw: Sapphire is much more transparent to IR than is glass. ;)

post #17 of 24
Quote:
Originally Posted by WonkoTheSane View Post

Where would this be useful other than music and drawing?

It might be generally useful for filtering out false touches (touches that are inadvertent).

post #18 of 24
Quote:
Originally Posted by WonkoTheSane View Post

Where would this be useful other than music and drawing?


Music? I hope you don't mean piano.

post #19 of 24
Quote:
Originally Posted by Cpsro View Post

It might be generally useful for filtering out false touches (touches that are inadvertent).


Ok. Thanks.
Quote:
Originally Posted by Emes View Post


Music? I hope you don't mean piano.


Uhm, I think there are a few people around that use their iPhone/iPad as instrument, including keyboard I suppose. So velocity sensitivity might be welcome
Yeah, well, you know, that's just, like, my opinion, man.
Reply
Yeah, well, you know, that's just, like, my opinion, man.
Reply
post #20 of 24
Quote:
Originally Posted by WonkoTheSane View Post

Uhm, I think there are a few people around that use their iPhone/iPad as instrument, including keyboard I suppose. So velocity sensitivity might be welcome

Not me. It might be good for taking notes or a synthesizer, but try playing the Moonlight Sonata on an iPad and you'll see what I mean

post #21 of 24
Quote:
Originally Posted by Emes View Post

Not me. It might be good for taking notes or a synthesizer, but try playing the Moonlight Sonata on an iPad and you'll see what I mean

I hear you 1smile.gif
Yeah, well, you know, that's just, like, my opinion, man.
Reply
Yeah, well, you know, that's just, like, my opinion, man.
Reply
post #22 of 24
Quote:
Originally Posted by WonkoTheSane View Post

Where would this be useful other than music and drawing?

Well conceptually, if the technology can distinguish/read multiple proximity and a range of touch, between light and heavy - then you have the basis for 3D modelling and direct manipulation by physically reaching Into your data as displayed.
I'm sure artists, engineers, designers of all kinds and cad folk would love it. I sure could use that facility...unless I'm completely over simplifying things.
post #23 of 24
Originally Posted by Emes View Post
try playing the Moonlight Sonata on an iPad and youll see what I mean

 

That’s why we need a 12”.

Originally posted by Marvin

Even if [the 5.5” iPhone exists], it doesn’t deserve to.
Reply

Originally posted by Marvin

Even if [the 5.5” iPhone exists], it doesn’t deserve to.
Reply
post #24 of 24
Quote:
Originally Posted by Tallest Skil View Post
 

 

That’s why we need a 12”.


No, you'd need about a 45"

New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: General Discussion
AppleInsider › Forums › General › General Discussion › Apple new touchscreen tech would use IR light to discern hard presses from soft