Apple exploring motion compensation in mobile screens

***AppleInsider*** · 08-13-2009, 10:01 AM

A new patent application revealed this week suggests that Apple could be working on motion compensation features on highly mobile screens like the iPhone.

Originally filed in February of 2008, the application describes various methods which might make handling a touchscreen device or viewing a mobile screen easier as the device moves about, whether on a moving vehicle or walking about. The document details a number of ways this problem could be solved, including display adjustment using motion data and screen properties, scaling selectable images, varying the input region on a touchscreen device, or including pressure values and location values.

"The instability, whether produced by the environment or the user, may cause user interface challenges," the patent application reads. "For example, a vibrating screen may make it difficult for a user to view images on the screen. Similarly, a moving screen or input object may make it difficult for a user to select an item on a touch screen."

The patent application describes different scenarios in which this technology could be helpful, from typical experiences to highly unique circumstances.

"The screen may be part of a system used in a high vibration environment such as a tank monitoring and control system for a chemical processing plant or a personal entertainment system located within an airplane seat back," the patent reads. "Similarly, the screen may be part of a portable electronic device that is accessed in an unsteady environment such as a subway or moving vehicle. In another example, the screen may be part of a device used by a user with limited or impaired motor control."

The filing is similar to one revealed by AppleInsider earlier this year that described an iPhone-like device with a front-facing video camera with software that would adjust itself while in motion. That application described technology that would detect "signatures of motion," to which the iPhone software would adjust by enlarging areas on the screen making them easier to see and touch.

In another patent filing, Apple describes a method to use a Bluetooth module to process non-Bluetooth signals. The document details how a device might be able to process signals received from a source that uses a different set of data rates, or conversely how a device might be able to transmit similar signals.

It goes on to say that a non-Bluetooth transmitter could potentially send out a non-Bluetooth signal at a data rate a Bluetooth receiver could read.

"A Bluetooth receiver, such as a portable media player or smart phone with Bluetooth circuitry, can receive the non-Bluetooth signals sent at the particular data rate using the Bluetooth circuitry," the document reads. "In one embodiment, the Bluetooth receiver can "over-sample" the signal or transmission of the non-Bluetooth packet sent at the particular data rate using one or more data rates associated with the Bluetooth circuitry."

Finally, another patent application revealed this week demonstrates a method to transform one complex programming language into another automatically. The document notes that techniques for bridging data between different programming languages currently exist, however, they do not provide functionality for converting more complex data into a different language.

"For example, a linked list object defined in a first programming language often has no direct transformation to a corresponding list data structure supported by a second programming language," the application states. "Thus, an improved technique for transforming data structures between programming languages or systems is needed."

[ View this article at AppleInsider.com ]

Quadra 610 · 08-13-2009, 10:11 AM

Apple: Skating to where the puck WILL be.

ulfoaf · 08-13-2009, 10:28 AM

To keep the screen coordinated with your eye, you'd have to wear a sensor on your head. If in your hand, it could still move relative to your eye if bouncing. But maybe that will be up to the guy holding it. :>)

I won't hold my breath on this one.

jcsegenmd · 08-13-2009, 10:33 AM

What I don't get is why Apple doesn't snap up Universal Display corporation. They they have 950 patents (!) for next-gen LED/OLED displays, which is one-half of what a computer is. If Apple ponied up $278 million for PA semi to buy their brains, then the $400-$500 million to own a large chunk of the licensable displays into the future would seem a brilliant idea--that way they could keep the best for Apple and get licensing fees for OLED that don't fit in their product mix

Are you listening SJ?

pixelcruncher · 08-13-2009, 11:16 AM

I think this is very unlikely to be implemented on the standard iPhone interface. Your head and hands are all moving independently, there's no way the iPhone can help sync up what your left hand and right hand and eyes are all doing to make a button push more accurate. In fact, your brain and body are already compensating to some degree, and having a "floating interface" would probably throw your brain off more than help. I'm not sure if it would help when reading, but the fact that words might disappear off the edges while the screen "floats" might be very annoying. This seems more like a fun little iPhone app that you turn on to amuse friends.

Wiggin · 08-13-2009, 11:17 AM

Quote:

Originally Posted by ulfoaf

To keep the screen coordinated with your eye, you'd have to wear a sensor on your head. If in your hand, it could still move relative to your eye if bouncing. But maybe that will be up to the guy holding it. :>)

I won't hold my breath on this one.

Yeah, it would be an interesting dynamics problem. Know how the display is moving is one thing, but predicting how the observer is moving due to the same inputs is a whole other problem.

A few cameras you digital image stabilization, which would be similar to stabilizing a display image; but most use physical stabilization of either the lens elements or the sensor itself because it's more effective due to the shorter feedback loop.

I could however see this being useful in high vibration environments where the vibrations are constant and predictable and the device is mounted on something. In that case it would be a similar problem as noise cancellation headphones, which are good at damping constant background noise (like when flying) but which allow more transient noises (talking) to be easily heard.

Uriah Heep · 08-13-2009, 11:29 AM

This patent another confirmation for Apple soon will present tablet computer FOR CAR !!!

Apple's "tablet" computer will use (as an external separate unit) iPhone resources for in/out communication and media translation.
The Tablet itself will be aimed for use in cars (mostly, but not only) as a center of car equipment digital integration (USB/BT/...),
screen+touch+voice interaction for control and GSM/EDGE/3G (via iPhone) + WiMax (4G, internal tablet unit) communication during the car driving.
Placing and using Apple's computer in a car as an information & communication center for driver - "killing" idea of Apple's tablet targeting.
Multitasking (even multi-screen, if for passengers), short OS, Apple's software, new SDK for mutual apps (tablet+iPhone), touchscreen+voice interaction software, upgrades - via AppStore.

Besides or without iPhone, Tablet itself will use 4G (WiMax) for network communication via Verizon (starting 2010), and can be used like small individual computer with touch screen.
One can use only iPhone, add tablet to iPhone, bye iPhone & tablet.
For Apple - no risk of its MacBooks and iPhones substitution by the tablet in the market.
May be, first attempt of Apple OS licensing if tablet in car base mounting.
Again Apple (thinking different) will open new market and new business on the base of previous success and technologies to be the first and No 1 in it.
Full articles:
http://www.deepapple.com/articles/25345.html , and http://www.deepapple.com/news/34814.html , in russian.

See my posts in forum

cmf2 · 08-13-2009, 12:00 PM

Quote:

Originally Posted by Uriah Heep

This patent another confirmation for Apple soon will present tablet computer FOR CAR !!!

Apple's "tablet" computer will use (as an external separate unit) iPhone resources for in/out communication and media translation.
The Tablet itself will be aimed for use in cars (mostly, but not only) as a center of car equipment digital integration (USB/BT/...),
screen+touch+voice interaction for control and GSM/EDGE/3G (via iPhone) + WiMax (4G, internal tablet unit) communication during the car driving.
Placing and using Apple's computer in a car as an information & communication center for driver - "killing" idea of Apple's tablet targeting.
Multitasking (even multi-screen, if for passengers), short OS, Apple's software, new SDK for mutual apps (tablet+iPhone), touchscreen+voice interaction software, upgrades - via AppStore.

Besides or without iPhone, Tablet itself will use 4G (WiMax) for network communication via Verizon (starting 2010), and can be used like small individual computer with touch screen.
One can use only iPhone, add tablet to iPhone, bye iPhone & tablet.
For Apple - no risk of its MacBooks and iPhones substitution by the tablet in the market.
May be, first attempt of Apple OS licensing if tablet in car base mounting.
Again Apple (thinking different) will open new market and new business on the base of previous success and technologies to be the first and No 1 in it.
Full articles:
http://www.deepapple.com/articles/25345.html , and http://www.deepapple.com/news/34814.html , in russian.

See my posts in forum

While I agree that a tablet could be very useful in a car and I've even wondered if Apple has ever thought about making a deal with car makers to a have a tablet pre-installed, I don't think the primary use will be marketed for the car. It is too limited of a market, not many people are going to drop $700-$800 to put a 10" touchscreen in their car, even if it can be removed and do other stuff. At most, in car use will be marketed as one of many features.

Trajectory · 08-13-2009, 03:24 PM

Quote:

Originally Posted by cmf2

While I agree that a tablet could be very useful in a car and I've even wondered if Apple has ever thought about making a deal with car makers to a have a tablet pre-installed, I don't think the primary use will be marketed for the car. It is too limited of a market, not many people are going to drop $700-$800 to put a 10" touchscreen in their car, even if it can be removed and do other stuff. At most, in car use will be marketed as one of many features.

If the Tablet can also provide GPS navigation, then the price is not out of line with top-notch devices that only do GPS, so, this could be a lucrative market for Apple and the tablet device.

retroneo · 08-13-2009, 08:31 PM

Must be how they got Nike+ which uses ANT to work with a Bluetooth receiver.

McDave · 08-13-2009, 09:19 PM

Quote:

Originally Posted by Uriah Heep

This patent another confirmation for Apple soon will present tablet computer FOR CAR !!!

Apple's "tablet" computer will use (as an external separate unit) iPhone resources for in/out communication and media translation.
The Tablet itself will be aimed for use in cars (mostly, but not only) as a center of car equipment digital integration (USB/BT/...),
screen+touch+voice interaction for control and GSM/EDGE/3G (via iPhone) + WiMax (4G, internal tablet unit) communication during the car driving.
Placing and using Apple's computer in a car as an information & communication center for driver - "killing" idea of Apple's tablet targeting.
Multitasking (even multi-screen, if for passengers), short OS, Apple's software, new SDK for mutual apps (tablet+iPhone), touchscreen+voice interaction software, upgrades - via AppStore.

Besides or without iPhone, Tablet itself will use 4G (WiMax) for network communication via Verizon (starting 2010), and can be used like small individual computer with touch screen.
One can use only iPhone, add tablet to iPhone, bye iPhone & tablet.
For Apple - no risk of its MacBooks and iPhones substitution by the tablet in the market.

May be, first attempt of Apple OS licensing if tablet in car base mounting.
Again Apple (thinking different) will open new market and new business on the base of previous success and technologies to be the first and No 1 in it.
Full articles:
http://www.deepapple.com/articles/25345.html , and http://www.deepapple.com/news/34814.html , in russian.

See my posts in forum

Not car, too expensive. Plane

McDave · 08-13-2009, 09:22 PM

Quote:

Originally Posted by pixelcruncher

I think this is very unlikely to be implemented on the standard iPhone interface. Your head and hands are all moving independently, there's no way the iPhone can help sync up what your left hand and right hand and eyes are all doing to make a button push more accurate. In fact, your brain and body are already compensating to some degree, and having a "floating interface" would probably throw your brain off more than help. I'm not sure if it would help when reading, but the fact that words might disappear off the edges while the screen "floats" might be very annoying. This seems more like a fun little iPhone app that you turn on to amuse friends.

Only if it was on all the time. If it activated when your finger was an inch away that would be useful.

McD

pixelcruncher · 08-14-2009, 01:12 AM

Quote:

Originally Posted by McDave

Only if it was on all the time. If it activated when your finger was an inch away that would be useful.

McD

So you think that when your finger is an inch away, the target started moving around, that would be a good thing?

SGSStateStudent · 08-14-2009, 02:06 AM

Quote:

Originally Posted by pixelcruncher

So you think that when your finger is an inch away, the target started moving around, that would be a good thing?

I'd say Apple should come up with something better for the iPhone. I really want bluetooth transfer for other files like music and pictures..

McDave · 08-17-2009, 04:58 AM

Quote:

Originally Posted by pixelcruncher

So you think that when your finger is an inch away, the target started moving around, that would be a good thing?

If the motion sensors picked up a lot of vibration then yes, why not? The screen would only appear to be tracking your finger.

McD

08-13-2009, 10:01 AM	#1
*AppleInsider* Kasper's Automated Slave Join Date: Nov 1997 Posts: 6,159	Apple exploring motion compensation in mobile screens A new patent application revealed this week suggests that Apple could be working on motion compensation features on highly mobile screens like the iPhone. Originally filed in February of 2008, the application describes various methods which might make handling a touchscreen device or viewing a mobile screen easier as the device moves about, whether on a moving vehicle or walking about. The document details a number of ways this problem could be solved, including display adjustment using motion data and screen properties, scaling selectable images, varying the input region on a touchscreen device, or including pressure values and location values. "The instability, whether produced by the environment or the user, may cause user interface challenges," the patent application reads. "For example, a vibrating screen may make it difficult for a user to view images on the screen. Similarly, a moving screen or input object may make it difficult for a user to select an item on a touch screen." The patent application describes different scenarios in which this technology could be helpful, from typical experiences to highly unique circumstances. "The screen may be part of a system used in a high vibration environment such as a tank monitoring and control system for a chemical processing plant or a personal entertainment system located within an airplane seat back," the patent reads. "Similarly, the screen may be part of a portable electronic device that is accessed in an unsteady environment such as a subway or moving vehicle. In another example, the screen may be part of a device used by a user with limited or impaired motor control." The filing is similar to one revealed by AppleInsider earlier this year that described an iPhone-like device with a front-facing video camera with software that would adjust itself while in motion. That application described technology that would detect "signatures of motion," to which the iPhone software would adjust by enlarging areas on the screen making them easier to see and touch. In another patent filing, Apple describes a method to use a Bluetooth module to process non-Bluetooth signals. The document details how a device might be able to process signals received from a source that uses a different set of data rates, or conversely how a device might be able to transmit similar signals. It goes on to say that a non-Bluetooth transmitter could potentially send out a non-Bluetooth signal at a data rate a Bluetooth receiver could read. "A Bluetooth receiver, such as a portable media player or smart phone with Bluetooth circuitry, can receive the non-Bluetooth signals sent at the particular data rate using the Bluetooth circuitry," the document reads. "In one embodiment, the Bluetooth receiver can "over-sample" the signal or transmission of the non-Bluetooth packet sent at the particular data rate using one or more data rates associated with the Bluetooth circuitry." Finally, another patent application revealed this week demonstrates a method to transform one complex programming language into another automatically. The document notes that techniques for bridging data between different programming languages currently exist, however, they do not provide functionality for converting more complex data into a different language. "For example, a linked list object defined in a first programming language often has no direct transformation to a corresponding list data structure supported by a second programming language," the application states. "Thus, an improved technique for transforming data structures between programming languages or systems is needed." [ View this article at AppleInsider.com ]

08-13-2009, 10:11 AM	#2
Quadra 610 Registered User Join Date: Nov 2008 Posts: 2,072	Apple: Skating to where the puck WILL be. (Formerly LTD on Neowin.net) (currently *LTD* on Macrumors.com) Mac OS users have made a conscious technology choice and are therefore typically better informed than their peers. -- Paul Thurrott, winsupersite.com, December 06, 2004

08-13-2009, 10:28 AM	#3
ulfoaf Registered User Join Date: Mar 2009 Location: Texas Posts: 104	unlikely To keep the screen coordinated with your eye, you'd have to wear a sensor on your head. If in your hand, it could still move relative to your eye if bouncing. But maybe that will be up to the guy holding it. :>) I won't hold my breath on this one.

08-13-2009, 10:33 AM	#4
jcsegenmd Registered User Join Date: Jun 2008 Posts: 30	Panl What I don't get is why Apple doesn't snap up Universal Display corporation. They they have 950 patents (!) for next-gen LED/OLED displays, which is one-half of what a computer is. If Apple ponied up $278 million for PA semi to buy their brains, then the $400-$500 million to own a large chunk of the licensable displays into the future would seem a brilliant idea--that way they could keep the best for Apple and get licensing fees for OLED that don't fit in their product mix Are you listening SJ?

08-13-2009, 11:29 AM	#7
Uriah Heep Registered User Join Date: Apr 2009 Location: Moscow Posts: 5	Apple tablet + iPone for car This patent another confirmation for Apple soon will present tablet computer FOR CAR !!! Apple's "tablet" computer will use (as an external separate unit) iPhone resources for in/out communication and media translation. The Tablet itself will be aimed for use in cars (mostly, but not only) as a center of car equipment digital integration (USB/BT/...), screen+touch+voice interaction for control and GSM/EDGE/3G (via iPhone) + WiMax (4G, internal tablet unit) communication during the car driving. Placing and using Apple's computer in a car as an information & communication center for driver - "killing" idea of Apple's tablet targeting. Multitasking (even multi-screen, if for passengers), short OS, Apple's software, new SDK for mutual apps (tablet+iPhone), touchscreen+voice interaction software, upgrades - via AppStore. Besides or without iPhone, Tablet itself will use 4G (WiMax) for network communication via Verizon (starting 2010), and can be used like small individual computer with touch screen. One can use only iPhone, add tablet to iPhone, bye iPhone & tablet. For Apple - no risk of its MacBooks and iPhones substitution by the tablet in the market. May be, first attempt of Apple OS licensing if tablet in car base mounting. Again Apple (thinking different) will open new market and new business on the base of previous success and technologies to be the first and No 1 in it. Full articles: http://www.deepapple.com/articles/25345.html , and http://www.deepapple.com/news/34814.html , in russian. See my posts in forum

08-13-2009, 11:16 AM	#5
pixelcruncher Registered User Join Date: Jun 2005 Posts: 119	I think this is very unlikely to be implemented on the standard iPhone interface. Your head and hands are all moving independently, there's no way the iPhone can help sync up what your left hand and right hand and eyes are all doing to make a button push more accurate. In fact, your brain and body are already compensating to some degree, and having a "floating interface" would probably throw your brain off more than help. I'm not sure if it would help when reading, but the fact that words might disappear off the edges while the screen "floats" might be very annoying. This seems more like a fun little iPhone app that you turn on to amuse friends.

08-13-2009, 08:31 PM	#10
retroneo Registered User Join Date: Dec 2001 Posts: 205	Must be how they got Nike+ which uses ANT to work with a Bluetooth receiver.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode