Apple filing details safe touch-screen navigation system

[AppleInsider]

An interesting but at times erratic patent filing from Apple published for the first time this week describes a proprietary in-car navigation system focused on maintaining driver safety while a vehicle is in motion.

The 11-page filing starts off by noting that the use of a conventional navigation system in a moving vehicle often raises safety concerns, particularly if the driver of the vehicle is attempting to operate the navigation system while simultaneously operating the vehicle.

"Many navigation systems use knobs and pushbuttons for entering destination and other information for use in determining driving directions," Apple says. "The accurate use of such input devices may force the driver to take her eyes off the road, resulting in a potentially hazardous condition."

The company goes on to explain that conventional solutions to this safety problem detect when the navigation system is being operated while the vehicle is moving and display a warning message notifying the user that operating the navigation system while the vehicle is moving is dangerous.

"Some conventional solutions may request that the user acknowledge the warning by pressing a pushbutton, for example. Once acknowledged, the navigation system typically becomes operable to the driver," the filing says. "Also, there are few safety concerns with a passenger in the vehicle operating the navigation system while the vehicle is moving. For passengers, the warnings may be unnecessary or irritating, and locking down the operation of the navigation system would prevent the passenger from operating the navigation system regardless of whether it was safe to do so."

Apple's solution to the problem calls for a smarter touchscreen-based navigation system that may be either a self-mounted handheld device like an iPhone or one that's hardwired into the car. Either could tie into various forms of sensors and I/O devices such as a speaker and a microphone to facilitate voice-enabled functionalities, such as navigation, stereo, and phone functions. A loud speaker could also be included to facilitate hands-free voice command functionalities, such as voice activated entry for requesting driving directions.

However, the heart of the filing is focused on assuring that drivers don't distract themselves while driving by fidgeting with the touch-screen. It details numerous methods of locking down the system while a vehicle is in motion, or, alternatively, authorizing only the front seat passenger to control the system.



For instance, the navigation system could determine if the vehicle is moving at the time of input or whether the vehicle is in gear or in park. The system could also be communicatively coupled (wired or wirelessly) to particular sensors in the vehicle, such as tire sensors, engine sensors, steering sensors, or GPS sensors. If the vehicle is determined to be in motion, the navigation system would enter into a lockdown mode where touch-based input would be disallowed, assuming a passenger is not present.

Simultaneously, however, other sensors could be at work to determine whether a passenger is also present in the moving vehicle, such as seat belt sensors, infrared sensor (to detect body head), proximity sensors or seat sensors (to detect the presence of a payload). If any of these sensors indicate a passenger may be present, the system could further scrutinized the situation by attempting to determine the angle of any ensuing touch input provided on the touch-sensitive display (e.g., angle of the user's finger at the touch point relative to a predefined reference frame). In these cases, a passenger may be able to operate the navigation system while the driver maintains focus on the road.

"The angle detection can provide the navigation device with the functionality to determine whether a driver or passenger is operating the navigation system," Apple says. "As such, the combination of any or all of a seat sensor, seat belt sensor, angle detection, or other sensors can determine which user provided input to system."



The Cupertino-based company goes on to explain that in some implementations, a biometric sensor can be included in navigation system to determine intrinsic physical traits of a user:

For example, the biometric sensor may be a fingerprint sensor, voice recognition sensor, iris recognition, or other sensor used to recognize a user identity. The recognizing factors can be stored in navigation device where the factors can be used to configure usability information for users of system. For example, a fingerprint can be stored for a vehicle owner which can be configured to enable use of navigation system at all times without limitation. At some point, the vehicle owner may store biometric information about other drivers in the family and place restrictions on the users. The restrictions can include operating navigation system functions related to entering new destinations, for example, when the restricted user is a passenger, but not a driver. As such, the restricted user may input data into the navigation system in the passenger seat, but may not input extensive data into the system 102 when in the driver's seat. Thus, the restrictions may protect the safety of the driver and the passenger by restricting any operation that may avert the driver's attention away from the road.

Control of the navigation system by drivers could also be determined by preference settings that could in some cases override the safety measures:

In some implementations, an override can be pre-configured for one or more drivers. For example, a more experienced driver may configure the system 102 to allow one or more drivers to interact with the navigation system 102 while the vehicle is in motion. Similarly, the configuration can preclude inexperienced drivers from providing input to the navigation system while the vehicle is in motion. The configuration can include identification of the driver using biometric sensors (e.g., fingerprint, digital camera recognition, hand geometry, voice recognition, etc.), mobile phone identifier (e.g., Bluetooth.TM., service provider, etc.). In some implementations, the navigation system 102 can use biometric input to determine whether a driver can legally operate the navigation system 102 and/or vehicle. For example, upon receiving a fingerprint input, the system 102 can search the department of motor vehicles for validation on the user's driving record or license and adjust the available navigation system functionality accordingly.

Oddly, the patent filing at times veers off course with abrupt mentions of locking out "functions such as text messaging, mobile device, browsing, and such, based on biometrics, vehicle movement, proximity, and the like." It also randomly notes that "a digital camera can be included on navigation device to capture snapshots of maps, points of interest, directions, and the like. In one example, if the navigation device is removable, the digital camera can perform standard camera functions, such as recording photographs and video clips."

More relevant side notes mention the inclusion of one or more wireless communication subsystems, such as an 802.11b/g, Bluetooth, CDMA, GSM and EDGE. Apple says these subsystems could allow the navigation system to pair with an iPhone and receive driving itinerary that may have been prepared on the handset before entering the vehicle.

[ View this article at AppleInsider.com ]

[Abster2core]

Originally Posted by AppleInsider

An interesting but at times erratic patent filing from Apple published for the first time this week describes a proprietary in-car navigation system focused on maintaining driver safety while a vehicle is in motion.

What do you mean by, "…erratic patent filing…?"

Re Patent Filing: 20090082951

[backtomac]

Seems like a couple of years ago Apple was rumored to be working on a NAV system for Mercedes Benz. I hope this comes to fruition.

This is one area where I would think Apple would excel.

[Johnny Mozzarella]

While Steve has been recuperating, his half-brother Homer Jobs has been designing the car of the future from the "working-man's perspective".

[Ireland]

I agree with all humans.

[talkshowonmute]

I think by erratic he means retarded.. I would have to agree. I dont want my in car nav to make me press an additional button to let me know its unsafe to use it as im driving. I would love to see this product come to life though just to see what road apple decides to take with the UI

[anantksundaram]

As a shareholder, I would prefer that Apple stay away from commercializing this kind of technology, and rather that they license it to someone else do it (with consequent IP revenue).

The reason? I can see some moron ending up in an accident, and suing the heck out of Apple because its claim to 'safe' turned out not to be the case.......

[malax]

Originally Posted by talkshowonmute

I think by erratic he means retarded.. I would have to agree. I dont want my in car nav to make me press an additional button to let me know its unsafe to use it as im driving. I would love to see this product come to life though just to see what road apple decides to take with the UI

My Garmins already do exactly what you're objecting to. The patents points to that "click here to confirm that it's stupid to use this while driving" approach as pretty lame.

[Abster2core]

Originally Posted by talkshowonmute

I think by erratic he means retarded.. I would have to agree. I dont want my in car nav to make me press an additional button to let me know its unsafe to use it as im driving. I would love to see this product come to life though just to see what road apple decides to take with the UI

Have you read the patent filing"

Do you have any idea of what product liability entails? And what it costs to insure products?

[ncee]

Man, these folks just don't get it!

I guess I'll just wait until they come out with this stuff, and then sue them … because I came up with this first!

Hell, even if I didn't, this has got to be good for a few quick bucks.


Skip

[Shookster]

It seems a rather elaborate approach to a simple problem. Drivers know they should not fiddle with electronic devices while driving - if they don't know this, they should not be on the road.

I was hoping there would be a new idea for using the device without having to look at it - this seems to just be a solution for not using it.

[soundsgoodtome]

Originally Posted by talkshowonmute

I think by erratic he means retarded.. I would have to agree. I dont want my in car nav to make me press an additional button to let me know its unsafe to use it as im driving. I would love to see this product come to life though just to see what road apple decides to take with the UI

i wonder if you read the article. the word "erratic" was used to describe the patent filing, but the button-pressing you don't want is part of features that apple was saying were poorly thought out. yet, in your reply, you seem to think that apple is advocating the button-pressing, which is not the case.

[soundsgoodtome]

Originally Posted by backtomac

Seems like a couple of years ago Apple was rumored to be working on a NAV system for Mercedes Benz. I hope this comes to fruition.

This is one area where I would think Apple would excel.

you're correct. i came here to mention it, but you beat me to it. :-)

specifically, the article i read said mercedes had asked apple to design a nav system for them. apple had agreed to do so, but the deal was that the system would only be exclusive to mercedes for 6 months. after that, apple would be free to sell the system to other automakers or to use it in their own product(s).

since apple already has a relationship with bmw, it was assumed that bmw might be among the first to follow mercedes. that was exciting to me, as i don't like benzes. :-)

[Celemourn]

Introducing the new Apple iMlost!

C

[quinney]

Originally Posted by talkshowonmute

I think by erratic he means retarded.. I would have to agree. I dont want my in car nav to make me press an additional button to let me know its unsafe to use it as im driving. I would love to see this product come to life though just to see what road apple decides to take with the UI

heh heh .... you said "road apple" ..... heh heh

[Panolo]

This will be a very unpopular product. Right now we have many things that could cause distractions to a driver. Entertainment products, Business or personal communication systems (CB, Ham Radio, APRS etc} all pose a potential for a distraction. Even the police cars have a whole dashboard of electronics to take their eyes from the road.

In the 1970s the auto manufacturers were forced to produce vehicles that would not operate or would sound an obnoxious alarm until the seat belt was fastened. Most people chose to circumvent the system. Even now, with wearing of seat belts mandatory in most states, it is amazing the degree of non-compliance.

In the fever to reduce the accidents attributed to increase in cell phone use we are in danger of over reacting by trying to force driver safety through legislation and/or technology. The only solution is driver education. Even then we will still lose the occasional soccer mom or teen texter.

[teslacoil6603]

I can measure in nanoseconds how long it would take for a system like that to be stolen out of my car. LOL

[mdriftmeyer]

Originally Posted by backtomac

Seems like a couple of years ago Apple was rumored to be working on a NAV system for Mercedes Benz. I hope this comes to fruition.

This is one area where I would think Apple would excel.

Imagine your iPhone docking into your "Garminish/XM Radio/DVD" console touch screen/voice command controlled system that allows one to use the phone to call people, speak hands free in the car with your audio down to ambient noise while talking and then upon hang up slowly raise up to prior levels.

I'd like to be able to jack in the phone, audibly command it to call a certain number, have my conversation and then disconnect all without needing a bluetooth head set with the system having sensitive embedded microphone nearby to make sure the conversation is clean.

I'd like to be able to pull that face off and put it away in a case [dvd front face] and when I'm on the go just use my iphone as normal.

[iVlad]

About time. Just wait till they publish all the patents. Apple can take over biggest market in the world.

[hillstones]

Originally Posted by Panolo

This will be a very unpopular product. Right now we have many things that could cause distractions to a driver. Entertainment products, Business or personal communication systems (CB, Ham Radio, APRS etc} all pose a potential for a distraction. Even the police cars have a whole dashboard of electronics to take their eyes from the road.

In the 1970s the auto manufacturers were forced to produce vehicles that would not operate or would sound an obnoxious alarm until the seat belt was fastened. Most people chose to circumvent the system. Even now, with wearing of seat belts mandatory in most states, it is amazing the degree of non-compliance.

In the fever to reduce the accidents attributed to increase in cell phone use we are in danger of over reacting by trying to force driver safety through legislation and/or technology. The only solution is driver education. Even then we will still lose the occasional soccer mom or teen texter.

CB and Ham Radios? What century are you living in? I guess you have never owned a vehicle with OEM navigation. There is a message that must be cleared every time you start the vehicle advising you that entering destination information while driving is not safe or recommended. Some systems even disable entering info while driving. I never change info in my Nav system while driving. The patent probably refers to a Nav system for OEM's, not a third-party Apple add-on product for a vehicle. The degree of non-compliance has nothing to do with the features of a car, it has to do with stupid people (your reference towards seat belts). There has never been a vehicle that would not operate if a seat belt was not fastened.

[blimp]

How many cars now come with full iPod/iPhone/MP3 support? - I'm guessing a majority. Surely that's gotta be a huge opportunity to leverage some form of iPhone navigation straight into the mix?

[groverat]

I would (stupidly) pay a nice chunk of change for a system mdriftmeyer just described.

[marzetta7]

I think a system like this would be fantastic. I look forward to seeing if it ever comes to market. However, I hope they don't limit this only to BMW and Mercedes. I think this would be a mistake and would lead to copy cat vendors stealing marketshare from Apple right off the bat.

[junglemaster]

that sounds like a cool idea...