Future iPhones could anticipate user needs with 'situational awareness module'

Posted:
in General Discussion edited January 2014
A system outlined in an Apple patent on Tuesday takes data from a number of sensors deployed throughout a handheld device and feeds the information into a "situational awareness module," which then triggers a number of functions, including vibration settings, music playback and sleep mode.

Flowchart
Source: USPTO


Apple's U.S. Patent No. 8,385,039 for "Electronic device with automatic mode switching" joins a variety of existing and pending properties related to sensor management to create a highly automated system that can "anticipate" a user's needs.

By using temperature, force, ambient lighting, vibration, pressure and a multitude of other sensors, Apple's "intuitive portable electronic device" can predict what function a user is likely to perform next. For example, the device can change be awoken from sleep mode based on ambient light and orientation information without input from the user. This provides for a heightened user experience.

Auto Hold
Illustration of the patent's original implementation as it applied to a concept iPod hold button.


From the patent's description:
The portable electronic device is therefore ready to perform a user function when the user desires to perform the function. The user does not have to perform additional steps such as selecting menu options in a GUI or activating a button or switch.
While the patent language and illustrations point to a portable media player, specifically the click wheel iPod, modifications have been made to the property's language to include cellular handsets like Apple's iPhone. Such products are mentioned in relation to how a user handles a device, for example two-handed use when texting or one-handed when placing a call.

In operation, the collected sensor data is run through a "situational awareness module" that interprets the signals by applying them to so-called "truth tables." These tables are used to map particular sensor events to functions, such as those gathered when a user adjusts volume levels, which then serve as "examples" of how a set of inputs should be handled in the future. The system can be directly customizable, allowing the user to set sensor parameters and what functions they trigger.

Sensor Table
Illustration of sensor truth table.


The patent covers a litany of implementations, including playing songs based on how a user takes the device out of their pants, switching between ring and vibrate modes based on ambient light and adjusting volume based on ambient noise.

The patent was first filed for in 2011 and credits Fletcher R. Rothkopf as its inventor.

Comments

  • Reply 1 of 13


    HAL: I am putting myself to the fullest possible use, which is all I think that any conscious entity can ever hope to do.


     


     


    (2001 Space Odyssey)

  • Reply 2 of 13
    solipsismxsolipsismx Posts: 19,566member
    Sweet! This is more complex than my concept of having certain phone services enable disable if ou are at home or not and if ou are using our iMac. For instance, if your iPhone is on our home WiFi and you are activeky using user account on your Mac with iMessage connected your phone will mot make an audible sound when ou get an iMessage. This is just one example. I'm just sick of having so many devices go off which means I need mute or unmute them all manually when I enter or leave home.

    Going along with the other patents article I'd like for a wearable computer to give a warning if the pairing is severed because the distance is too far. Of course, when at home on WiFi this will be auto-disabled so I can trae, through the home. But in public this could be the difference between having to buy a new Phone or iPad, like if it's left in a cab.
  • Reply 3 of 13
    antkm1antkm1 Posts: 1,441member

    Quote:

    Originally Posted by SolipsismX View Post



    Sweet! This is more complex than my concept of having certain phone services enable disable if ou are at home or not and if ou are using our iMac. For instance, if your iPhone is on our home WiFi and you are activeky using user account on your Mac with iMessage connected your phone will mot make an audible sound when ou get an iMessage. This is just one example. I'm just sick of having so many devices go off which means I need mute or unmute them all manually when I enter or leave home.



    Going along with the other patents article I'd like for a wearable computer to give a warning if the pairing is severed because the distance is too far. Of course, when at home on WiFi this will be auto-disabled so I can trae, through the home. But in public this could be the difference between having to buy a new Phone or iPad, like if it's left in a cab.


    yes, the iMessage example is the best one.  I'd been talking with a friend about this almost a year ago.  Why should every iDevice you own go off instantaneously when you receive an iMessage?  the service should know which device you are actively using and push the message to that device normally and silent on the others.  Speaking of iMessage, the Mac version could use some serious syncing fixing.  If i'm actively in a string of messages with people on one device and I go to my Mac hours later, the string is all jumbled and half the conversation is spilt and garbled up, timing of messages is all out of sync too.  It's really annoying to see how poorly the Mac Message client sync up.  At my last 1-1 session I asked the "Genius" about it and he just shrugged it off and said it annoys him too.  Some "Genius", huh?


     


    speaking of iDevice specific activity, I'd really wish they would do something about Podcast syncing.  It never seems to sync properly between the Mac and my iDevices.  If i'm listening to a podcast on my phone/iPad...it should sync the listening position over iCloud and back to my Mac, but it most certainly doesn't.  It is getting better, it does now finally recognize which podcasts are the most recent and syncs the recent ones, but it could use a LOT of work.  I'm probably preaching to the choir here though.  It just doesn't seem like Podcasts are a big concern to Apple's iTunes team.

  • Reply 4 of 13
    antkm1antkm1 Posts: 1,441member

    Quote:

    Originally Posted by AppleInsider View Post




    Sensor Table

    Illustration of sensor truth table.



     


    what strikes me as odd about this image is that they think we care if it's enabled or disabled.  A lot of things like this example in iOS seem overly complicated.  Why should I care if it's on or off?  the whole purpose of this implementation seems to be more of an Automatic function rather than a toggle.  I just want iOS to know which device i'm currently using and push verbal/physical notifications to that device.  If none of my iDevices have been active longer than 30-60 minutes, push the notification to all devices as before.  I don't want to have to configure it.  Just make it happen!

  • Reply 5 of 13
    solipsismxsolipsismx Posts: 19,566member
    antkm1 wrote: »
    Speaking of iMessage, the Mac version could use some serious syncing fixing.  If i'm actively in a string of messages with people on one device and I go to my Mac hours later, the string is all jumbled and half the conversation is spilt and garbled up, timing of messages is all out of sync too.  It's really annoying to see how poorly the Mac Message client sync up.  At my last 1-1 session I asked the "Genius" about it and he just shrugged it off and said it annoys him too.  Some "Genius", huh?

    The syncing issue I can live with because I can still follow the conversation and if worse comes to worse it's fine on my iPad and IPhone, but what I can't stand is that if I send a formatted hyperlink* to someone they can open it fine on their Mac's iMessage but on iOS-based devices iMessage just shows it as plain text of the formatting title.

    Since it gets received fine by other Macs it's transversing the iMessages servers fine but iOS is being able to understand the formatting used, even though you can send and receive such links perfectly fine via iMessage in iOS… and they are received fine to a Mac with iMessage. I just don't get why this would happen at all.



    * In case I didn't explain it well enough, by formatted hyperlink I mean something like this: Future iPhones could anticipate user needs with 'situational awareness module' as opposed to just sending this (http://appleinsider.com/articles/13/02/26/future-iphones-could-anticipate-user-needs-with-situational-awareness-module) even though they open the same page.
  • Reply 6 of 13
    gazoobeegazoobee Posts: 3,754member


    Not to ruin the futurist party but these things rarely, if ever work even a tiny bit.  It's a pipe dream designers have been chasing for many decades at the very least.  


     


    People always think that it's going to be like on Star Trek where the computer knows what you want and anticipates your needs, but even the greatest attempts at producing Artificial Intelligence on that level have so far failed over and over again.  To think that a computer is able to anticipate your needs in this way is a gross fallacy.  It just isn't possible yet.  


     


    Essentially, this would be like hiring a personal assistant, but one that is far dumber than you are and has faulty perception as well.  What are the odds that this "dumber and not as observant as you" assistant will actually be a help and not a hinderance?  


     


    Programming functions in yourself is always going to be hundreds of times more efficient and useful than this will ever be.  

  • Reply 7 of 13
    solipsismxsolipsismx Posts: 19,566member
    gazoobee wrote: »
    Not to ruin the futurist party but these things rarely, if ever work even a tiny bit.  It's a pipe dream designers have been chasing for many decades at the very least.  

    People always think that it's going to be like on Star Trek where the computer knows what you want and anticipates your needs, but even the greatest attempts at producing Artificial Intelligence on that level have so far failed over and over again.  To think that a computer is able to anticipate your needs in this way is a gross fallacy.  It just isn't possible yet.  

    Essentially, this would be like hiring a personal assistant, but one that is far dumber than you are and has faulty perception as well.  What are the odds that this "dumber and not as observant as you" assistant will actually be a help and not a hinderance?  

    Programming functions in yourself is always going to be hundreds of times more efficient and useful than this will ever be.  

    1) A lot can be said about the iPhone when the previous lot of smartphones were for hardcore business or hardcore nerds, and werren't good casual computing devices.

    2) Look at Nest Thermostat (and other learning thermostats). They interact with the environment very well. You can say it's a more rudimentary interaction or some other way to disassociate from a handheld type — and I'd agree, to an extent — but the bottom line is that this is the trend. Not being good yesterday on a smartphone does not mean it won't be good tomorrow.

    3) As mentioned above my antkm1 and me, something as simple as Apple's products know when the owner is engaging in one not to annoy you with the others is pretty simple. With Phoo Stream, iMessage, Push Notifications, Notes, Reminders, iMessages, Find my Apple Device*, Safari Reader, and iCloud Tabs, and iTunes Match, these devices are already talking to each other all the time through Apple. I see no reason for a silent, specially coded Push Notification to tell my iPhone not to send audible, haptic or locks screen notifications when I'm logged into my Mac (i.e.: not locked), for example. You can even the phone OS only limit this to when the iPhone and Mac are on the same WiFi, which allows you to have your iPhone in your pocket whilst using your MBA at a coffee shop, for example.




    * That might not be the best name but I'd rather have that over Find my IPhone.
  • Reply 8 of 13
    I can imagine something simpler but perhaps more useful. Users carry a Bluetooth signaling device with a long battery life. When they walk away from their computer for more than a couple of minutes, it goes to sleep. A few minutes later, the lights dim. Shortly after that, if there's no Bluetooth signal in the entire house and certain other conditions are met (i.e. a weekday morning), the entire house goes into Owner Away mode. When the owner returns, the process reverses itself. The lights come on, the temperature returns to normal, and the computer grabs your email.

    In fact, the same gadget could serve equally well at home or work. It'd stay silent until it picks up certain signals and then respond with an "I'm here."


  • Reply 9 of 13
    solipsismxsolipsismx Posts: 19,566member
    inkling wrote: »
    I can imagine something simpler but perhaps more useful. Users carry a Bluetooth signaling device with a long battery life. When they walk away from their computer for more than a couple of minutes, it goes to sleep. A few minutes later, the lights dim. Shortly after that, if there's no Bluetooth signal in the entire house and certain other conditions are met (i.e. a weekday morning), the entire house goes into Owner Away mode. When the owner returns, the process reverses itself. The lights come on, the temperature returns to normal, and the computer grabs your email.

    In fact, the same gadget could serve equally well at home or work. It'd stay silent until it picks up certain signals and then respond with an "I'm here."

    I love that idea! No need to remember if I locked my computer. If I and my phone are away from it it's locked.
  • Reply 10 of 13

    Quote:

    Originally Posted by antkm1 View Post


    Why should every iDevice you own go off instantaneously when you receive an iMessage?  the service should know which device you are actively using and push the message to that device normally and silent on the others.



     


    Like Facebook Messenger.


     


    Works like a charm.

  • Reply 11 of 13
    Like Facebook Messenger.

    Works like a charm.

    As a non-FB user I'm not familiar with that feature. Would you mind giving a little more detail about how it works?
  • Reply 12 of 13
    Like Facebook Messenger.

    Works like a charm.

    Not really...
    if i am on my laptop, my ipad and android phone both still go off when i get a facebook message, and any of the other ways around too (eg. if i am on my phone, my laptop and ipad still go off) :no:
  • Reply 13 of 13
    inkling wrote: »
    I can imagine something simpler but perhaps more useful. Users carry a Bluetooth signaling device with a long battery life. When they walk away from their computer for more than a couple of minutes, it goes to sleep. A few minutes later, the lights dim. Shortly after that, if there's no Bluetooth signal in the entire house and certain other conditions are met (i.e. a weekday morning), the entire house goes into Owner Away mode. When the owner returns, the process reverses itself. The lights come on, the temperature returns to normal, and the computer grabs your email.

    In fact, the same gadget could serve equally well at home or work. It'd stay silent until it picks up certain signals and then respond with an "I'm here."


    Love it! it could even lock/unlock your door using one of those new bluetooth deadbolt attachments!
    https://lockitron.com/preorder
Sign In or Register to comment.