Future iPhone could stop music & video when you're not paying attention

Posted:
in Future Apple Hardware
Apple is researching how a future iPhone can save power by automatically pausing playback when you're not paying attention to media.




Just about every Apple device bar the Apple Pencil can play music or some kind of audio, and most of them have microphones. Apple wants to use those microphones, and very many other sensors, to determine whether you're paying attention.

Newly-revealed patent application "Proactive Actions Based on Audio and Body Movement," could be applied to any Apple device, but it is specifically about stopping audio. And that's specifically about stopping it in order to conserve battery power instead of wasting it on something you're no longer interested in.

There are other possibilities, such as displaying information about an artist when you are detected as being interested. But as with most patent applications, this one is focused most on determining your lack of attention, and less on precisely what actions could follow.

Apple even says "various actions may be performed proactively based on the identifying the interest in the content" of the music or other audio being played.

Some of that identifying of interest could come from use of a device's microphones, but this patent application is about combining information from multiple sources. It's similar to the way that the new iPhone 14 leverages everything from changes in sounds, acceleration, and even barometric pressure to detect a car crash.

In this case, the device would perhaps start with head movement.

"The method identifies a time-based relationship between one or more elements of the audio and one or more aspects of the body movement," says Apple. "For example, this may involve determining that a user of the device is bobbing his [or her] head to the beat of the music that is playing aloud in the physical environment."

Detail from the patent application showing an Apple party.
Detail from the patent application showing an Apple party.


The patent application doesn't say this, but that head-bobbing detection suggests this could utilize AirPods or perhaps even Apple Glass.

Apple also wants to detect body movement, such as dancing -- or jumping out of your armchair when the Giants win the Pennant, the Giants win the Pennant.

"In another example, user motion is recognized as an indication of interest based on its type (e.g., corresponding to excited behavior)," continues Apple, "and/or the movement following shortly after the time at which a significant event, e.g., a touchdown, occurs in the audio."

"The method identifies an interest in content of the audio based on identifying the time-based relationship," For example, this may involve determining that a particular song is playing and that the user is interested in the song based on his or her movement matching the beat of the song."

Most of this supposes that it is the Apple device that is playing the music, the podcast, or the live sports coverage. But the patent application also covers detection of external audio, such as when you may be dancing in the street.

That's partly about whether your attention is away from whatever else your phone is doing, but perhaps mostly because of checking for context. You may be bopping your head as the iPhone is playing Taylor Swift, but maybe you're on a subway train that happens to be vibrating in 4/4 time.

In that case, the iPhone would use what its microphones pick up to determine ambient environment sounds. It surely couldn't be enough to tell the iPhone you're on the N, Q, R or W.

Yet if the iPhone identifies the sound of train tracks, and you keep bopping even between the different kind of tracks that Taylor Swift makes, it all helps build up a picture of what you're concentrating on.

The patent application is credited to three inventors. They include Devin W. Chalmers. whose previous related work has concerned directing a user's attention in an Apple AR environment.






Read on AppleInsider

Comments

  • Reply 1 of 9
    This feature should be really fun when I’m listening to and half watching the news while cooking dinner. 
    muthuk_vanalingamdewmebaconstangFileMakerFellermattinozdocno42
  • Reply 2 of 9
    Definitely a feature that I'd turn off. When YouTube pauses playback on AppleTV and waits for us to confirm that "we're still watching", it's quite annoying.
    baconstangFileMakerFeller
  • Reply 3 of 9
    As long as it can be turned off. I hated this feature on my Samsung (was work phone) and turned it off ASAP.

    edit: Samsung feature used camera to monitor screen attention. It would pause video content when not looking a the screen. 
    edited September 2022
  • Reply 4 of 9
    applguy said:
    As long as it can be turned off. I hated this feature on my Samsung (was work phone) and turned it off ASAP.

    edit: Samsung feature used camera to monitor screen attention. It would pause video content when not looking a the screen. 
    Wow, that's an advertiser's wet dream. Thank goodness it comes with an off switch.
  • Reply 5 of 9
    hexclockhexclock Posts: 1,263member
    I never “pay attention” to my phone when it’s playing music or podcasts…I just want it to play. Sometimes the phone is in my pocket during those times. How could I pay attention in that case? 
    I definitely don’t want it to shut off if I avert my eyes from the screen for a minute or two while watching tv or YouTube.  Most people stop paying attention the second a commercial or ad starts playing. Sounds like a solution to a problem that doesn’t really exist. 
    docno42
  • Reply 6 of 9
    Ehh sorry.....
  • Reply 7 of 9
    docno42docno42 Posts: 3,757member
    No, just no!

    I already loathe their attempts to figure out which device I'm paying attention to in order to only show notifications there.  I want them to show on my Apple watch - always!  Full stop!  It's beyond idiotic you can't force that.  
  • Reply 8 of 9
    docno42docno42 Posts: 3,757member
    Definitely a feature that I'd turn off. 
    lol - good luck with that.  You used to be able to get all notifications on the Apple Watch, then they changed it to where it tries to figure out what you are "paying attention" to - your phone or watch and only show them there.  Except if you put your phone in a stand up charger it thinks you are paying attention to it and now notifications are effectively broken for me.  It's a screaming PITA and really sinks the value of the Apple Watch.

    So yeah, better for them to just butt the eff out.
  • Reply 9 of 9
    DAalsethDAalseth Posts: 2,800member
    I have music on when I’m working, it’s in the background. I’m paying attention to work, not what’s playing.

    To quote an old Monty Python skit, “What a stupid concept.”

Sign In or Register to comment.