'Apple Glass' microphones may locate sounds and direct users to the source

Posted:
in General Discussion edited February 2021
An array of sensitive microphones in "Apple Glass" may detect audio that's difficult to hear, or to precisely locate, and direct the wearer where to look.

'Apple Glass' may point users toward where sounds are originating
"Apple Glass" may point users toward where sounds are originating (source: Angelo Libero


Apple has previously applied for patents regarding sound quality in "Apple Glass," and making 3D audio for it. A newly-revealed patent application shows that Apple is also looking at what "Apple Glass" can do with the audio its microphones hear.

"Audio-Based Feedback for Head-Mountable Device," is concerned with detecting sounds, and then informing the wearer of them. That's if the device has these microphones -- the patent is careful not to say that "Apple Glass" or any specific device will have them, only that they could.

"A head-mountable device can include multiple microphones for directional audio detection," it says. "The head-mountable device can be configured to provide visual outputs based on audio inputs by displaying an indicator on a display based on a location of a source of a sound."

So if "Apple Glass" has "multiple microphones for capturing audio information (e.g., sounds) from multiple sources that are located in different directions," then it could process what it hears. While the patent application does not go into details, the implication is that at the very least, the "Apple Glass" display could show a notification when a particular sound is detected.

Detail from the patent showing microphones facing in different directions
Detail from the patent showing microphones facing in different directions


What may be more useful in certain applications is that the device's microphones are likely to be rather more powerful than the wearer's own ears. Wearing "Apple Glass," they could be notified of sounds they simply could not hear unaided.

Plus, because there are an array of microphones facing different directions, "Apple Glass" could highly accurately calculate where a given sound originates. They could "rendered with visual outputs" what Apple describes as "indicators directing the user to the source of the sound."

"This can allow the user to correctly and readily identify the location of the source, even when the user is not readily able to hear the sound independently of the head-mountable device," says the patent. "By further example, the detected audio inputs can be rendered with audio outputs that emphasize (e.g., amplify) certain sounds over others to help the user distinguish between different sounds."

This patent is credited to three inventors -- Killian J. Poore, Stephen E. Dey, and Trevor J. Ness. Each of these also worked together on a previous patent application to improve how users might see better in low light using "Apple Glass."

Comments

  • Reply 1 of 4
    gatorguygatorguy Posts: 24,641member
    An array of sensitive microphones in "Apple Glass" may detect audio that's difficult to hear, or to precisely locate, and direct the wearer where to look.

    What may be more useful in certain applications is that the device's microphones are likely to be rather more powerful than the wearer's own ears. Wearing "Apple Glass," they could be notified of sounds they simply could not hear unaided.

    Eavesdropping on conversations you shouldn't be party to? I doubt that would go over great with many privacy advocates. I would hope Apple considered a method of masking some speech so as to be unintelligible, if that's possible. That's probably worse for those with expectations of privacy than having a camera built into glasses, and we know how that went over. 
    edited February 2021 beowulfschmidt
  • Reply 2 of 4
    byronlbyronl Posts: 377member
    i thought they wouldn’t include cameras into the glasses for privacy reasons. don’t the microphones interfere with that? anyways it’s just a patent 
  • Reply 3 of 4
    DAalsethDAalseth Posts: 3,045member
    There have been so many articles about this or that amazing feature that Apple has patented for AppleGlasses, everything from locating sound sources to automatically correcting people's vision, and on and on. The result will be when they are finally released, especially in the 1.0 version, people will be disappointed. They will focus on what they won't do rather than amazed by what they will do.
    edited February 2021 watto_cobra
  • Reply 4 of 4
    JapheyJaphey Posts: 1,772member
    Privacy concerns notwithstanding, this could be completely life changing for those with hearing impairments. 
    watto_cobra
Sign In or Register to comment.