Apple's 'iRing,' AR headset resurface in Augmented Reality filings

AppleInsider

In a trio of new patents about Augmented Reality, Apple reveals that it is continuing to work on using a smart ring to help with detecting a user's motion, as well as new systems for playing relevant audio, and positioning virtual objects in the real world.

An AR headset that uses a mounted iPhone would have its audio automatically relayed to the headset's speakers

Details of certain ways Apple is approaching its forthcoming Augmented Reality system have been revealed in a series of related patents covering key aspects of the technology. The company continues to refine its headsets, this time detailing how the correct audio can be sent to the wearer, and how virtual objects can be consistently positioned in the real world.

Plus one patent proposes using a smart ring instead of a typical Virtual Reality glove. An Apple-designed "iRing" has been previously rumored since 2015 when a patent filing detailed such a device.

Detail from one description of a smart ring

In US patent number 20190349662, Apple describes an AR headset "having device-mount audio mode."

This is specifically for a headset where another device like an iPhone is mounted in front of the user's eyes.

"[The headset can be] configured to: determine whether the mobile device is mounted on a head-mounted display (HMD) mount," says the patent, "[then] transmit an audio signal from the device processor to a wireless headphone; and change an audio mode of one or more of the mobile device or the wireless headphone."

So when the iPhone is mounted in the headset, the audio can be automatically routed to that headset's speakers. When it isn't, the iPhone's own speakers are used instead.

A separate filing, patent number 20190346938, covers a "finger-mounted device with fabric."

While previous patents have shown Apple describing various systems using gloves or gloves with rings on several fingers to detect motion, this filing proposes that one smart ring could provide the necessary motion information.

"The use of wearable devices to gather input for controlling electronic equipment can pose challenges," says this patent. "If care is not taken, a device such as a glove may affect the ability of a user to feel objects in the user's surroundings, may be uncomfortable to use, or may not gather suitable input from the user."

Such a ring could contain "components such as force sensors, accelerometers, and other sensors and for haptic output devices."

"During operation, a user may wear the finger mounted units on the tips of the user's fingers while interacting with external objects," it continues.

Patent drawings don't have to be elegant, they just have to convey the key parts of the filing

Part of the need for precise detection of a user's motion is to do with how virtual objects must not only appear to be placed in the real world, but must be consistent, too. The objects need to be fixed in the real world and the user has to be able to locate them.

A third patent, number 20190347846, covers "techniques for locating virtual objects relative to real physical objects."

"Various electronic devices exist, such as head-mound devices (also known as headsets and HMDs), with displays that present users with experiences in which they may be fully immersed in a surrounding physical environment," says the patent.

"These devices often generate experiences utilizing pre-canned (or fixed) content to represent a CGR environment," it continues. "When presented on a display of an electronic device, that pre-canned content provides the same experience regardless of the physical environment in which the electronic device is physically located."

These patents may refer to the AR headset that Apple is expected to release by 2022, with a separate AR Glasses device coming the following year.

fastasleep

People are stupid to dismiss this tech. The current crop of VR headsets are already very impressive for being 1st gen tech at this point. Apple's not going to release something until it's miles ahead of what we've already seen, and will probably be the first real solid AR implementation when it comes out unless someone beats them to it. I'm looking forward to this very much.

gatorguy

The "wearable ring" for tracking hand movements and controlling elements in a virtual space is probably going to be fairly common. Google, Microsoft, and quite a few smaller companies have filed and even been granted patents on "rings" some years ago for similar uses to what Apple sees as useful in their more recent patent filings. What they're all waiting for is the miniaturizing tech for the head-mounted units to catch up. So far everything has been relatively bulky and not fit for street use outside of something like Google Glass which failed for consumers due to PR reasons. 

Once the head hardware is nailed all the big techs will be jumping in with their own adaptations of it, all properly IP protected since the ecosystem requirements are generally understood and the engineering already well under way. This is a segment that will take off quickly IMO. They're all waiting on the same thing. 

OutdoorAppDeveloper

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

currentinterest

The use of haptics is what makes these rings interesting. The lack of tactile feedback can be a limiting factor in some applications. The next few years will be very interesting.

gatorguy

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

I've had time to think about it more and you may well be right.

fastasleep

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

Your hands won't always be in front of cameras with a self-contained headset. It could also integrate controls such as "buttons" for gripping/releasing/whatever, or provide feedback.

gatorguy

fastasleep said:

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

Your hands won't always be in front of cameras with a self-contained headset. It could also integrate controls such as "buttons" for gripping/releasing/whatever, or provide feedback.

Might be a job for radar...

leavingthebigg

Way back in April 2013 an analyst named Brian White announced he had discovered in Apple’s supply chain that Apple was researching a ring for gesture control of iTV. He was mercilessly mocked by nearly everyone including me. To see that he being proven right has me shaking my head in awe.

fastasleep

gatorguy said:

fastasleep said:

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

Your hands won't always be in front of cameras with a self-contained headset. It could also integrate controls such as "buttons" for gripping/releasing/whatever, or provide feedback.

Might be a job for radar...

What? If your hands are out of view of a camera, why would it not also be out of view of some sort of radar sensor?

gatorguy

fastasleep said:

gatorguy said:

fastasleep said:

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

Your hands won't always be in front of cameras with a self-contained headset. It could also integrate controls such as "buttons" for gripping/releasing/whatever, or provide feedback.

Might be a job for radar...

What? If your hands are out of view of a camera, why would it not also be out of view of some sort of radar sensor?

Why would they be out of view if you're trying to control something with your hands? There's also no reason the radar sensors couldn't be both fore and aft, creating a small bubble around you so to speak. 

fastasleep

gatorguy said:

fastasleep said:

gatorguy said:

fastasleep said:

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

Your hands won't always be in front of cameras with a self-contained headset. It could also integrate controls such as "buttons" for gripping/releasing/whatever, or provide feedback.

Might be a job for radar...

What? If your hands are out of view of a camera, why would it not also be out of view of some sort of radar sensor?

Why would they be out of view if you're trying to control something with your hands? There's also no reason the radar sensors couldn't be both fore and aft, creating a small bubble around you so to speak. 

The point is, you may have your hands obscured from view of whatever type of sensor, so having a disparate sensor that can track your hand movement and orientation outside of that view could be useful. I’m speaking from actual experience in VR. 

gatorguy

fastasleep said:

gatorguy said:

fastasleep said:

gatorguy said:

fastasleep said:

OutdoorAppDeveloper said:

Rings and gloves have already been made obsolete by AI hand tracking using vision sensors. It is working already on the Oculus Quest with low resolution cameras and a relatively slow CPU/GPU. With high resolution cameras and depth sensors, very high precision tracking of hands and fingers will be possible. That will work a lot better than forcing users to wear things on their hands.

Your hands won't always be in front of cameras with a self-contained headset. It could also integrate controls such as "buttons" for gripping/releasing/whatever, or provide feedback.

Might be a job for radar...

What? If your hands are out of view of a camera, why would it not also be out of view of some sort of radar sensor?

Why would they be out of view if you're trying to control something with your hands? There's also no reason the radar sensors couldn't be both fore and aft, creating a small bubble around you so to speak. 

The point is, you may have your hands obscured from view of whatever type of sensor, so having a disparate sensor that can track your hand movement and orientation outside of that view could be useful. I’m speaking from actual experience in VR. 

Ah, gotcha. that makes some sense.