Magnetic smart gloves for 'Apple Glass' could provide precise user control

Posted:
in Future Apple Hardware
Apple's long-rumored AR and VR efforts including "Apple Glass" could use smart gloves to interact with the system, using magnetic fields to determine where a user's individual fingers are located.




One of the issues with current-generation VR headsets is a need to use hand-held controllers. While existing systems can be used to tell where hands are in relation to a helmet, they aren't capable of accurately working out where a user's individual fingers are positioned.

Furthermore, hand-held controllers may not allow users to grab onto other objects, something that could be needed in some AR applications. This may be especially true for Apple Glass, rumored AR glasses that may need to rely on controller-less interaction in the future.

In a patent granted to Apple on Tuesday by the US Patent and Trademark Office titled "Magnetic sensor based proximity sensing," Apple suggests it could create smart gloves that can accurately pinpoint a user's fingertips.

Apple claims it can do this via magnetic sensing. This is the practice of using disturbances in magnetic fields to measure location and positioning of magnetic sources, or the position of a sensor from a magnetic source.

In a glove, Apple suggests a coil-based magnetic field generator with a specific modulation could be positioned on the back of a hand. Magnetic sensors attached to each fingertip can demodulate the magnetic field, which helps determine the distance between it and the source.

By using multiple magnetic sources, such as two on the back of the hand and one in the palm, the system can also feasibly work out the 3D positioning of each fingertip.

The fingertips hold sensors that can detect the magnetic source on the back of the glove.
The fingertips hold sensors that can detect the magnetic source on the back of the glove.


This would potentially leave a lot of space on the glove to add other components, including touch sensors, actuators for haptic feedback, temperature sensors, and heaters. Batteries and a communication system with the rest of a VR system can also be included.

The patent lists its inventors as Jian Guo, John Greer Elias, and Savas Gidler. It was originally filed on February 19, 2019, and first surfaced to AppleInsider in an application filing in August 2019.

Apple files numerous patent applications on a weekly basis. While the existence of a patent indicates areas of interest for Apple's research and development efforts, they do not guarantee the concepts will appear in a future product.

The rumored Apple VR and Apple AR projects, along with Apple Glass, have thrown up many patents in the past. Some of those patents have shown Apple is certainly working on solving the interactivity problem.

This has previously included finger clamps that squeeze fingers to simulate typing on a keyboard, force-sensing garments, eye-tracking systems, and other methods.

On the VR and AR side, the patent for "Computer Systems with Finger Devices" suggested the use of fingernail-mounted attachments to sense positioning and other factors.

An "expandable ring device" has also been touted in a patent in November 2020. The expanded section, which covers part of the finger, could be used to detect finger movements as it bends and flexes.

There is also the possibility of using LiDAR in such a system. A patent from the same month offered the use of LiDAR to perform object tracking, rather than relying on video feeds, while also opening the possibility for controller-free hand tracking.

Comments

  • Reply 1 of 8
    cg27cg27 Posts: 213member
    Warning: keep gloved hands away from hearts of those with pacemakers - if in doubt do not shake hands or hug.  Keep gloves away from children as they may attempt to climb metal buildings/objects like Spider-Man.
  • Reply 2 of 8
    z3r0z3r0 Posts: 238member
    Cue Magneto cosplay in 3.. 2.. 1.. !  :#



    edited February 2021 watto_cobra
  • Reply 3 of 8
    Pretty sure the gloves in the top image are Mujjo.  Comfortable, warm, easily controls a device, but a pain to deal with shipping.  (Particularly if a return is needed.)
    watto_cobra
  • Reply 4 of 8
    entropysentropys Posts: 4,166member
    Get Tom Cruise to advertise them although I suspect that would be a Minority Report amongst this crowd.
  • Reply 5 of 8
    anomeanome Posts: 1,533member
    cg27 said:
    Warning: keep gloved hands away from hearts of those with pacemakers - if in doubt do not shake hands or hug.  Keep gloves away from children as they may attempt to climb metal buildings/objects like Spider-Man.
    Well, they did put a spider logo on the back of them*...

    Doesn't feel like a very Apple solution, though. Also I hope those things are machine-washable.

    * Yes, I know. That's the joke.
    watto_cobra
  • Reply 6 of 8
    To the author: You should give Oculus Quest 2 a try. Even with the feature in beta, its hand tracking can tell precisely where your fingers are. The effect is pretty freaky as you stare at a ghostly image of your hands while you wiggle your fingers. In another generation or two, the idea of having to wear gloves for hand tracking will treated with embarrassed chuckles.
    AI vision is really happening in a big way. No one is going to don gloves to use AR or VR.
    edited February 2021
  • Reply 7 of 8
    To the author: You should give Oculus Quest 2 a try. 
    Requires a Facebook account for use.  I'll never own or try one.
    dysamoriawatto_cobra
  • Reply 8 of 8
    dysamoriadysamoria Posts: 3,430member
    Why does the industry keep wanting us to look like Borg, just for a questionable added utility of... uh... what, again?

    Buying an assortment of fashion tech objects so they can get us on an ever-accelerating cycle of replacing our glasses, gloves, hats, shoes, underwear...
Sign In or Register to comment.