Apple awarded PrimeSense patent for 3D virtual keyboard that would allow typing on air
While the reason behind Apple's acquisition of PrimeSense remains unknown, the Cupertino company was awarded a PrimeSense patent on Tuesday describing 3D camera system allowing for an entirely new type of virtual keyboard.
The U.S. Patent and Trademark office awarded Apple with U.S. Patent 8,959,013, entitled "Virtual Keyboard for a Non-Tactile Three Dimensional User Interface." First discovered by AppleInsider, the newly granted invention describes a virtual keyboard that would allow users to type on air.
The system would use a 3D capturing device, such as an array of cameras, that would detect a user's hand movements. A user would be able to type and control a virtual keyboard by moving their fingers or hands, and the system would determine which words and keystrokes a user intends to type.
In the patent, Apple notes that its system could capture 3D information by scanning an "interactive area" located in front of a display screen. In this sense, users could interact with objects on a Mac or HDTV by using their hands in front of them, without physically touching a keyboard, remote, or touchscreen.
If the concept sounds familiar, it's because PrimeSense is the same company that powered the technology behind the first generation of Microsoft's Xbox Kinect.
However, even in its second generation hardware, Kinect does not allow the kind of precise gesture input described in the latest Apple patent, which was originally filed by PrimeSense in 2011. Apple's invention would feature cameras accurate enough to detect subtle fingertip movements for a virtual keyboard or otherwise.
PrimeSense's Carmine short-range sensor.
To help determine which keys a user intends to press, Apple's system would use a "language model" similar to its QuickType suggestions in iOS 8. This would provide a "best guess of the user's intended input," the filing reads, which would allow users to enter more quickly.
Apple's awarded patent is credited to PrimeSense employees Micha Galor, Ofir Or, Shai Litvak, and Erez Sali.
Apple's first awarded patent via the PrimeSense acquisition came last December, and it described a projection-based 3D mapping solution for advanced gesture input.
PrimeSense was founded in 2005, gaining notoriety in 2010 when Microsoft licensed its infrared motion-tracking, depth-sensing chip for the Kinect accessory for Xbox 360. Apple eventually bought Primesense in 2013 at a price tag said to be between $345 million and $360 million.
The U.S. Patent and Trademark office awarded Apple with U.S. Patent 8,959,013, entitled "Virtual Keyboard for a Non-Tactile Three Dimensional User Interface." First discovered by AppleInsider, the newly granted invention describes a virtual keyboard that would allow users to type on air.
The system would use a 3D capturing device, such as an array of cameras, that would detect a user's hand movements. A user would be able to type and control a virtual keyboard by moving their fingers or hands, and the system would determine which words and keystrokes a user intends to type.
In the patent, Apple notes that its system could capture 3D information by scanning an "interactive area" located in front of a display screen. In this sense, users could interact with objects on a Mac or HDTV by using their hands in front of them, without physically touching a keyboard, remote, or touchscreen.
If the concept sounds familiar, it's because PrimeSense is the same company that powered the technology behind the first generation of Microsoft's Xbox Kinect.
However, even in its second generation hardware, Kinect does not allow the kind of precise gesture input described in the latest Apple patent, which was originally filed by PrimeSense in 2011. Apple's invention would feature cameras accurate enough to detect subtle fingertip movements for a virtual keyboard or otherwise.
PrimeSense's Carmine short-range sensor.
To help determine which keys a user intends to press, Apple's system would use a "language model" similar to its QuickType suggestions in iOS 8. This would provide a "best guess of the user's intended input," the filing reads, which would allow users to enter more quickly.
Apple's awarded patent is credited to PrimeSense employees Micha Galor, Ofir Or, Shai Litvak, and Erez Sali.
Apple's first awarded patent via the PrimeSense acquisition came last December, and it described a projection-based 3D mapping solution for advanced gesture input.
PrimeSense was founded in 2005, gaining notoriety in 2010 when Microsoft licensed its infrared motion-tracking, depth-sensing chip for the Kinect accessory for Xbox 360. Apple eventually bought Primesense in 2013 at a price tag said to be between $345 million and $360 million.
Comments
No thanks.
Lame application... but if they've actually been able to capture this much detail in real-time, then they're really coming along with this technology from PrimeSense.
Thankful we haven't seen any close-ups of that creepy, weird hand recently.
http://m.brookstone.com/laser-projection-virtual-keyboard
Gosh, I sure hope Blackberry doesn't have any patents on air...
Frankly, this is the kind of junk you'd find on SkyMall pages...
http://m.brookstone.com/laser-projection-virtual-keyboard
No is not. The SkyMall crap is light based keyboard reflected on a surface and your fingers have to strike the right keys. This is camera based system which calibrates the positions of your hands/fingers with proximity. It doesn't matter where you move your hand within the camera zone, it still works just like the way Kinect captures your image in Xbox game. That means you can put a dummy keyboard right in front of you and type on it and it should work like you actually connect that keyboard to the system..LOL.
Gonna help with configuration of my
air guitar.
you beat me to it. I was thinking a MIDI air drums controller.
[VIDEO]
With the sensor positioned correctly, it should be able to track your hands in a resting position so you can tap out letters on your knee on a sofa without a keyboard into an Apple TV interface or iPad without an add-on keyboard.
Exactly. I bet a lot of the folks mocking this enjoyed Minority Report and are failing to make the connection.
You don't have to type in the air like this:
With the sensor positioned correctly, it should be able to track your hands in a resting position so you can tap out letters on your knee on a sofa without a keyboard into an Apple TV interface or iPad without an add-on keyboard.
Now, that's fking cool way to type. I hope it works for other languages too.
Wait! Are you that "Quadro?" The 1993 World Air Guitar champion "Quadro?"
PrimeSense was founded in 2005, gaining notoriety in 2010 when....
Gained "notoriety"? How so?
This is the second time I am seeing the exact same sentence on articles around PrimeSense. The last one being: http://forums.appleinsider.com/t/183798/apples-first-patent-reassignment-from-primesense-buy-hints-at-3d-mapping-on-apple-tv-iphone ;
Yep although I wouldn't say the Minority Report setup is the way to go. The qwerty keyboard has been given a level of importance when it comes to language input but it has a limited design:
http://www.businessinsider.com/chinese-keyboards-2011-9?op=1
http://www.businessinsider.com/apple-keyboard-2011-7
People have complained about the software keyboard in iOS but that's mainly the tactile part. From a functionality point of view, software inputs are much more flexible. We have to map functionality onto key combinations. Why do we use command-s to save files rather than tap an icon that represents saving a file? Why do we hit b to enable a brush in Photoshop and j for the heal brush? We simply don't have contextual representations to do it directly.
The keyboard really needs to be a thing of the past. We only have it because of typewriters. Letters don't need to be arranged the way they are because children aren't taught on typewriters any more, they are taught the alphabet and keyboards present a letter layout that is nothing like it.
When it comes to keyboard-less devices like phones and tablets, gesture input can provide the higher functionality of the software keyboard without touching the display. Microsoft has focused on sticking qwerty keyboards to the tablets but it should really be a gesture sensor or touch pad. The pad can be narrow because keys can be arranged in a single line. It would take character input for Asian users.
The precision of these sensors is high enough that it will be as reliable as pressing a key. They can detect 0.01mm distances. They can also anticipate your next gesture so they can type ahead before you enter a character. They have no moving parts so would be reliable and feel consistent across devices.