Future MacBook keyboards may come loaded with in-key displays, capacitive touch sensors
While Apple's most recent innovations have come from portables like the iPad Air and iPhone 5s, a document uncovered on Thursday reveals a feature-laden keyboard with multi-function "keystacks" that integrate miniature displays, touch sensors and haptic feedback mechanisms.
Showing the company is still making advances in more traditional tech, an Apple patent filing for "Multi-functional keyboard assemblies" describes a keyboard consisting of an array of so-called "keystacks," or individual keys layered with electronics, sensors and switches.
Published by the U.S. Patent and Trademark Office, Apple's application takes cues from third-party accessories like Art. Lebedev Studio's Optimus Maximus keyboard, which sported clear keycaps overlaid atop small configurable OLED displays. While both standalone and integrated laptop keyboards are covered in the patent language, it should be noted that the first illustration shows a current-generation MacBook Air.
The Maximus, and successor models like the Optimus Popularis that feature keys with built-in displays, are highly functional tools as each key can be mapped to output specific letters, icons or pictures with corresponding customizable commands. Being small-batch products, the Optimus line never really caught on due to prohibitively high price tags and sub-par performance.
Source: USPTO
Apple's invention builds on this display-within-key concept by adding multiple layers to the keystack. While the Optimus is limited to input via a physical switch and output through an OLED, Apple's invention allows for multiple modes of input and output.
For example, the multi-functional keystack can be configured to accept user input through a switch-type button, while a capacitive surface component can provide a second independent input through multitouch gestures.
Cross-sectional view of keystack.
Going further, Apple notes the system gives users visual feedback through a backlit display integrated into each key. Based on OLED, LCD or other screen technology, the display sits above or below touch circuitry and is viewed through a transparent portion of the key. In some embodiments, the keycaps are made of glass or a similarly rigid -- yet durable -- material that is stronger and thinner than traditional plastic parts.
Diving into the workings of Apple's patent, the invention states each key has its own circuitry that is operably connected to one or more system processors. The basic keystack incorporates a support structure (scissor or butterfly switch), flex circuit, light guide and display. More advanced forms add in capacitive sensing and haptic feedback mechanisms.
Key covers.
Acting as a regular keyboard, the invention allows users to reproduce glyphs, characters or symbols onscreen as they are seen displayed on each key. With dedicated circuitry in communication with a computer's processor, however, the keyboard is able to output visual and tactile information corresponding to a user's input.
The keyboard accepts normal dome switch presses, pressure-sensitive input and capacitive touch-based gestures. Using the latter embodiment, Apple's keyboard is able to replace a traditional mouse or multitouch trackpad. In one example, the document describes a user flipping through the pages of an e-book in iBooks by swiping across certain keys or key combinations.
Both scissor (left) and dome type switches are supported in Apple's invention.
Finally, switches located at the base of each keystack are, in some forms of the invention, able to respond to user input through haptic feedback like vibrations, clicks and increased resistance in relation to a button press.
The rest of the application covers details regarding keystack implementation in standalone and integrated keyboards. Variations on display techniques are also discussed and include less dynamic forms of visual feedback relating to multi-colored light sources and optical filters.
Apple's multi-functional keyboard assemblies patent application claims benefit of a provisional application first filed for in 2012 and credits Craig C. Leong, James J. Niu, John M. Brock, Keith J. Hendren, Thomas W. Wilson, Jr., Bartley K. Andre, Mikael Silvanto and Dinesh C. Mathew as its inventors.
Showing the company is still making advances in more traditional tech, an Apple patent filing for "Multi-functional keyboard assemblies" describes a keyboard consisting of an array of so-called "keystacks," or individual keys layered with electronics, sensors and switches.
Published by the U.S. Patent and Trademark Office, Apple's application takes cues from third-party accessories like Art. Lebedev Studio's Optimus Maximus keyboard, which sported clear keycaps overlaid atop small configurable OLED displays. While both standalone and integrated laptop keyboards are covered in the patent language, it should be noted that the first illustration shows a current-generation MacBook Air.
The Maximus, and successor models like the Optimus Popularis that feature keys with built-in displays, are highly functional tools as each key can be mapped to output specific letters, icons or pictures with corresponding customizable commands. Being small-batch products, the Optimus line never really caught on due to prohibitively high price tags and sub-par performance.
Source: USPTO
Apple's invention builds on this display-within-key concept by adding multiple layers to the keystack. While the Optimus is limited to input via a physical switch and output through an OLED, Apple's invention allows for multiple modes of input and output.
For example, the multi-functional keystack can be configured to accept user input through a switch-type button, while a capacitive surface component can provide a second independent input through multitouch gestures.
Cross-sectional view of keystack.
Going further, Apple notes the system gives users visual feedback through a backlit display integrated into each key. Based on OLED, LCD or other screen technology, the display sits above or below touch circuitry and is viewed through a transparent portion of the key. In some embodiments, the keycaps are made of glass or a similarly rigid -- yet durable -- material that is stronger and thinner than traditional plastic parts.
Diving into the workings of Apple's patent, the invention states each key has its own circuitry that is operably connected to one or more system processors. The basic keystack incorporates a support structure (scissor or butterfly switch), flex circuit, light guide and display. More advanced forms add in capacitive sensing and haptic feedback mechanisms.
Key covers.
Acting as a regular keyboard, the invention allows users to reproduce glyphs, characters or symbols onscreen as they are seen displayed on each key. With dedicated circuitry in communication with a computer's processor, however, the keyboard is able to output visual and tactile information corresponding to a user's input.
The keyboard accepts normal dome switch presses, pressure-sensitive input and capacitive touch-based gestures. Using the latter embodiment, Apple's keyboard is able to replace a traditional mouse or multitouch trackpad. In one example, the document describes a user flipping through the pages of an e-book in iBooks by swiping across certain keys or key combinations.
Both scissor (left) and dome type switches are supported in Apple's invention.
Finally, switches located at the base of each keystack are, in some forms of the invention, able to respond to user input through haptic feedback like vibrations, clicks and increased resistance in relation to a button press.
The rest of the application covers details regarding keystack implementation in standalone and integrated keyboards. Variations on display techniques are also discussed and include less dynamic forms of visual feedback relating to multi-colored light sources and optical filters.
Apple's multi-functional keyboard assemblies patent application claims benefit of a provisional application first filed for in 2012 and credits Craig C. Leong, James J. Niu, John M. Brock, Keith J. Hendren, Thomas W. Wilson, Jr., Bartley K. Andre, Mikael Silvanto and Dinesh C. Mathew as its inventors.
Comments
I see the first shipping product being $200
I think you should be prepared to add a zero.
I'm down. Best purchase in recent memory. Anything to make a better version is gold.
yes please. this could help for non-English speaking people. I would love to see a keyboard in a different language- but they all have English. this way when i want to type Korean, Czech or Norwegian i can just change the keys like i do on the iPhone/ipad.
however, i would also love to see the keyboard go. I would imagine that they could save room if they did away with the keyboard and just had another display that could act as a giant mousepad/ipad and a keyboard when one needs it. obviously not everyone would want it, so it could be an upgrade.
I think you should be prepared to add a zero.
$2000 for a keyboard? When they are selling arguably a $4000 computer for $3000? Maybe $200 is a little low, but I'll bet nothing more than $300, and that would be for a VERY useful bit of kit. Maybe even keyboard with customizable keys and a trackpad grafted onto the side. A new Magic Keyboard Pro if you will.
Also, as revenant points out, language assigned physically to keyboards is a problem to be solved. I am in Berlin, and buying a new computer is problematic because I would want an english keyboard. If the keyboard could be dynamically assigned, that would be slick. Quickly switching between languages as well as application specific layouts would be a major selling point, and save Apple the logistics of making machines for each language, and maybe getting the ratios wrong.
Time will tell.
I would want an english keyboard. If the keyboard could be dynamically assigned, that would be slick.
ZWERTY to QWERTY at the tick of a checkbox in settings.
None of the actual product we see today as "game changers" was preceded by a patent filing giving away the future of Apple product.
ZWERTY to QWERTY at the tick of a checkbox in settings.
Not just this but imagine the Language change options. Huge manufacturing benefits.
Reminds me of the Art Lebedev Studio keyboards. You know, the one with 108 OLED keys that costs $1,500. And this one, which is a touchscreen concept of theirs.
In that it’s a meaningless middle ground between keyboard+mouse and a real touchscreen desktop.
Fascinating
http://www.wpcentral.com/microsoft-research-building-gesture-sensing-physical-keyboard
First, I do not accept the argument that Apple is selling a $4000 computer for $3000. My shopping exercises put Apple's prices among the highest on the market. Other, similar machines have also been very expensive, but Apple always comes in $100-200 more than the nearest comparable equivalent. Perhaps that premium is justified by superior materials, but the point stands that Apple is not doing anyone any pricing favours.
As for the price of the keyboard, I'm basing my estimate on existing technology. The much less capable Art Lebedev is USD$1500:
http://www.artlebedev.com/everything/optimus/popularis/
That $1500 does not include haptic feedback or capacitive touch, so adding the additional features Apple's patent app includes will drive the price even higher. Apple will achieve a lower cost of manufacturing through economies of scale, then immediately swallow those savings with 40% margins.
How did you come up with your figure?
On the higher end Apple tends to come in lower than the competition.
Also, I've always wanted to teach myself to use the DVORAK layout. But not being able to see the letters in their rearranged positions has been a daunting setback. I would LOVE it, if during my spare time I could have my key caps automatically rearrange to display DVORAK, but display QWERTY when I get to work and have to really get stuff done without stumbling over my hobbies.
I think a Pro keyboard that is built around iPad technology could be the answer.
I personally don't like the idea of lots of little OLED screens in separate keys.
I'd rather see a keyboard based on iPad hardware + pressure sensitive display.
This way you could rest your fingers on the keys and use haptic feedback to simulate key presses.
This also gives lots of flexibility with custom keyboard layouts as well as non-traditional inputs such as sliders, knobs and color pickers.
If based on iPad technology the price could definitely start in the $300-500 range and come down over time.
No doubt Apple could make it better, but this isn't new.
http://www.artlebedev.com/everything/optimus/maximus/
this has kind of been done a few years ago...
No doubt Apple could make it better, but this isn't new.
http://www.artlebedev.com/everything/optimus/maximus/
Does no one read the articles before posting? It specifically talks about the existing Art Lebedev keyboards.