Apple seeks to improve the stylus with dynamic input based on pressure, grip, angle & more
As rumors suggest Apple will launch a 12.9-inch iPad with a new stylus accessory later this year, a new patent application offers a glimpse at what the company could be working on, describing an advanced stylus that would offer much more dynamic ways of interacting with a touchscreen than just the press of a finger.
The stylus concept was revealed in Apple's filing for "Expanded Function Touch Sensor Implement," published this week by the U.S. Patent and Trademark Office, and discovered by AppleInsider. The newly disclosed concept describes a stylus-type accessory with multiple sensors that would act in concert with a touchscreen device, like an iPad.
In the filing, Apple notes that with current capacitive touchscreens, users can "mash" their fingertip against the screen, deforming it to contact a variable area of a touchscreen. A traditional stylus, meanwhile, does not offer as much precision, simply acting as a specific point where touch input is sensed.
"As such, use of a stylus or other implement with a touch sensor may not be as flexible as use of a finger or other body part," the application reads.
Apple's solution is to create an advanced stylus with a number of sensors to detect a variety of types of input. These could include the angle at which the stylus is touching the display, or the distance of the stylus from the device, potentially allowing for 3D input.
Those features sound similar to an advanced stylus described in earlier rumors, said to be in the works by Apple. Specifically, it was said that the company plans to release a stylus that would include a built-in gyroscope or accelerometer to allow new features like 3D handwriting.
Apple's patent application also describes a stylus with a "grip sensor" that would sense the amount of force with which the user is gripping the instrument. The filing also describes a pressure sensor that would measure how hard the user is pressing the stylus against the device -- something that could take advantage of Force Touch input rumored to be on future iPads.
Another input method described by Apple is a "strain gauge" that would measure how much strain is being exerted on the stylus by the user. Finally, Apple also notes that its stylus could also include hardware buttons that could be pressed for alternative input methods.
AppleInsider's own sources have indicated that the company is working on a 12.9-inch tablet, known colloquially as an "iPad Pro," that will feature a Bluetooth-connected stylus. Separately, analyst Ming-Chi Kuo of KGI Securities has said that Apple plans to launch the larger iPad with a simple stylus this year, while more advanced features such as 3D handwriting, are unlikely to arrive until next year at the earliest, with a new and more advanced stylus.
This week's patent application is far from the first filing by Apple revealing the company's behind-the-scenes interest in developing a stylus. One concept detailed by AppleInsider last year included an extendable multitouch nib with onboard light and motion sensors, while another stylus patent published earlier this year described once again how a stylus can offer more precise input than a fingertip.
Apple's latest patent filing was first submitted to the USPTO in November of 2013. It is credited to Christopher J. Herrick and Agustya R. Mehta.
The stylus concept was revealed in Apple's filing for "Expanded Function Touch Sensor Implement," published this week by the U.S. Patent and Trademark Office, and discovered by AppleInsider. The newly disclosed concept describes a stylus-type accessory with multiple sensors that would act in concert with a touchscreen device, like an iPad.
In the filing, Apple notes that with current capacitive touchscreens, users can "mash" their fingertip against the screen, deforming it to contact a variable area of a touchscreen. A traditional stylus, meanwhile, does not offer as much precision, simply acting as a specific point where touch input is sensed.
"As such, use of a stylus or other implement with a touch sensor may not be as flexible as use of a finger or other body part," the application reads.
Apple's solution is to create an advanced stylus with a number of sensors to detect a variety of types of input. These could include the angle at which the stylus is touching the display, or the distance of the stylus from the device, potentially allowing for 3D input.
Those features sound similar to an advanced stylus described in earlier rumors, said to be in the works by Apple. Specifically, it was said that the company plans to release a stylus that would include a built-in gyroscope or accelerometer to allow new features like 3D handwriting.
Apple's patent application also describes a stylus with a "grip sensor" that would sense the amount of force with which the user is gripping the instrument. The filing also describes a pressure sensor that would measure how hard the user is pressing the stylus against the device -- something that could take advantage of Force Touch input rumored to be on future iPads.
Another input method described by Apple is a "strain gauge" that would measure how much strain is being exerted on the stylus by the user. Finally, Apple also notes that its stylus could also include hardware buttons that could be pressed for alternative input methods.
AppleInsider's own sources have indicated that the company is working on a 12.9-inch tablet, known colloquially as an "iPad Pro," that will feature a Bluetooth-connected stylus. Separately, analyst Ming-Chi Kuo of KGI Securities has said that Apple plans to launch the larger iPad with a simple stylus this year, while more advanced features such as 3D handwriting, are unlikely to arrive until next year at the earliest, with a new and more advanced stylus.
This week's patent application is far from the first filing by Apple revealing the company's behind-the-scenes interest in developing a stylus. One concept detailed by AppleInsider last year included an extendable multitouch nib with onboard light and motion sensors, while another stylus patent published earlier this year described once again how a stylus can offer more precise input than a fingertip.
Apple's latest patent filing was first submitted to the USPTO in November of 2013. It is credited to Christopher J. Herrick and Agustya R. Mehta.
Comments
I hope they do ship an optional stylus though, or else better support for a new class of more advanced 3rd-party ones. I know artists who couldn't give up their iPad art apps, but would love better options for styluses.
um, just what body parts are they using to write on their iPads down in Cupertino?
Problems it could overcome:
lag (pencil line trails pen stroke by significant amount on most current solutions)
offset between tip and pixels being effected
feel of the screen under tip (smooth glass is very different than paper)
Problems with accidental press of buttons on stylus
Very tough space to stand out, however, given Wacom and Microsoft Surface have been doing a great job with this.
An iPad specific stylus from Apple would be fantastic. Anyone that has tried a 3rd party stylus on an Air will agree. In light of the iPad Pro rumors a stylus is plausible imo. Crossing fingers.
People have used pencils to draw for eons without any sort of grip feature. Just make the stylus act and work like a pencil/brush/pen.
There's no need to reinvent the wheel. There's already enough UI combinations from swiping with four fingers to force touch trackpads. The last thing I need is some new way to grip a bloody pen.
I don't believe tales of force touch on iPads or iPhones. There isnt enough room. Look at the tear downs of MacBooks and you can see what I mean. Incorporating force touch into the stylus in the other hand, I can believe.
Would seem more cost-effective, as well as universal, since current iPad would support dynamic pressure this way with a software update.
The large part is the electromagnet to make the click. This wouldn't be possible in a multi-touch device because it wouldn't simulate two clicks close together. The sensors for pressure aren't that large, they can use the speaker or vibration motor to give feedback.
It would be more accurate on the pen.
"input information from such a stylus or other implement may be limited to detecting the touch at the exact tip of the stylus or other implement. Unlike a finger, which may “mash” or otherwise be deformable to contact a variable area of a touch sensor, the physical area contactable by a stylus or other implement may not be controllable. As such, use of a stylus or other implement with a touch sensor may not be as flexible as use of a finger or other body part."
Apple showed a 3rd party stylus in one of their ads recently, which is one of the few that can do finer writing because of the small tip and transparent disc:
https://www.apple.com/ipad/change-everything/learning/
http://www.adonit.net/jot/pro/
One thing to watch out for with a fine tip would be scratching up anti-glare coatings and even cracking the display if people press too hard on a small point. I expect the tip of the pen would be dampened so that it doesn't put too much pressure on the glass.
Another reason for special sensors in the pen is for palm rejection. When the pen is in close proximity to the display, the iPad can disable input from the hand but possibly leave some finger input active.
The handle pressure sensor can be used for navigating and moving things so with an image layer for example, you can hover above it, squeeze the pen and drag the layer around, even rotate (twist/tilt) and scale (move pen towards/away).
It would be a bonus in education over laptops for inputting equations and for drawing classes.
If I use finger to draw or write, I cannot let my palm touch the screen otherwise it would register as a stroke.
If I use Wacom pen, it will help reduce palm but it is totally awkward. When writing or drawing, thee strokes are several pixels offset from the tip.
iPad Pro should have the stylus for writing or drawing. It would be a much welcome feature.
I will definitely upgrade from iPad Air 2 to iPad Pro once it comes out.
BTW, the stylus is NOT designed to replace the gestures used to execute commands. The stylus is only for drawing or writing.
Studies show that writing improves your cognition. It makes you think while you write and helps you brainstorm better. Typing doesn't offer that kind of benefit.
"please, just make the computer work like a typewriter"
Form follows function.
Nice try Apple.
Microsoft needs to patent the Surface Pen and prevent Apple from stealing their ideas!
The Surface Pen already has these same features.. Apple isn't doing anything new.
The surface Pro 2 had a superior Wacom digitizer. The Surface Pro 3 has an nTrig sensor that leverages the touch screen itself, but everyone that's an artist hates it and are keeping the Surface Pro 2's. Microsoft is always quick to sink their own ship, geez.
For reference, it's like Apple selling IPS monitors and tablets, and then everyone selling their own IPS monitors and tablets at the same cost as Apple, and when they don't sell, they switch them back to TN panels and try to still sell them as equivalent. They are not.
The surface Pro 2 had a superior Wacom digitizer. The Surface Pro 3 has an nTrig sensor that leverages the touch screen itself, but everyone that's an artist hates it and are keeping the Surface Pro 2's. Microsoft is always quick to sink their own ship, geez.
For reference, it's like Apple selling IPS monitors and tablets, and then everyone selling their own IPS monitors and tablets at the same cost as Apple, and when they don't sell, they switch them back to TN panels and try to still sell them as equivalent. They are not.
What are you talking about? nobody is keeping Pro 2s lol.. Surface Pro 3 has broken sales records and is far more superior. The Pen doesn't leverage the screen, they actually improved the pressure sensitivity and added palm block tech. You can press harder or lighter on the pen to make the ink appear thicker or thinner in OneNote and any other pen app.
From Microsoft.com: "The fine tip, along with Palm Block technology and multi-point sensitivity in your Surface, lets you write and draw naturally."
Adjust pressure sensitivity for your Surface Pen
You can use the Surface app to adjust built-in pressure detection to your writing style. Here’s how:
Step 1:To open the app, swipe in from the right edge of the screen, and tap Search.
Step 2:In the search box, enter surface, and in the search results, tap or click Surface.
Step 3:Swipe left to Settings.
Step 4:Under Pen Pressure Sensitivity, adjust the slider to change your pen sensitivity.
Step 5:Under Ink Test, test your pen sensitivity by drawing or writing with varying pressure.
Step 6:Continue to adjust and test the sensitivity until it’s just where you like it.
The app saves your setting automatically.
Speaking of Surface sales: http://www.engadget.com/2015/04/23/microsoft-q3-2015-earnings/
"After a very slow start, Microsoft's Surface finally seems to be hitting its stride. The company made $713 million from Surface sales last quarter, a 44 percent jump over last year, according to its latest earnings report. And yes, it's attributing much of that to the Surface Pro 3, which also saw strong sales during the previous quarter."
When an American astronaut asked a Russian college how they tackled the problem, the Russian astronaut showed him a one cent pencil.