Future iPhones may shift camera sensor to take perfect pictures with clip-on lenses
Camera accessories that attach to an iPhone or iPad could work better in the future, as Apple is considering ways to adjust a mobile device's camera to make shots taken through the extra external lens look great.
Accessories like those from Olloclip and other third-party producers provide customers with ways to make the camera included in iPhones and iPads better, usually in the form of putting additional lenses in front of the camera to change the photograph. While this can help create effects not normally possible on an iPhone, such as extending the zoom or widening the field of view, errors in physically attaching it to the device, such as failing to center it on the lens, could cause some unwanted results.
Granted on Tuesday by the U.S. Patent and Trademark Office, the patent for "Adapting camera systems to accessory lenses" was originally filed in August 2016, and attempts to fix such issues using a combination of methods.
Apple's suggestion includes a lens system, a photosensor, camera control, image analysis, and image processing software, which can be used to analyze the picture quality and detect problems. The analysis element would look at the focus, sharpness, relative illumination, optical distortion, chromatic aberration, magnification, vignetting, and other metrics to see how the image has changed from existing results for the stock camera lens.
A part of the same system, actuators could change the physical location of the camera itself on multiple axes based on the results of the analysis, in order to properly line itself up with the center of the accessory's lens. In theory, this could include tilting the camera if the accessory is fitted at an angle, and in some cases could be moved closer or further away from the accessory's lens.
While this can be performed by the camera detecting an accessory, Apple suggests other ways can be used to determine if an accessory is attached, including electronics, magnets, and radio sensing. In the case where the device knows what specific accessory is attached, this could be used to enable extra options in the camera interface, giving users more ways to interact with the add-on hardware.
Apple regularly files patent applications with the USPTO, and the publication of an application or granting of a patent is not necessarily a sign that Apple is actively working on introducing the technology in its consumer products.
In this case, such a system seems fairly plausible to add to an iPhone or iPad, as some of the elements are already in place. Aside from the software-based image analysis that could be processed on a mobile device, Apple does use mechanical optical image stabilization systems that help produce sharp images with minimal motion blur.
While it would be a stretch to adjust the tilt of the lens using an existing OIS system, its ability to make minor adjustments to the camera sensor's position could feasibly be useful for the final lining-up of the camera's lens with the center of the accessory, if it is almost perfectly placed from the start.
Accessories like those from Olloclip and other third-party producers provide customers with ways to make the camera included in iPhones and iPads better, usually in the form of putting additional lenses in front of the camera to change the photograph. While this can help create effects not normally possible on an iPhone, such as extending the zoom or widening the field of view, errors in physically attaching it to the device, such as failing to center it on the lens, could cause some unwanted results.
Granted on Tuesday by the U.S. Patent and Trademark Office, the patent for "Adapting camera systems to accessory lenses" was originally filed in August 2016, and attempts to fix such issues using a combination of methods.
Apple's suggestion includes a lens system, a photosensor, camera control, image analysis, and image processing software, which can be used to analyze the picture quality and detect problems. The analysis element would look at the focus, sharpness, relative illumination, optical distortion, chromatic aberration, magnification, vignetting, and other metrics to see how the image has changed from existing results for the stock camera lens.
A part of the same system, actuators could change the physical location of the camera itself on multiple axes based on the results of the analysis, in order to properly line itself up with the center of the accessory's lens. In theory, this could include tilting the camera if the accessory is fitted at an angle, and in some cases could be moved closer or further away from the accessory's lens.
While this can be performed by the camera detecting an accessory, Apple suggests other ways can be used to determine if an accessory is attached, including electronics, magnets, and radio sensing. In the case where the device knows what specific accessory is attached, this could be used to enable extra options in the camera interface, giving users more ways to interact with the add-on hardware.
Apple regularly files patent applications with the USPTO, and the publication of an application or granting of a patent is not necessarily a sign that Apple is actively working on introducing the technology in its consumer products.
In this case, such a system seems fairly plausible to add to an iPhone or iPad, as some of the elements are already in place. Aside from the software-based image analysis that could be processed on a mobile device, Apple does use mechanical optical image stabilization systems that help produce sharp images with minimal motion blur.
While it would be a stretch to adjust the tilt of the lens using an existing OIS system, its ability to make minor adjustments to the camera sensor's position could feasibly be useful for the final lining-up of the camera's lens with the center of the accessory, if it is almost perfectly placed from the start.
Comments
giving the optical specs. Out to manufacturers would also help in their design work. There are some very good lenses for the iPhone out there, but they require cases, or clip-on mounts that either shift, or are clumsy. I’ve got a number of these things.
I’m also curious if they are working on a 3 lense system.
Another exciting area is computational photography as is done with the two lenses used together.
I read earlier this year that Apple has around a thousand people that work on computational photography (Jean-Louis Gassée’s Monday Note blog—former Apple exec, BE OS founder and very smart guy). That’s much more than Canon, Nikon or Sony can afford to invest.
Apple is very serious about photography and AR. Since their pipelines for products can be as much as 5 to 7 years, believe Tim Cook when he says AR is going to be a big deal.
i love to pixel peep as much as the next guy. But, when you get to real photos in print, the differences just melt away. Ten years ago, we could see differences in print, from high quality commercial ink jet. But even then, when going four color, it was almost impossible to tell. The same thing is true now, though it’s even more difficult.
all cameras from about three years ago far exceed the limits of four color printing, and even the best inkjet printing. Even websites, using sRGB, which is the standard for the internet, have problems showing the differences between the newest models. I’ll take my 5Dmk IV any day.
If I remember right, Sony uses Zeiss lenses, doesn't it? What does Apple use? Their own? Someone else's (e.g., Huawei and Leica)?