Apple's patent for an LCD display that also takes photos, video

Posted:
in iPhone edited January 2014
As rumors swirl over the possibility of a 3G iPhone with video conferencing capabilities, it may be of some interest to recall an earlier patent filing from Apple for an 'integrated sensing display' capable of serving as both a display screen and a digital camera.



The filing, which predates the iPhone's release by nearly three years, describes a new breed of LCD display that could simultaneously take photos while continuing its role as the primary display screen of an electronics device or computer monitor.



The idea behind the invention is to wedge thousands of microscopic image sensors between the LCD cells that make up the display, where each sensor would be responsible for capturing a piece of the overall photo. Those pieces would then be stitched together by software to recreate the complete image capture.



According to the filing, made back in June of 2004, the tiny image sensors could also have variable focal lengths in order to zoom and focus the image: "The lens might either be physically moved or have its properties altered. In the latter case, the lens might be made of a material that changes its refractive index in response to electrical stimulus or a magnetic field."



The filing has a newfound relevance given recent claims by Digg founder Kevin Rose that Apple's forthcoming iPhone revision will include a camera mounted on the face of the unit to coincide with a mobile version of iChat suited for handheld video conferencing.



While Rose's track-record on predicting Apple's future directions is akin to a hit or miss affair, the advent of video conference via iPhones is seemingly inevitable given time. Therefore his proposals, as well as those outlined in the patent, could potentially surface slightly further down the road should they not be part of Apple's more immediate plans.



Of particular interest in this regard, is the electronics maker's claims that 'integrated sensing displays' are ideally suited for video conferencing on handhelds, where the available real estate limits the number of components -- such as a front mounted cam in addition to a rear-mounted cam -- that can fit into the devices.



"A panel created from an integrated, embedded macro charge-coupled devices (CCD) would thus be able to both display and record visual information simultaneously, without the use of an external video capture device. Simply put, the same panel could display a video conference while also recording the participant sitting in front of it," the company said in the filing.



"A video panel that has an embedded macro CCD is no longer just a display. It can be used to transmit as well as receive visual information. One use and benefit for such a panel is video conferencing: a user can maintain eye contact with someone on screen because the camera is 'in' the screen. In addition, portable devices, such as portable digital assistants (PDAs) and cell phones, have very limited space for displays and would benefit if additional real estate were not used for a camera."







The patent filing was published by the United States Patent and Trademark Office in April of 2006 alongside three other filings pertaining to wireless iPods, iChat whiteboards, and virtual touch-screen keyboards -- technologies which were all later implemented in shipping Apple products.
«13

Comments

  • Reply 1 of 52
    Hmmm, VIdeo Conferencing?
  • Reply 2 of 52
    I wonder how power hungry that would be? The theory is excellent, but will it be something that we see as soon as the next gen iPhone? I hope so.
  • Reply 3 of 52
    Irony abounds. Apple has invented the telescreen.
  • Reply 4 of 52
    Man alive, I love technology!



    Things are getting more and more like Star Trek every day.
  • Reply 5 of 52
    Even on Star Trek they never saw communication images on the Tricoder.
  • Reply 6 of 52
    lukazlukaz Posts: 10member
    Is it possible that the current generation of iPhones (and perhaps the Touch too) ALREDY has this thing!?





    Gosh!









    "iPhone spanks competition to death"
  • Reply 7 of 52
    csimmonscsimmons Posts: 100member
    So the screen IS the front side camera.



    That's just sick.



    I love it.
  • Reply 8 of 52
    jeffdmjeffdm Posts: 12,951member
    Quote:
    Originally Posted by knadles View Post


    Irony abounds. Apple has invented the telescreen.



    There already were other things that did the job, this is just a specific implementation of it, which might do a better job for that task, but it breaks up the screen pattern to do it.
  • Reply 9 of 52
    olternautolternaut Posts: 1,376member
    Quote:
    Originally Posted by csimmons View Post


    So the screen IS the front side camera.



    That's just sick.



    I love it.



    Actually, a lot of star trek devices had this telescreen stuff......they didn't just have the audio communicators. Anybody remember tekwar? Those video communicators they had is EXACTLY what I'm looking for in the fabled apple tablet.



    Yup, micro-cams embedded in the screen itself. Technology is moving forward. Of course.....its being dragged, slowly, kicking and screaming. But at least its moving forward.
  • Reply 10 of 52
    irelandireland Posts: 17,798member
    I don't care for video conferring on a phone, frankly I rarely use it on my computer. An OLED screen excites me way more that any video conferencing capabilities.



    OLED with rich blacks and vivid colors and the addition of better battery life, and then 3G web speeds and a 32GB HD - that's mouth watering!
  • Reply 11 of 52
    maestro64maestro64 Posts: 5,043member
    When video conference first came to the computer world back in the late 80's and early 90's this whole idea of embedding the recording source into the playback source was investigated. The reason it died back then was the fact that people did not like the fact they might not know if someone could see their image when they did not want to. The whole 1984 concept that someone could be watching you.



    It a good idea since most people will be looking at the screen because the are viewing the other sides video so the other side will see them straight on and see their eyes. This is the biggest complaint about doing video conferencing on the computer most peoples cameras are not positioned correctly.
  • Reply 12 of 52
    lukazlukaz Posts: 10member
    Quote:
    Originally Posted by Ireland View Post


    I don't care for video conferring on a phone, frankly I rarely use it on my computer. An OLED screen excites me way more that any video conferencing capabilities.



    OLED with rich blacks and vivid colors and the addition of better battery life, and then 3G web speeds and a 32GB HD - that's mouth watering!



    What about an OLED with videoconferency?



    I'm serius, if my iPod Touch alredy has this thing (Apple patented it before the beginning of the iPhone Project), I'm going to freak out. First the 3-axis acelerometer (I didn't knew it was 3-axis) now this? What, does this thing also have hidden bluetooth in it?
  • Reply 13 of 52
    palegolaspalegolas Posts: 1,361member
    It looks really easy on paper with small black dots and all, but I don't have a clue of how well this could work out practically.

    And also, would all these microsensors capture "parallell light"? Making a photo with a really weird or no perspective?
  • Reply 14 of 52
    kennywrxkennywrx Posts: 141member
    They supposedly already have a translucent touch screen right... I would imagine they could put a camera behind it and process the image using a "backdrop" kind of effect to eliminate distortion due to the actual screen not being completely transparent.
  • Reply 15 of 52
    mstonemstone Posts: 11,510member
    Quote:
    Originally Posted by palegolas View Post


    It looks really easy on paper with small black dots and all, but I don't have a clue of how well this could work out practically.

    And also, would all these microsensors capture "parallell light"? Making a photo with a really weird or no perspective?



    It works just like the CheezIt commercial on TV. They load up a 400 mm Canon zoom lens in a catapult and fire it 300 meters at a big target with an iPhone fixed in the center and BOOM Camera Screen!
  • Reply 16 of 52
    Quote:
    Originally Posted by Ireland View Post


    I don't care for video conferring on a phone, frankly I rarely use it on my computer. An OLED screen excites me way more that any video conferencing capabilities.



    OLED with rich blacks and vivid colors and the addition of better battery life, and then 3G web speeds and a 32GB HD - that's mouth watering!



    Not to rain on the mouth-watering parade (I actually agree with you on all of the above) and not that they are mutually exclusive in any way, but I'd like to see cut-copy-paste and voice-activated dialing before anything else.



    Can't believe that it's a year and a quarter now, and Apple still hasn't implemented these two very basic features.
  • Reply 17 of 52
    thrangthrang Posts: 1,007member
    Quote:
    Originally Posted by anantksundaram View Post


    Not to rain on the mouth-watering parade (I actually agree with you on all of the above) and not that they are mutually exclusive in any way, but I'd like to see cut-copy-paste and voice-activated dialing before anything else.



    Can't believe that it's a year and a quarter now, and Apple still hasn't implemented these two very basic features.



    AGREED!



    I think Apple's decision NOT to offer voice dialing is marketing-driven. Despite the clear need to have this, remember that as soon as they introduce it, millions of iPhones will suddenly remain hidden in pockets, purses, briefcases, an belt clips. And right now, I think Apple wants those iPhone OUT in the OPEN as frequently as possible to garner as much attention as possible. But in reality, they are sacrificing sales and safety by not including this. Voice dialing is very important for a lot a people who make calls in their car, and forcing them to dial from the slippery brick means it will be either unsafe for them (and us fellow drivers) or it will be unsold (may father and wife, despite admiring my iPhone, won't buy for this reason alone).
  • Reply 18 of 52
    nagrommenagromme Posts: 2,834member
    Interesting concept. But a plain old off-the-shelf camera component seems like it does the job just fine.
  • Reply 19 of 52
    solipsismsolipsism Posts: 25,726member
    This could also be used for 3D image and video creation.
  • Reply 20 of 52
    SpamSandwichSpamSandwich Posts: 33,407member
    Just a reminder, Apple did not come up with the idea for this kind of camera-screen. I distinctly remember the introduction of a chip that had these properties years before the Apple patent was announced.



    Also, since the camera lens function would be essentially software based, I don't think the quality could even approach that of a lens. Any engineers care to comment?
Sign In or Register to comment.