Apple files for patents on laser-based head-mounted displays

[AppleInsider]

A new series of patent filings by Apple outlines attempts to modernize head-mounted displays (HMDs) that can be plugged into iPods or iPhones by decoupling the image generation components from the headsets themselves, which would pave the way for more lightweight and comfortable designs.

In the primary filing, the electronics maker notes that with most HMDs the displays and optics are typically embedded in the helmet, glasses, or a visor, which is worn by the user. However, this arrangement has several drawbacks, the company explains:

"For one, the displays and optics take up a lot of space. Thus, the HMD may be quite large and therefore unwieldy to use. The weight of these components may further exacerbate this problem. For another, the displays may generate a lot of heat and have large power needs, which again make the HMD difficult to construct and use."

Though there exist several different architectures for producing HMDs -- including transmissive, emissive, and reflective -- Apple's design calls for the use of a micro-electro-mechanical/laser-based architecture. Still, there are concerns associated with laser HMD designs, mainly that the devices can generate a lot of heat and require a large amount of power to operate. Furthermore, some laser technologies also have safety concerns, and thus need to be housed in special enclosures in order to prevent laser leakage.

"As should be appreciated, designing around these constraints and limitations add complexity and cost to the HMD," Apple said. "Moreover, they can make the HMD aesthetically unpleasing, which reduces sales of the HMD."

As such, the company suggests a HMD apparatus that separates the laser engine from the image generator via a fiber optic cable so that the laser engine can be physically decoupled from a headgear.



"By separating the laser engine, a more lightweight compact smaller head mounted display apparatus can be created," Apple said. "Furthermore, concerns over heat, power requirement and safety at the head mounted display apparatus are greatly diminished. Another aspect of the invention relates to utilizing wedge optics to display the video images. Wedge optics are very thin and therefore a low profile head mounted display apparatus can be created. Wedge optics also provide a very large picture."

The decoupled laser engine would be a portable unit that can be carried by the user, or "may include a strap, clip or other attachment means for coupling to the user or an article of clothing thereby making it easily transportable." In such a case, Apple notes that the "user simply wears the head mounted display apparatus that includes the imaging device and displays elements on their head, and attaches the laser engine to their person thereby keeping their hands free to do other tasks."



In the case where the display elements of the HMD are formed from transparent optical materials, the user would also be free to be mobile when images aren't being displayed. For example, the user would be able see through the display unit similar to traditional eye glasses. The decoupled laser engine would not be particularly power hungry and thus could be powered by a small battery rather than a power cable, allowing the user to be free to move anywhere they like.

"In one example of this embodiment, a user simply plugs their handheld video player such as the iPod manufactured by Apple Computer of Cupertino, Calif., into the compact laser engine attached to their belt, and places the headset on their head," Apple said. "The user then selects a video to be played at the handheld video player (viewing through transparent display elements). Once selected, the handheld video player generates a video signal which is processed into synchronized light control signals and image control signals for use by the laser engine and imaging device."



"In essence," the company continued, "the laser engine and imaging device work together to create dual video images in accordance with the video signal being outputted by the handheld video player. Furthermore, the display unit receives the dual video images from the imaging device and presents them for viewing. When video is not being played, no images are being created and thus the display unit act just like glasses. In fact, the head set may further include optical components that are based on the user' eyesight so they can see normally when the system is not operating. Thus, the user is able to select other video for playing without taking off the head gear. If the laser engine further includes a battery, the user can be very mobile while utilizing and wearing the system 50 (e.g., not limited to the length of a power cord)."

Additionally, the fiber optic cable coupling the detached laser engine to the headgear could also be configured to include an audio line that provides audio signals in parallel with the video images. As such, the head mounted display apparatus may include integrated earphones capable of transmitting audio signals to the user's ears. The audio line could be an electrical line or an optical line, Apple said. "In some cases, the optical line used to transmit the RGB laser light is also used to send audio signals (e.g., multifunctionality)."



The iPod maker goes on to note that various enhancements may be applied to further improve its HMD concept. For example, the HMD may provide methods and apparatus for providing a wider field of view and creating a more natural viewing situation for a user of a head mounted display, which results in improved comfort and usability for head mounted displays.

The Apple HMD may also provide methods and apparatus for treating the peripheral area of a user's field of view in a head mounted display, and thereby creating improved comfort and usability for head mounted displays.

All three of the related filings are credited to Apple employee John Tang, with Apple iPod chief Anthony Fadell providing some input on the peripheral treatment filing.

[ View this article at AppleInsider.com ]

[Taylorman]

I love that Apple may come up with something like this one day. I know that there is at least one other company that sells "video glasses" through Sharper Image- and those airline magazines- that also runs off a video iPod. I"m assuming the big difference here is that Apple's version would be less bulky (and probably much better looking). Does anyone know anything about patents- and could explain a little more what exactly is being protected in what Apple is describing? I"m just curious- it always seems like the patent drawing and description have lots of 'black box' areas or parts where something magically happens to get whatever the thing is to work.

[JeffDM]

Originally Posted by Taylorman

I love that Apple may come up with something like this one day. I know that there is at least one other company that sells "video glasses" through Sharper Image- and those airline magazines- that also runs off a video iPod. I"m assuming the big difference here is that Apple's version would be less bulky (and probably much better looking). Does anyone know anything about patents- and could explain a little more what exactly is being protected in what Apple is describing? I"m just curious- it always seems like the patent drawing and description have lots of 'black box' areas or parts where something magically happens to get whatever the thing is to work.

I don't see that here, it looks pretty clear to me. But it also looks like an adaptation of DLP to goggles.

[Bergermeister]

Dang, when I first read the headline I thought Apple was working on re-inventing the first-person shooter game.

Oh, well. Need some sleep.

[chadisawesome]

I don't think you could possibly look worse in public than wearing one of those

[Booga]

All I want is frikkin geeks with frikkin laser beams attached to their foreheads! Is that so much to ask!!

[solipsism]

Originally Posted by Booga

All I want is frikkin geeks with frikkin laser beams attached to their foreheads! Is that so much to ask!!

[quinney]

Originally Posted by AppleInsider

"In essence," the company continued, "the laser engine and imaging device work together to create dual video images in accordance with the video signal being outputted by the handheld video player. Furthermore, the display unit receives the dual video images from the imaging device and presents them for viewing.

Dual images eh? So could it display 3D if the video images were
created that way?

[Buck]

So how's the system going to adjust to your eye's lens following different objects? In other words it should have a focusing mechanism that knows if you look at something 2 feet or 2 miles away.

[EagerDragon]

Originally Posted by chadisawesome

I don't think you could possibly look worse in public than wearing one of those

They will come in Elton John approved styles, LOL.

[solipsism]

Originally Posted by chadisawesome

I don't think you could possibly look worse in public than wearing one of those

Not worse, but pretty damn close.

• http://www.myvu.com/Products/soloplus/

I really want to try it out first before I buy it and would like it to work with my iPhone without going into Airplane mode, though I plan to mainly use it while flying, but I may finally give in and buy it.

[801]

Umm, you suppose that Steve Jobs Gulfstar jet gets those AirMall catalogs stuffed into the seatbacks, do you?

And, as he is flying along in corporate comfort, he is sitting there looking at these devices thinking that they look like a good idea?

Or maybe the kids are getting antsy, jumping up and down in their seats at 35,000 feet, bugging him for them? I can just see it now...


Kids (togeather): Are the only movies on this plane pixar movies? We seen them all a million times. We want High School Musical. Wha!

Laurene - Their right Steve, and I feel the same way. I can't take it anymore. If it wasn't for Pirates of Silicon Valley, I would have lost my mind long ago on these trips. Look here, (handing him the airmall catalog) glasses that have movies screens on them, with these, everyone could watch what they want and not distrurb the people sitting next to them.

Steve - (turning and swatting at the rugrats with his weekly report)
"OK, OK, enough already, I'll get the optical engineering department on it right away, now will you please sit down.

Kids (togeather)" Yea!"
The kids start chanting loudly togeather:
" Just -one - more- thing! Just -one - more - thing!"

Steve turns to Laurene: (Shaking his head)" Honey, I just don't gronk them sometimes."

(Applause over kids chanting, Fade , pull away shot from Steves face in the window of the jet.)

[melgross]

Originally Posted by chadisawesome

I don't think you could possibly look worse in public than wearing one of those

Yeah, like having an earphone and microphone sprouting from the side of your head, while you walk around talking to yourself.

No one would be stupid enough to do that.

[melgross]

Originally Posted by Buck

So how's the system going to adjust to your eye's lens following different objects? In other words it should have a focusing mechanism that knows if you look at something 2 feet or 2 miles away.

That can be done.

For over ten years, Canon has had follow focus in some of their cameras that knows where in the viewfinder you are looking, and has the camera focus where you are looking.

Whether they have a patent on that I don't know.

[g5man]

Originally Posted by melgross

Yeah, like having an earphone and microphone sprouting from the side of your head, while you walk around talking to yourself.

No one would be stupid enough to do that.

[mdriftmeyer]

Originally Posted by solipsism

Not worse, but pretty damn close.

• http://www.myvu.com/Products/soloplus/

I really want to try it out first before I buy it and would like it to work with my iPhone without going into Airplane mode, though I plan to mainly use it while flying, but I may finally give in and buy it.

Well, frack me.

[zanshin]

Originally Posted by melgross

That can be done.

For over ten years, Canon has had follow focus in some of their cameras that knows where in the viewfinder you are looking, and has the camera focus where you are looking.

Whether they have a patent on that I don't know.

Shoot, we had heads-up guidance that steered missiles to target by following where the WO's eyes looked during fly-by in the early 70s.

[ascii]

Ahh.. Apple is moving ahead with their new iCyborg strategy. Apple in your den, your pocket, your car and ... your body

Speaking of cyborgs if they could figure out how to feed images directly in to the visual cortex you wouldn't need to lug all that laser gear around. But that's the next-next generation.

[andypullen]

iGoggles

[coffeetime]

Bono would be a natural.

[zanshin]

Originally Posted by coffeetime

Bono would be a natural.

[Cubert]

YESSSS!

Sharks with frickin' laser beams on their heads cannot be far behind!

[Cubert]

Booga,
A brother from a different mother.

[fizzboy]

Originally Posted by andypullen

iGoggles

Nope. iGlasses.

[melchman]

Originally Posted by ascii

Ahh.. Apple is moving ahead with their new iCyborg strategy. Apple in your den, your pocket, your car and ... your body

Speaking of cyborgs if they could figure out how to feed images directly in to the visual cortex you wouldn't need to lug all that laser gear around. But that's the next-next generation.

That research is just entering the cranium now...
http://www.pinktentacle.com/2008/04/...ers-the-skull/

[SpamSandwich]

There is just no bloody way I'm strapping on an HMD just to listen to my music. This is a preemptive patent filing by Apple, to keep their options open, but I think it's a really dumb one.

[palomine]

Quote:
Originally Posted by andypullen

iGoggles
Nope. iGlasses.

Nope.

ieyes!

[JeffDM]

Originally Posted by SpamSandwich

There is just no bloody way I'm strapping on an HMD just to listen to my music. This is a preemptive patent filing by Apple, to keep their options open, but I think it's a really dumb one.

I don't get it, you wouldn't need a video display to listen to music.

[phenocopy]

Originally Posted by JeffDM

I don't get it, you wouldn't need a video display to listen to music.

A decent HMD would be great for using a laptop when commuting (e.g on the train) since it is terrible posture to bend your neck to look at the screen.

[Crtaylor]

I think something like this is totally impractical! If you were listening and watching, you wouldn't even notice anything around you. Let's just hope Apple abandons this right away!

[quinney]

Originally Posted by Crtaylor

I think something like this is totally impractical! If you were listening and watching, you wouldn't even notice anything around you.

Which would be OK commuting on the train or bus, or sitting on a long airplane flight,
or sitting in a boring lecture or sermon, or a chick movie your old lady dragged you to.

[Walter Slocombe]

Originally Posted by Crtaylor

I think something like this is totally impractical! If you were listening and watching, you wouldn't even notice anything around you. Let's just hope Apple abandons this right away!

Ahh! you so right, thats why people are easier to mug when they have headphones on, and we all know what a failure headphones are!

[userone]

Originally Posted by melgross

Yeah, like having an earphone and microphone sprouting from the side of your head, while you walk around talking to yourself.

No one would be stupid enough to do that.

This is possibly part of a gestural computing initiative, so it is likely to be accompanied by some kind of 'robot dance'.

[Clive At Five]

-Clive

[Dunks]

The arrangement of reflective surfaces in that is pure genius. The light travels from a narrow angle at the bridge of the nose out to the temples then is reflected twice then onto the internal surface of the tapered proximal lens.

[Dunks]

Originally Posted by Clive At Five

-Clive

Ha ha I love it.

[melgross]

Originally Posted by zanshin

Shoot, we had heads-up guidance that steered missiles to target by following where the WO's eyes looked during fly-by in the early 70s.

I don't remember that. Do you have a reference?

[vinea]

Originally Posted by melgross

I don't remember that. Do you have a reference?

VTAS. In operational F4s by...um...late 60s early 70s. More head tracking than eye tracking but since the reticle is a known position relative to the helmet you know where the pilot must be looking. The helmet mounted unit generates a collimated virtual reticle image in a known location that is superimposed on the target aircraft and so the airplane knows which target is the one to shoot at.

AN/AVG-6? Maybe 8? Something like that. Sorry too lazy to google at the moment.

[melgross]

Originally Posted by vinea

VTAS. In operational F4s by...um...late 60s early 70s. More head tracking than eye tracking but since the reticle is a known position relative to the helmet you know where the pilot must be looking. The helmet mounted unit generates a collimated virtual reticle image in a known location that is superimposed on the target aircraft and so the airplane knows which target is the one to shoot at.

AN/AVG-6? Maybe 8? Something like that. Sorry too lazy to google at the moment.

I remember that about that time they were doing itwith sensors on the helmet. But, that's much more primitive.

As far as I know, Canon was the first to release this as a commercial product. With the military, we don't always know until some time later.

[vinea]

Originally Posted by melgross

I remember that about that time they were doing itwith sensors on the helmet. But, that's much more primitive.

As far as I know, Canon was the first to release this as a commercial product. With the military, we don't always know until some time later.

Yes, it is more primitive. But the process is evolutionary from the first primitive systems to what we have today. The first FLIR systems were also in Vietnam. The first wire guided missiles in WWII.