or Connect
AppleInsider › Forums › Mobile › iPhone › Apple exploring motion-based 3D user interface for iPhone
New Posts  All Forums:Forum Nav:

Apple exploring motion-based 3D user interface for iPhone

post #1 of 23
Thread Starter 
Apple has shown interest in developing a new user interface for the iPhone that relies less on the device's touchscreen, and more on manipulating a 3D environment with motion controls.

The concept was revealed this week in a new patent application discovered by AppleInsider and entitled "Sensor Based Display Environment." It describes a three-dimensional display environment that uses orientation data from onboard sensors, like a gyroscope and compass, to navigate the system.

In the application, Apple notes that problems can occur when using a 3D user interface with a touchscreen. The application refers to 3D as polygons on the screen of a traditional iPhone, rather than the "illusion" of 3D by sending two different images to each eye with a new, special display.

"Due to the limited size of the typical display on a mobile device, a 3D GUI can be difficult to navigate using conventional means, such as a finger or stylus," the filing reads. "For example, to view different perspectives of the 3D GUI, two hands are often needed: one hand to hold the mobile device and the other hand to manipulate the GUI into a new 3D perspective."

Apple could remove the need to touch the screen entirely by using orientation data from onboard sensors to determine a "perspective projection of the 3D display environment." Examples of this kind of interaction can be seen with augmented reality applications, or using the gyroscope to view a location with Google Street View in the iOS Maps application.

But Apple's concept would take the idea much further, potentially offering users the ability to navigate the device using motion. In one illustration, the iPhone is shown with a home screen featuring a floor, back wall, ceiling and side walls.

Users would navigate the iPhone by picturing the display as an "imaginary camera viewfinder" offering a glimpse into a digital world. By moving the imaginary viewfinder around, the orientation of the iPhone would determine what is displayed to the user on the screen.




As users look about their virtual room, a number of objects can be placed on the floor, walls, ceiling and even behind them. These objects could be selected and would allow users to navigate the device.

The filing also makes note of a "snap to" feature that could make navigation a quicker process. By doing a preset action, such as shaking the iPhone, the view could automatically "snap to" a predetermined camera view of the 3D user interface.

The proposed invention, made public this week by the U.S. Patent and Trademark Office, was first filed in July of 2010. It is credited to one inventor: Patrick Piedmonte.
post #2 of 23
If you want to know the weather forecast, look up at the sky with the phone in the way
post #3 of 23
This is a great concept because it allows people to organize their digital life just like there physical life. In my case, everything would be on a pile on the floor...
post #4 of 23
Second Life comes to IOS
Been using Apple since Apple ][ - Long on AAPL so biased
nMac Pro 6 Core, MacBookPro i7, MacBookPro i5, iPhones 5 and 5s, iPad Air, 2013 Mac mini, SE30, IIFx, Towers; G4 & G3.
Reply
Been using Apple since Apple ][ - Long on AAPL so biased
nMac Pro 6 Core, MacBookPro i7, MacBookPro i5, iPhones 5 and 5s, iPad Air, 2013 Mac mini, SE30, IIFx, Towers; G4 & G3.
Reply
post #5 of 23
This is why Apple own apps tend to look like real life object. So when they decide to go this route the user will be at ease handling iCal or Address Book on the desktop.
post #6 of 23
Quote:
Originally Posted by jkichline View Post

This is a great concept because it allows people to organize their digital life just like there physical life. In my case, everything would be on a pile on the floor...

I wonder will my screen be as messy as my room? Ha!
post #7 of 23
This seems odd. Will I have to turn in circles to see different parts of my GUI?

I was imagining very different things coming to this article...
post #8 of 23
Seems logical. Have been reading up on the power of the Games Everywhere Interface movement.

If you have a Toyota Hybrid you will understand what I mean. If interested check out the TED talk :
http://www.ted.com/talks/lang/en/tom...the_brain.html
post #9 of 23
Good way to justify the presence of gyroscope into iPhones ... I always found it was under utilized ...
post #10 of 23
I can't imagine ever using such a function. Turning on myself, or rotating the phone seem very impractical and gimmicky.
post #11 of 23
Quote:
Originally Posted by ClemyNX View Post

I can't imagine ever using such a function. Turning on myself, or rotating the phone seem very impractical and gimmicky.

I don't think it will happen either. The phone will stick with touchscreen. Maybe when the iPhone has evolved in to iGlasses, and there is no touchscreen, and all you can do is turn your head, these kind of UI will start to emerge.
post #12 of 23
This looks like a desktop replacement Bumptop. I used to use it for my Mac, but it was originally for Windows. It was awesome...it added dimensions and physics to my desktop. It was much more useful than I thought it would be.

But Google bought them a couple of years ago and stopped updating it. And just like about half of the software on my Mac after Lion it just stopped working right. I just wish Mission Control worked.
post #13 of 23
Quote:
Originally Posted by ClemyNX View Post

I can't imagine ever using such a function. Turning on myself, or rotating the phone seem very impractical and gimmicky.

I just imagine a packed city bus at rush hour with roughly 50% of the people having an iPhone and every one is turning and bending in all sorts of directions to pick up some virtual items in their virtual rooms .
post #14 of 23
Quote:
Originally Posted by j2-core View Post

This looks like a desktop replacement Bumptop. I used to use it for my Mac, but it was originally for Windows. It was awesome...it added dimensions and physics to my desktop. It was much more useful than I thought it would be.

But Google bought them a couple of years ago and stopped updating it. And just like about half of the software on my Mac after Lion it just stopped working right. I just wish Mission Control worked.

What is the half of software on your machine that doesn't work?
post #15 of 23
Quote:
Originally Posted by burtonman View Post

What is the half of software on your machine that doesn't work?

He just bought a new Mac after coming off a System 7 computer and he's confused why Clarisworks 1.0 doesn't work for him anymore.

Originally Posted by Slurpy

There's just a TINY chance that Apple will also be able to figure out payments. Oh wait, they did already… …and you’re already fucked.

 

Reply

Originally Posted by Slurpy

There's just a TINY chance that Apple will also be able to figure out payments. Oh wait, they did already… …and you’re already fucked.

 

Reply
post #16 of 23
I am suing Apple for causing motion sickness induced by this interface.
post #17 of 23
Quote:
Originally Posted by ascii View Post

I don't think it will happen either. The phone will stick with touchscreen. Maybe when the iPhone has evolved in to iGlasses, and there is no touchscreen, and all you can do is turn your head, these kind of UI will start to emerge.

gotta agree.
post #18 of 23
Quote:
Originally Posted by brutus009 View Post

This seems odd. Will I have to turn in circles to see different parts of my GUI?

I was imagining very different things coming to this article...

it would certainly have very limited usefulness as described in the article.

For that reason and other cues, I think the author has this completely wrong. This reads to me much more like a way of navigating a (real) internal space like an Apple store or of navigating a virtual reality Apple store that maps to a real space.

As a GUI to navigate one's phone it makes no sense at all. One obvious flaw being that there is no place to go on a phone that has no file system. The only "spaces" are the home screens and navigating them in 3D would seem to offer no advantages versus the 2D method we have now and yet have significant drawbacks attached.
post #19 of 23
Quote:
Originally Posted by Prof. Peabody View Post

it would certainly have very limited usefulness as described in the article.

For that reason and other cues, I think the author has this completely wrong. This reads to me much more like a way of navigating a (real) internal space like an Apple store or of navigating a virtual reality Apple store that maps to a real space.

As a GUI to navigate one's phone it makes no sense at all. One obvious flaw being that there is no place to go on a phone that has no file system. The only "spaces" are the home screens and navigating them in 3D would seem to offer no advantages versus the 2D method we have now and yet have significant drawbacks attached.

Agreed...and that would be awesome...more gimmicky than necessary but still useful...IMO.

Apple stores already have great signage and whatnot. But I guess extra data not displayed could be shown on the augmented reality store to save you from having to ask questions...etc.

hmmm...maybe not so gimmicky.
post #20 of 23
Quote:
Originally Posted by Prof. Peabody View Post

As a GUI to navigate one's phone it makes no sense at all. One obvious flaw being that there is no place to go on a phone that has no file system. The only "spaces" are the home screens and navigating them in 3D would seem to offer no advantages versus the 2D method we have now and yet have significant drawbacks attached.

duh?
a file system isn't more inherently spatial than any other data structure.



Quote:
Originally Posted by 801 View Post

Seems logical. Have been reading up on the power of the Games Everywhere Interface movement.

If you have a Toyota Hybrid you will understand what I mean. If interested check out the TED talk :
http://www.ted.com/talks/lang/en/tom...the_brain.html

Yep I know about that movement and everytime I come across their ideas I get utterly depressed.
The talk you linked, while interesting, gave me again the same feelings. It seems I'm getting old...
post #21 of 23
Quote:
Originally Posted by ClemyNX View Post

I can't imagine ever using such a function. Turning on myself, or rotating the phone seem very impractical and gimmicky.

Have you tried the Star Walk app? It'll give you an idea of how this would work.
post #22 of 23
Something different (without the possibility to change anything else then the viewangle) but with a similarity:

http://www.youtube.com/watch?v=Jd3-eiid-Uw

And in some iOS-Apps this Pseudo-3D-Effect was used.
- i3D (with Face Recognition)
- MP3D (Smooth - Album Covers in 3D Space)
- Gun Range (Game)
and more

and sort of in all apps with augmented Reality
(just type "augmented reality" in iTunes / App Store)

Greetings,
Soul71 / Matthias
post #23 of 23
Quote:
Originally Posted by coffeetime View Post

Have you tried the Star Walk app? It'll give you an idea of how this would work.

We are talking UI here, not stargazing.

Quote:
Originally Posted by Rabbit_Coach View Post

I just imagine a packed city bus at rush hour with roughly 50% of the people having an iPhone and every one is turning and bending in all sorts of directions to pick up some virtual items in their virtual rooms .

My exact thought.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: iPhone
AppleInsider › Forums › Mobile › iPhone › Apple exploring motion-based 3D user interface for iPhone