Apple's Cover Flow-like 3D desktop UI uses tilt controls to peek around windows
Apple is looking into a new desktop user interface that puts two- and three-dimensional application windows in a unique browsable "parade" view, much like the company's Cover Flow GUI used in iTunes and iOS apps.
Source: USPTO
The U.S. Patent and Trademark Office on Tuesday awarded Apple U.S. Patent No. 8,560,960 for "Browsing and interacting with open windows," which at first blush appears to be a modified solution that brings Cover Flow to the desktop. Deeper in the document, however, is language describing a fresh take on usability that implements a secondary mode of input more akin to controls used in an iOS device.
According to the patent's detailed description, a user can tilt the computer to present the three-dimensional desktop "with a raised view level, such that desktop items behind the browsable parade are revealed." This action not only allows for a more immersive interactive experience, but increases viewable desktop space and aids in navigating the UI.
While the current OS X desktop is already somewhat "3D," with drop shadows and other graphical tricks providing an illusion of depth, Tuesday's invention further pushes these established boundaries.
A conventional desktop displays two-dimensional windows and icons on a substantially flat background. Users interact with these on-screen items via a given mode on input, such as clicking on a window to make it active. This means the visible area for presenting windows, icons, and other UI elements is constrained by the size of a device's screen.
Illustration of two-dimensional desktop environment.
As noted in the patent, 3D desktops offer more perceived space with the introduction of a z-axis, but manipulating graphical assets within these environments has proven too complex for previously proposed systems. Apple itself experimented with such techniques in the past, though the technology has yet to be applied to OS X.
To work around the hurdles, the invention proposes an operating system that can seamlessly switch between two-dimensional and three-dimensional environments. In two-dimensions, a user can invoke the familiar expose mode to see all open windows in a tiled view. Alternatively, in a three-dimensional environment, a user can invoke a Cover Flow or "parade" viewing mode, browsable by flipping through active windows.
Illustration of three-dimensional desktop space.
When in 3D mode, the individual application windows act much like their current OS X counterparts. For example, when a window is made active, that application's menu bar is provided directly below the system menu bar. Further, when new windows are opened, the UI places the assets in a stack that can be reshuffled, resized or moved by the user.
Aside from the Cover Flow capabilities, Apple's invention uses two inputs to control the window parade. This is accomplished with conventional computer inputs, like a mouse and keyboard, working in concert with tilt controls. While not specifically explained in the patent, tilting of a device can be recognized by an accelerometer, gyroscope, camera or any other suitable on-board sensor. Alternatively, a tilt command can be invoked via a special key combination or gesture.
Illustration of tilted three-dimensional desktop with active windows.
By tilting the three-dimensional desktop space, users can view an entire group of open windows in the parade from a higher view point. Content previously obscured by an active top window is made viewable, allowing users to select another window without cycling through all open assets.
It is unclear if Apple will implement the Cover Flow window invention in a future version of OS X, but a similar technique uses iOS device sensors to create the "parallax effect" seen in iOS 7.
Apple's three-dimensional GUI patent was first filed for in 2010 and credits Thomas Goossens and Fabrice Robinet as its inventors.
Source: USPTO
The U.S. Patent and Trademark Office on Tuesday awarded Apple U.S. Patent No. 8,560,960 for "Browsing and interacting with open windows," which at first blush appears to be a modified solution that brings Cover Flow to the desktop. Deeper in the document, however, is language describing a fresh take on usability that implements a secondary mode of input more akin to controls used in an iOS device.
According to the patent's detailed description, a user can tilt the computer to present the three-dimensional desktop "with a raised view level, such that desktop items behind the browsable parade are revealed." This action not only allows for a more immersive interactive experience, but increases viewable desktop space and aids in navigating the UI.
While the current OS X desktop is already somewhat "3D," with drop shadows and other graphical tricks providing an illusion of depth, Tuesday's invention further pushes these established boundaries.
A conventional desktop displays two-dimensional windows and icons on a substantially flat background. Users interact with these on-screen items via a given mode on input, such as clicking on a window to make it active. This means the visible area for presenting windows, icons, and other UI elements is constrained by the size of a device's screen.
Illustration of two-dimensional desktop environment.
As noted in the patent, 3D desktops offer more perceived space with the introduction of a z-axis, but manipulating graphical assets within these environments has proven too complex for previously proposed systems. Apple itself experimented with such techniques in the past, though the technology has yet to be applied to OS X.
To work around the hurdles, the invention proposes an operating system that can seamlessly switch between two-dimensional and three-dimensional environments. In two-dimensions, a user can invoke the familiar expose mode to see all open windows in a tiled view. Alternatively, in a three-dimensional environment, a user can invoke a Cover Flow or "parade" viewing mode, browsable by flipping through active windows.
Illustration of three-dimensional desktop space.
When in 3D mode, the individual application windows act much like their current OS X counterparts. For example, when a window is made active, that application's menu bar is provided directly below the system menu bar. Further, when new windows are opened, the UI places the assets in a stack that can be reshuffled, resized or moved by the user.
Aside from the Cover Flow capabilities, Apple's invention uses two inputs to control the window parade. This is accomplished with conventional computer inputs, like a mouse and keyboard, working in concert with tilt controls. While not specifically explained in the patent, tilting of a device can be recognized by an accelerometer, gyroscope, camera or any other suitable on-board sensor. Alternatively, a tilt command can be invoked via a special key combination or gesture.
Illustration of tilted three-dimensional desktop with active windows.
By tilting the three-dimensional desktop space, users can view an entire group of open windows in the parade from a higher view point. Content previously obscured by an active top window is made viewable, allowing users to select another window without cycling through all open assets.
It is unclear if Apple will implement the Cover Flow window invention in a future version of OS X, but a similar technique uses iOS device sensors to create the "parallax effect" seen in iOS 7.
Apple's three-dimensional GUI patent was first filed for in 2010 and credits Thomas Goossens and Fabrice Robinet as its inventors.
Comments
If they have a tabbed finder in Mavericks why not cover low the tabs? Sound like a great idea!
[IMG ALT=""]http://forums.appleinsider.com/content/type/61/id/33410/width/500/height/1000[/IMG]
[IMG ALT=""]http://forums.appleinsider.com/content/type/61/id/33411/width/500/height/1000[/IMG]
source: http://www.patentlyapple.com/
and they have a worthy footnote:
[quote]
Readers should be aware that every Tuesday the US Patent and Trademark Office publish Apple's Granted Patents. Granted patents are approved patent applications that Apple applied for months or even years ago. In the vast majority of cases, "granted patents" aren't covering any new kind of technology on the day the patent is being granted. New Apple technologies are generally revealed on Thursdays by the US Patent Office in the form of published patent applications. Some Mac sites confuse this process by making claims and presenting bylines on Tuesday that insinuate that Apple has just revealed a new technology or process. In 99% of cases, this is simply untrue and readers should be made aware of this fact. Known exceptions would include patents that were recently acquired by Apple or a domestic and/or foreign patent application that Apple had never presented in the US before under its own brand name.
[/quote]
This is a rip off of Compiz in Linux. Been there done that. It's cool but requires a lot of horsepower.
As for practical implications, imagine sitting on a train with a laptop perched on your lap, jiggling all over the place; or even the laptop on a table but on one of those tilting trains that lean into corners, thus activating a tilt mechanism on the laptop so you are constantly flicking between 2D and 3D views...
I do wish Apple would focus on useful features again.
1) It's a patent, not a product.
2) Knowing Apple, they test these things for various scenarios.
3) When did they stop focussing on useful features?
And iTunes, much to my dismay.
Obviously your statement is patently false (no pun intended), because HERE’S A PATENT THEY’VE BEEN GRANTED THAT STATES OTHERWISE.
Geez, how stupid a statement can you make? And no, that’s not a challenge.
Man, multitouch… what a gimmick, eh?
Which is also likely a rip off on Sun's Project Looking Glass http://www.freedesktop.org/software/XDevConf/LG-Xdevconf.pdf
Two words: Compiz, Linux.
Two words: Look up.
The full range of practical use cases. Everything from trains to tilting trains.
Fixed it for you. /s
Windows Vista and 7 had "Flip 3D", which looks similar..
http://en.wikipedia.org/wiki/Features_new_to_Windows_Vista#Windows_Flip_and_Flip_3D
Its been pulled from Windows 8 though - can't say I miss it! lol