Inside iPhone 4: Gyro spins Apple ahead in gaming

Posted:
in iPhone edited January 2014
Apple appears to have inadvertently discovered mobile gaming as a killer app for the iPod touch last year, but iOS 4's Game Center and the new iPhone 4's new gyroscope indicate the company is ready to lead mobile gaming as a competitive opportunity.



On stage at WWDC, chief executive Steve Jobs was expected to have little new to show about iPhone 4, given that a prototype version had been stolen and publicly dissected weeks before the event. Fortunately for Apple, most of its key details weren't grasped by the prototype's leakers.



Nothing about the new Retina Display was leaked apart from the fact that the new phone appeared to have a much higher resolution display, something everyone expected anyway. Leaks only assumed the presence of an A4 brain and faster 802.11n WiFi. Additionally, nobody guessed that the stainless steel shell would double as an antenna system for WiFi, Bluetooth, GPS and 3G. The leak also didn't anticipate any details of Apple's standards-based FaceTime video calling.



The biggest secret however might have been the new phone's gyroscope, a feature that beat to market the fancy phones from Nokia's Symbian and Google's Android. Few who bought into Android phones from Verizon and Sprint over the past six months will be ready to pay up to $350 in early termination fees just to grab the next gyro-equipped models one they eventually come out. Microsoft has also admitted that it won't be ready to support gyros or digital compasses in Windows Phone 7 at its end of the year launch.



That makes Apple's gyro introduction, tied to the mega-launch of the new iPhone 4, a big deal in terms of differentiating Apple's platform. Jobs' announcement of the new gyroscope feature generated an enthusiastic, instantaneous whoop from a few developers at the WWDC keynote who understood what it meant. For everyone else, Jobs had a demonstration planned involving a 3D Jenga-style game that allowed for an entirely new type of motion feedback.







On page 2 of 4: What's a gyroscope?



What's a gyroscope?



Apple's original iPhone popularized the accelerometer, a type of sensor that can detect a device's acceleration, shake, vibration shock, or fall by detecting linear acceleration along one of three x, y and z axes: up/down; right/left and front/back. The company had earlier used accelerometers in its notebooks as "Sudden Motion Sensors" in order to park the hard drive in anticipation of hitting the floor, to avoid hard drive damage related to a drop.



On the iPhone and iPod touch (and recent iPod nanos), 3-axis accelerometers enable landscape/portrait orientation switching, tilt control for games, and shake features such as undo and song shuffle. Because they only measure linear motion, they can't sense compass direction or subtle twisting motions or rotation about gravity.



In the iPhone 3GS, Apple added a digital compass (magnetometer), which can additionally sense magnetic direction relative to the Earth's poles. The iPhone 4 gyroscope adds an additional new electronic sensor for detecting 3-axis angular acceleration around the X, Y and Z axes, enabling precise calculation of pitch, yaw and roll.



While conventional accelerometers measure linear acceleration as a change in velocity (speed increasing or decreasing over time) apart a change of direction, a gyro measures angular acceleration: a change in both velocity and direction at the same time. In iPhone 4, the gyro enables the device to sense slight degrees of rotation while rejecting linear movements and hand jitters, while its accelerometer senses those linear movements.



Combined with data from the accelerometer and compass, the gyro provides detailed, precise information about the device's six-axis movement in space: the 3 axes of the gyro, combined with the 3 axes of the accelerometer enable the device to recognize how far, fast, and in which direction it has moved in space. Apple makes this information available to developers through new CoreMotion APIs, sparing them the need to be experts in physics just to add gyro support to their apps.







On page 3 of 4: Video game commotion about motion



Video game commotion about motion



Apple's new gyro not only beat other smartphone makers to market, but also premiered ahead of motion-based controls on dedicated gaming devices. Nintendo won't bring accelerometer and gyro support to its new Nintendo 3DS until March 2011. Sony's PSP Go, released last fall, has neither type of motion sensor built in and has announced no plans to add any (while it can theoretically be used with Sony's SIXAXIS controller for the PS3, nobody is supporting that sort of thing today, nor does it make much sense for a handheld device to use a separate controller).



The iPhone 4's gyro introduction resonated with new announcements at E3 related to the leading video game console vendors, each of whom were demonstrating their own new motion-based gaming technologies for their gaming consoles.



In video game consoles, accelerometer-based motion control was pioneered by Nintendo, which around 2001 bought up patents from Gyration pertaining to that company's motion sensing PC mice. Five years later, the company had completed an innovative design for a one-handed controller using a 3-axis accelerometer paired with an IR camera designed to locate itself in space using a stationary "sensor bar," which enables the Wii Remote to determine where it is being pointed.



The company first planned to use the new controller to extend the lifespan of the GameCube, but after that console largely failed as a product due to being branded as a toy for children, the new controller was used to launch the Revolution console, later renamed Wii. Motion-based controls have defined the Wii gaming experience.



Just months after the announcement of Nintendo's Wii motion-based "Wii Remote," Sony rushed its own SIXAXIS controller to market for the PS3, although fewer PS3 titles have made much use of its motion-sensing controller; most PS3 games have been more conventional button-oriented titles as opposed to the Wii where motion-based control is a major feature of the platform. Additionally, while the SIXAXIS controller detects changes on "more axes," it can't be used to point at the screen like the Wii Remote can.



Last summer, Nintendo released the Wii MotionPlus, an add-on device that plugs into the Wii Remote and adds a 3-axis gyroscope to enable much greater positioning accuracy to the controller. While the Wii Remote could sense up/down, right/left and back/forth movements, these require flicking or jabbing the controller and don't really respond to different degrees of motion. Adding the MotionPlus gyro provides sensitivity for slight degrees of motion along six axes for determining precisely where the controller is in space.



In the last week, Microsoft and Sony both demonstrated new camera-based motion detection features, the Xbox Kinect and and Playstation Move. Kinect is entirely camera and mic based, scanning the user's full body motions, while Move uses motion based controllers like the Wii Remote with MotionPlus in addition to a magnetometer and camera sensing LED sphere that are all combined to determine the location and movement of the controllers in the user's hands. Clearly, the whole industry thinks that motion-based gaming is a big deal.







On page 4 of 4: Gyro motion extends Apple's lead mobile games.



Gyro motion extends Apple's lead mobile games



By being first to incorporate motion controls in a mobile device for gaming and other uses, Apple is signaling its intention to not just make its iOS platform a suitable performer for casual games, but to instead increase its vast gaming lead over other smartphone platforms while also outpacing the interactivity of dedicated game devices, essentially beating Nintendo at its own game in the mobile realm.



The problem with adding advanced features to a gaming platform is that historically it's appeared difficult to sell consumers those additional add-on devices. By building gyro support into iPhone 4 (and almost certainly the iPod touch 4 this fall) Apple will rapidly create a large installed base of tens of millions of gyro-ready iOS devices for developers to target. Many games designed to take advantage of gyro data in CoreMotion will be able to degrade gracefully to support less accurate 3-axis control on earlier iPhone and iPod touch devices, just as iOS' Core Location bridges the hardware gap between devices that have GPS and those that can only use WiFi triangulation for positioning.



The new gyro is also an example of how Apple can outpace rival platforms that advertise "openness" as a feature over integration; Google won't be able to move its Android partners to add gyros to all their phones immediately, nor will the company be very interested in developing a sophisticated new motion API in Android, given that such a feature won't do much to help the company sell more ads. Microsoft won't be adding gyro support to Windows Phone 7 from the start, and Symbian's installed base is so large that adding gyros to new phones won't really result in an addressable market for gyro-based games, given the already limited potential for sophisticated Symbian titles right now.



Along with RIM and HP, all of these vendors have plenty of far more serious problems to address first, starting with basic user interface upgrades that make them comparable to the iOS platform; basic support for new tablet devices; and a business model that can sustain app development in the first place. That leaves Apple positioned well ahead in attracting mobile gamers from both conventional handheld devices, while also promoting its lead as the top smartphone platform in terms of sophisticated games and other apps.
«1345

Comments

  • Reply 1 of 96
    zindakozindako Posts: 468member
    Wonderful article, I fear the competition is falling even more years behind Apple and its innovative market lead.
  • Reply 2 of 96
    g3prog3pro Posts: 669member
    Quote:
    Originally Posted by zindako View Post


    Wonderful article, I fear the competition is falling even more years behind Apple and its innovative market lead.



    Yeah, like with dual-microphone for noise cancellation and with a decent high-resolution screen?
  • Reply 3 of 96
    dagamer34dagamer34 Posts: 494member
    Maybe finally my iPhone won't get lost in transition when I move my phone from portrait to landscape.
  • Reply 4 of 96
    luisdiasluisdias Posts: 277member
    Quote:
    Originally Posted by g3pro View Post


    Yeah, like with dual-microphone for noise cancellation and with a decent high-resolution screen?



    "Decent"? Rofl. Find me a phone with a better resolution and pixel density as the iPhone.











    Well, spare yourself the work really. There is none.
  • Reply 5 of 96
    anantksundaramanantksundaram Posts: 18,346member
    Thanks for a GREAT analysis. Very persuasive. Upon reading, it all seemed so obvious. It is quite amazing that no one else has picked up on this feature as a major differentiator.



    My only concern would be whether the rest of the world is ready for this, and whether Apple is a couple of years ahead of its time.
  • Reply 6 of 96
    anantksundaramanantksundaram Posts: 18,346member
    Quote:
    Originally Posted by g3pro View Post


    Yeah, like with dual-microphone for noise cancellation and with a decent high-resolution screen?



    Why have you been here since 1998? Low self-esteem?
  • Reply 7 of 96
    bbbbbb Posts: 1member
    Great article! This is why I read AppleInsider. I'm a fan boy all the way, and I really enjoy your lengthy articles about how Apple is better than everyone. Keep up the good work, and I'll keep reading.
  • Reply 8 of 96
    prof. peabodyprof. peabody Posts: 2,860member
    Quote:
    Originally Posted by AppleInsider View Post


    ... nobody guessed that the aluminum shell would double as an antenna system ...



    Steel shell, not "aluminum" (sic).
  • Reply 9 of 96
    melgrossmelgross Posts: 30,166member
    Quote:

    Additionally, nobody guessed that the aluminum shell would double as an antenna system for WiFi, Bluetooth, GPS and 3G.



    The reason why no one guessed that the ALUMINUM shell would double, is that it's NOT Aluminum. It's STAINLESS STEEL.



    Sheesh! I really don't mind his nutty opinions, but when he gets the simplest, basic facts wrong...
  • Reply 10 of 96
    ^^ Yeah, like those people who said the rest of the world have been making voice calls since dinosaur years, tell me how's that been like, seriously? Why does the rest of the world need Apple to change and lead all the time? The answer lies in the culture. Approach. Liberty. And passion. Of Apple.



    Oh, not to mention the fanboi....



    (sorry, a bit slow in writing. Meant to quote post#7)
  • Reply 11 of 96
    melgrossmelgross Posts: 30,166member
    Quote:
    Originally Posted by Prof. Peabody View Post


    Steel shell, not "aluminum" (sic).



    Geeze! If you took a bit more time with your post, I would have gotten there first!
  • Reply 12 of 96
    SpamSandwichSpamSandwich Posts: 28,371member
    Quote:
    Originally Posted by melgross View Post


    The reason why no one guessed that the ALUMINUM shell would double, is that it's NOT Aluminum. It's STAINLESS STEEL.



    Sheesh! I really don't mind his nutty opinions, but when he gets the simplest, basic facts wrong...







    That made my day.
  • Reply 13 of 96
    daharderdaharder Posts: 1,580member
    "Gyro spins Apple ahead in gaming" - No... Not Really
  • Reply 14 of 96
    boogabooga Posts: 1,071member
    The most interesting part of the gyro to me is combining it with the AV Apis and wireless networking to do some really interesting computer vision applications. Once you have a six axis motion-tracked camera you can do some pretty advanced recognition algorithms.
  • Reply 15 of 96
    sheffsheff Posts: 1,407member
    I remember hearing someone float an idea where a new TV would be able to use iOS apps (games), and the iPhone could become the six-axis controller for such games. I think that that would be the most awesome use for the gyro. Spinning with the iphone while on the train or in the car would not be as easy as it might seem.



    Hopefully the gyro is added to the touch as well.
  • Reply 16 of 96
    zoolookzoolook Posts: 657member
    That actually looks awesome.
  • Reply 17 of 96
    adamiigsadamiigs Posts: 355member
    Quote:
    Originally Posted by sheff View Post


    I remember hearing someone float an idea where a new TV would be able to use iOS apps (games), and the iPhone could become the six-axis controller for such games. I think that that would be the most awesome use for the gyro. Spinning with the iphone while on the train or in the car would not be as easy as it might seem.



    Hopefully the gyro is added to the touch as well.



    It's an electronic gyro not mechanical, either way they would have to add the components into the next itouch
  • Reply 18 of 96
    bartfatbartfat Posts: 432member
    Damn. I'm now regretting my decision to wait until 2012 for a new iPhone. I want that gyroscope
  • Reply 19 of 96
    nagrommenagromme Posts: 2,834member
    If the gyroscope is like the Wii add-on, it?s a pair of vibrating tuning forks rather than spinning axles, and variations on the vibrations are what gets measured. A tuning-fork gyroscope.



    Either way, it?s a little moving part inside your phone, so tiny that even thieves with screwdrivers didn?t find it! (And evidently so tiny that it doesn?t kill the battery. I had no idea mobile-friendly gyroscopes even existed.) Pretty cool.
  • Reply 20 of 96
    mkeathmkeath Posts: 60member
    Quote:
    Originally Posted by LuisDias View Post


    "Decent"? Rofl. Find me a phone with a better resolution and pixel density as the iPhone.











    Well, spare yourself the work really. There is none.



    Just because it isn't as high a resolution and pixel density doesn't mean it is necessarily bad. Many people might prefer an AMOLED screen to an LCD screen. And the higher resolution phones out there right now are nothing to turn your nose up at. For example, my brother has a Droid Incredible, and its display really looks awesome.



    Also, I don't really want our species to turn into beings that spin around on one spot to play a game. It just looks silly.
Sign In or Register to comment.