Apple interested in adding augmented reality to improve iPhone Maps

Posted:
in iPhone edited January 2014
Apple may update its Maps application for iPhone with augmented reality, allowing users to view information, like street names, displayed in unison with live images from the device's camera.



Apple's interest in the feature was revealed this week in a new U.S. Patent and Trademark Office filing entitled Augmented Reality Maps. Using an iPhone camera and its wide array of sensors, including GPS, compass and gyroscope, mapping data can be used to visually augment live video.



This process, known as "augmented reality," is already found in many iPhone applications, such as Layar (iTunes link), which can be used for finding local businesses and other locations. Augmented reality presents data to a user in real time by augmenting images of the real world that are displayed via a device's camera.



In Apple's concept, streets, locations and other map data would be overlaid onto the live images being displayed through the iPhone camera. Standing along a street, users could see the street name and individual street addresses displayed in front of them, just by holding up their iPhone and pointing its camera at a location.



Apple's application notes that augmented reality programs are already available, but are typically separate from mapping applications that offer users directions to a location.



"Such systems can fail to orient [users] with a poor sense of direction and force the user to correlate the directions with objects in reality," the filing reads. "Such a transition is not as easy as it might seem.



"For example, an instruction that directs a user to go north on Main St. assumes that the user can discern which direction is north. Further, in some instances, street signs may be missing or indecipherable, making it difficult for the user to find the directed route."



Apple's solution would interpret data describing the surrounding areas, and determine what objects are being viewed by the iPhone at present. This information would be overlaid onto the live video screen, and other features, like searching for locations, would also be accessible from this screen.



"In one form of interaction, a device can receive input from the user requesting directions from a present location to a selected search result," the filing reads. "Directions can be overlaid onto the presently displayed video feed, thus showing a course and upcoming turns."



The system could also give users indications that they are headed in the wrong direction. For example, if they must walk north to find a certain restaurant, and they are headed south, the system could inform them there is "no route" to their selected destination.



The proposed invention made public this week was first filed in February of 2010. It is credited to Jaron Waldman.







Its publication comes just a week after another potential enhancement to the iPhone Maps application was also discovered by AppleInsider. That filing described a system that would exaggerate or even omit some details, like roads or landmarks, to make navigation easier to follow.



Since the release of iOS 3.2 in April 2010, Apple has been relying on its own databases for location-based services. The company has also revealed it is working on a "crowd-sourced traffic" service that will launch in the next few years.



The company also purchased Google Maps competitor Placebase in 2009, and in 2010 it acquired another online mapping company, Poly9. The company's interest in "radically" improving the iPhone Maps application has also been highlighted in job listings advertised by Apple.

Comments

  • Reply 1 of 14
    Augmented reality holds a lot of promise. I've been disappointed with the current implementations. I want artists to do things that will delight the user, like showing giant lizards crawling up and down when you view the Empire State Building, or showing historical views of bygone eras. It would be awesome to click through views starting with rolling hills, progressing through views of log cabins, all the way up to the present built environment.



    I hope Apple advances the field.
  • Reply 2 of 14
    While it's all well and good Apple is working hard on improving Maps, it really seems like some of these improvements are years away, yet some could be implemented now. I think it would make for a much better transition if they introduced some of these features sooner rather than later (coughturnbyturncough).
  • Reply 3 of 14
    MacProMacPro Posts: 19,727member
    This is all very exciting, this implemented by Apple and available to developers through SDK would be awesome. Apple have to break with Google Maps at some point too.
  • Reply 4 of 14
    I'm sorry but did they really patent this?



    doesn't this exist already?
  • Reply 5 of 14
    solipsismsolipsism Posts: 25,726member
    Maps are just the most obvious of the solution for AR due to it's innate utility. I had this idea years ago (as I'm sure many did) when gimmicky AR apps were starting to appear. We need something well implemented into the core of the OS with APIs that devs can access. It doesn't look like Android will implement it right (they can't even get cut/copy/paste universal) so it's up to Apple to show everyone how its done.



    Of course, then we'll hear that Apple didn't invent anything despite everything else following in Apple's footsteps to make their AR look and feel more like Apple's AR APIs.
  • Reply 6 of 14
    iaeeniaeen Posts: 588member
    Quote:
    Originally Posted by AbsoluteDesignz View Post


    I'm sorry but did they really patent this?



    doesn't this exist already?



    Does it? Where?
  • Reply 7 of 14
    Quote:
    Originally Posted by iaeen View Post


    Does it? Where?



    2 years ago Yelp introduced similar concept... while it didnt overlay streets, it would overlay business names and ratings and a click would take ya to the businesses yelp page



    http://gizmodo.com/5347194/augmented...apps-my-health
  • Reply 8 of 14
    sheffsheff Posts: 1,407member
    Quote:
    Originally Posted by mbarriault View Post


    While it's all well and good Apple is working hard on improving Maps, it really seems like some of these improvements are years away, yet some could be implemented now. I think it would make for a much better transition if they introduced some of these features sooner rather than later (coughturnbyturncough).



    Can't you see? This is a way to annihilate google street view, without having the self driving car technology. Here are the steps:



    1. Kick google to the curb, using Apple's own maps back end taken from acquired companies.



    2. People complain - what about street view, that would take years.



    3. Steve enters on stage with one more thing and shows off Augmented street view. Why have cars drive around and take stale pictures, and waste data downloading pictures when you can fire up Apple Maps and have the fresh, up to date view of your surroundings along with an overlay of shops, streets and directions.



    4. Oh and by the way, no ads! (this last one might be pushing it)
  • Reply 9 of 14
    sheffsheff Posts: 1,407member
    Quote:
    Originally Posted by solipsism View Post


    Maps are just the most obvious of the solution for AR due to it's innate utility. I had this idea years ago (as I'm sure many did) when gimmicky AR apps were starting to appear. We need something well implemented into the core of the OS with APIs that devs can access. It doesn't look like Android will implement it right (they can't even get cut/copy/paste universal) so it's up to Apple to show everyone how its done.



    Of course, then we'll hear that Apple didn't invent anything despite everything else following in Apple's footsteps to make their AR look and feel more like Apple's AR APIs.



    Well, bing had something like this a few years back too, but they never introduced it into reality I Don't think. About 5 minute mark. http://www.youtube.com/watch?v=0TOqikZTBMY
  • Reply 10 of 14
    orlandoorlando Posts: 601member
    Quote:
    Originally Posted by sheff View Post


    3. Steve enters on stage with one more thing and shows off Augmented street view. Why have cars drive around and take stale pictures, and waste data downloading pictures when you can fire up Apple Maps and have the fresh, up to date view of your surroundings along with an overlay of shops, streets and directions.



    I use Street View to check out an area before I go visit.
  • Reply 11 of 14
    Quote:
    Originally Posted by AppleLover2 View Post


    Augmented reality holds a lot of promise. I've been disappointed with the current implementations. I want artists to do things that will delight the user, like showing giant lizards crawling up and down when you view the Empire State Building, or showing historical views of bygone eras. It would be awesome to click through views starting with rolling hills, progressing through views of log cabins, all the way up to the present built environment.



    I hope Apple advances the field.



    I believe there is already an app on the store that will show you historical images using AR. It looked like fun, but didn't seem like I would ever use it beyond the first 5 minutes.
  • Reply 12 of 14
    sockrolidsockrolid Posts: 2,789member
    Quote:
    Originally Posted by sheff View Post


    Can't you see? This is a way to annihilate google street view, without having the self driving car technology. Here are the steps:



    1. Kick google to the curb, using Apple's own maps back end taken from acquired companies.



    2. People complain - what about street view, that would take years.



    3. Steve enters on stage with one more thing and shows off Augmented street view. Why have cars drive around and take stale pictures, and waste data downloading pictures when you can fire up Apple Maps and have the fresh, up to date view of your surroundings along with an overlay of shops, streets and directions.



    4. Oh and by the way, no ads! (this last one might be pushing it)



    What sheff said. How many Google apps will be needed on iOS after Apple releases their own "Maps VR" app? Let's see: Google Earth, Google search, ummm... that's all I can find on my iPhone anyway.
  • Reply 13 of 14
    momoemomoe Posts: 5member
    I like that they included Vespas in the reference drawings!



    Mac User since 1984

    Vespa owner since 1981
  • Reply 14 of 14
    Quote:
    Originally Posted by SockRolid View Post


    What sheff said. How many Google apps will be needed on iOS after Apple releases their own "Maps VR" app? Let's see: Google Earth, Google search, ummm... that's all I can find on my iPhone anyway.







    Agree with you.Cause Apple is good at offering prettry nice iPhones,Macbook,etc,and Google is good at offering servises,as you say Google Earth,Google search,etc.
Sign In or Register to comment.