Google Maps for iOS uses Gemini to pull places from screenshots

Jump to First Reply
Posted:
in iOS

Google Maps is making more use of Gemini, with the AI service now identifying locations in iPhone screenshots.

Two smartphone screens display a map and screenshot review process with a finger pointing at the second screen showing found places. Background shows a detailed map of roads and parks.
Location info can be pulled from screenshots by Google Maps on iOS - Image Credit: Google



Like other navigation tools, Google Maps lets users create lists of locations, making it helpful for long trips and vacations. However, with a new update, the app will make it easier to add locations automatically, rather than doing so manually.

Initially announced in March, Google Maps for iOS will now include a new "Screenshots" list under the "You" tab. That list will be an automatically-populated collection of locations, sourced from screenshots.

The idea is based on the principle that people often take screenshots of webpages for later reference, rather than manually making notes.

As Google's blog explains, Google Maps will use Google Gemini's AI to scan screenshots taken on the iPhone for location information. If a place is recognized, typically by including some searchable text that reveals a location, it will be added to the Screenshots list.

The functionality won't be immediately available to users, as they first have to select to try the function out. They are also asked to agree to a system request to allow Google Maps access to photos.

If Maps recognizes a place, it will pop up a message saying there's places ready for review on the list. Users can then select which images and locations to be added to the list, and become viewable on the main map view.

If users don't agree to provide access via the system request, they can also upload screenshots to the list manually.

The update is slowly rolling out to users from Thursday, starting with those using iPhones in US English.



Read on AppleInsider

Comments

  • Reply 1 of 2
    rotateleftbyterotateleftbyte Posts: 1,639member
    Is there no limit to how low Google will stoop? Don't answer that. They know no limits in their quest to know more about you than you do.

    If you use Google for anything, now is the time to stop and ask if you should continue to let them have free access to your phone which for many people IS THEIR LIFE.

    NO, NO and thrice no.
    DBSyncmike1danoxneoncatappleinsideruser
     4Likes 1Dislike 0Informatives
  • Reply 2 of 2
    danoxdanox Posts: 3,739member
    No thanks insidious… But for those that do use it I’m sure Apple is getting paid for infrastructure access.
    neoncatbonobob
     0Likes 2Dislikes 0Informatives
Sign In or Register to comment.