Eye-tracking app Eyeware Beam free to download in iPhone beta

AppleInsiderAppleInsider
Posted:
in iOS
The eye-tracking app Eyeware Beam has been released in a public beta, with the app providing Windows users the ability to track their eyes using the iPhone's TrueDepth camera.




Originally introduced in January, Eyewear Beam is an app that brings head and eye tracking to consumers, without requiring any extra hardware other than an iPhone. Connected to a Windows PC, the app uses the TrueDepth camera array normally used for Face ID to perform the task, treating the iPhone as a webcam.

The app can be used to introduce head movements as a game input, as well as for game streamers to show their audience what they're actively looking at. It also has a use for training, with it able to show where a player or worker is looking within an application or game, so they can see how they pay attention to events and actions.

The head-tracking feature works with over 150 games, which support Open Track or Free Track integration. The eye-tracking is able to be added as an overlay of a game or a screen within the streaming and screen recording tool OBS.

To use the app, a software counterpart has to be installed on the computer in order to communicate with the iPhone app. For the moment, it only supports Windows, with no macOS support at this time.

On the mobile device side, it is compatible with all iPhone versions with a TrueDepth camera, as well as the iPad Pro with Face ID support, running on iOS or iPadOS 13 or later.

In the public beta, the app is free to download and use from the App Store. A paid version will arrive later in 2021, and will include new features and other improvements, though pricing has yet to be announced.

Keep up with everything Apple in the weekly AppleInsider Podcast -- and get a fast news update from AppleInsider Daily. Just say, "Hey, Siri," to your HomePod mini and ask for these podcasts, and our latest HomeKit Insider episode too.If you want an ad-free main AppleInsider Podcast experience, you can support the AppleInsider podcast by subscribing for $5 per month through Apple's Podcasts app, or via Patreon if you prefer any other podcast player.

Comments

  • Reply 1 of 8
    boxcatcherboxcatcher Posts: 267member
    No macOS support is baffling
    seanjwatto_cobra
  • Reply 2 of 8
    beowulfschmidtbeowulfschmidt Posts: 2,129member
    boxcatcher said:
    No macOS support is baffling
    It's not baffling at all if their target audience is gamers and game streamers.
  • Reply 3 of 8
    appleinsideruserappleinsideruser Posts: 490member
    Can’t games use the built in head pointer in macOS?
  • Reply 4 of 8
    tenthousandthingstenthousandthings Posts: 1,036member
    This is one of the most exciting things I’ve read about in a while—not because of this particular implementation in gaming or whatever, but because of other potential applications of the TrueDepth technology.

    I mean, my sister-in-law has ALS—she communicates using an expensive yet limited proprietary device (tobii dynavox) that tracks her eye movements—she is five years in, so hers is not the latest model, but still even a brand-new unit can’t handle super-basic things we take for granted, like group texts or sending photos in texts. 

    The prospect of using an iPhone or iPad for something like this, in conjunction with iPadOS or macOS or even Windows is full of possibilities.
    edited July 2021 eyeware_beamwatto_cobra
  • Reply 5 of 8
    appleinsideruserappleinsideruser Posts: 490member
    This is one of the most exciting things I’ve read about in a while—not because of this particular implementation in gaming or whatever, but because of other potential applications of the TrueDepth technology.

    I mean, my sister-in-law has ALS—she communicates using an expensive yet limited proprietary device (tobii dynavox) that tracks her eye movements—she is five years in, so hers is not the latest model, but still even a brand-new unit can’t handle super-basic things we take for granted, like group texts or sending photos in texts. 

    The prospect of using an iPhone or iPad for something like this, in conjunction with iPadOS or macOS or even Windows is full of possibilities.
    Like head pointer I mentioned above, Apple provides loads of accessibility options as standard that many people don’t know exist. You probably know, but I just mention in case it’s helpful: https://support.apple.com/en-gb/guide/mac-help/mchlp1400/11.0/mac/11.0
    watto_cobra
  • Reply 6 of 8
    normmnormm Posts: 653member
    eyeware_beam said:
    This is one of the most exciting things I’ve read about in a while—not because of this particular implementation in gaming or whatever, but because of other potential applications of the TrueDepth technology.

    I mean, my sister-in-law has ALS—she communicates using an expensive yet limited proprietary device (tobii dynavox) that tracks her eye movements—she is five years in, so hers is not the latest model, but still even a brand-new unit can’t handle super-basic things we take for granted, like group texts or sending photos in texts. 

    The prospect of using an iPhone or iPad for something like this, in conjunction with iPadOS or macOS or even Windows is full of possibilities.


    Hi @Tenthousandthings, we’re very happy to see your comment here. We, too, believe that the TrueDepth camera brings a lot of potential to the assistive technology market. And, that a lot of people could benefit from this type of tech evolving as fast as it does. Although, things don’t evolve as quickly as we’d want them to when we’re speaking of the assistive tech/medical markets. Our current focus is not on assistive technology, although this was the main market focus when we started building the core eye tracking software back in 2016. 

    However, a first step we’re taking to support the community is the creation of an SDK that will enable developers to prototype and integrate eye tracking capabilities in whatever tools they are building (accessibility solutions, specific interaction experiences, immersive game experiences etc.). If interested, please get in touch with us here https://beam.eyeware.tech/developers/ or over email directly. 

    A few years ago, before the TrueDepth camera, my brother-in-law's best friend died of ALS.  He never had good technology to help him remain able to communicate.  He once spent 12 hours blinking at an assistant holding cardboard cards, giving yes/no answers to write a speech for a friend's wedding.  I tried to find out from Apple's assistive technologies people if they had eye-tracking on their roadmap, but didn't get an answer.  I hope Apple is aware of the Eyewear-Beam people, and will perhaps collaborate to make their product part of the built-in assistive technologies.  It should be possible to do almost everything on an iPhone using eye tracking and blinking.
    watto_cobra
  • Reply 7 of 8
    appleinsideruserappleinsideruser Posts: 490member
    Er, iOS (like macOS I mentioned) does head tracking by default too! @normm ;
    edited July 2021 eyeware_beam
Sign In or Register to comment.