Details of Apple's rumored AR headset revealed in iOS 13 GM

Posted:
in General Discussion edited September 2019
Apple "leaked" strings of code, entire frameworks and "read me" files related to its widely-rumored augmented reality headset with Tuesday's iOS 13 Gold Master release and Xcode beta, revealing a few details about the project that was reportedly put on ice earlier this year.




Uncovered by ever intrepid developer Steve Troughton-Smith, the AR headset information is openly listed in files and complete folders issued with the iOS 13 GM.

Dubbed "StarBoard," the system shell describes an AR headset or similar apparatus capable of running stereoscopic, or stereo, content. According to Troughton-Smith, code strings point to multiple ways of accessing AR content, including wearing or holding an "HME" device, as well as potentially connecting a specialized gamepad for use with the wearable.

StarBoard appears to operate in a manner similar to CarPlay in that content is offloaded to an external display. While exact working details are unknown, Troughton-Smith guesses that a "dashboard" displaying compatible stereo AR apps will appear when the presumed headset is connected to an iPhone or similar computing device.

"Very curious to see whether the headset or the iPhone runs the StarBoard shell itself, but seems very much like the iPhone does the rendering," Troughton-Smith said in a tweet.

More interesting is a read me file that runs through procedures for testing stereo AR apps on iPhone, a contingency apparently made for employees who do not have access to the headset. The file notes internal iOS builds come with a "STARTester" app that can switch its displayable content in and out of HME mode when used with another asset called "starboardct1."

Setting the system state to a "worn" HME configuration, for example a prototype dubbed "Garta," will apply distortions associated with that device. Setting the state back to "held" returns the app back to "normal" mode, which is assumedly typical 2D rendering.

Apple has for years been rumored to be working on an AR headset under the codename "T288." Previous reports claimed the company tested a variety of prototype hardware including 8K eyepieces and WiGig 2.0, along with a slew of onboard sensors fed to a separate processing unit.

Analyst estimates pegged launch for 2020, but reports in July claimed Apple put the project on ice. Judging by today's revelations, however, work on the initiative is ongoing.

Comments

  • Reply 1 of 9
    As long as I can use the ARkit to display the upcoming 3d totally realistic digital Abbatars Simon Fuller is making for Abba, I'll be happy.
    chasmargonaut
  • Reply 2 of 9
    I kept waiting for a "One more thing" today to be AR and/or VR but it never happened. Oculus Quest is killing it in VR.
    edited September 2019
  • Reply 3 of 9
    I think development of the iPhone 11 has been put on ice also. Maybe because is now in Production...
    mknelson
  • Reply 4 of 9
    Come on. This hidden information can’t be an accident.
    razorpitargonautwatto_cobra
  • Reply 5 of 9
    MisterKit said:
    Come on. This hidden information can’t be an accident.
    It's obviously not an accident but it does show that Apple is laying the foundation.
    watto_cobra
  • Reply 6 of 9
    mcdavemcdave Posts: 1,927member
    STereo Augmented Reality - got it.
    watto_cobra
  • Reply 7 of 9
    Will be this dependent on 5G networking and A14 graphic power or is possible that even older devices will support it?

    Processing on phone make sense from battery life perspective. Small batteries, low weight, lightweight design as solution allows.

    watto_cobra
  • Reply 8 of 9
    flaneurflaneur Posts: 4,526member
    mcdave said:
    STereo Augmented Reality - got it.
    Hey, I think you might be right.

    What’s HME stand for? Head Mounted...?

    Meanwhile, note the two mistakes in the quoted read-me file: “it’s” should be “its,” and “dislayable” should be “displayable.”
  • Reply 9 of 9
    flaneurflaneur Posts: 4,526member
    Thinking about the difference between head-mounted stereo and hand-held 2D display, I think they might show the two frames, right and left, side by side on a single screen when not in head-mounted HME mode. This would allow for L/R motion sync to be displayed and verified, as well as L/R parallax details to be compared, perhaps with a hand-held two-lens stereo viewer.
Sign In or Register to comment.