How to use Mac Virtual Display for Apple Vision Pro with desktop Macs and MacBooks

AppleInsiderAppleInsider
Posted:
in Apple Vision Pro edited February 3

There was some drama on social media suggesting that you couldn't connect an Apple Vision Pro to a desktop Mac like a Mac mini or Mac Studio. You can, but it's not quite as simple as connecting a MacBook Air, or MacBook Pro. Here's how to do it.

Mac Virtual Display for Apple Vision Pro [Apple]
Mac Virtual Display for Apple Vision Pro [Apple]



Among the various features of the Apple Vision Pro is its ability to show a Mac or MacBook's screen floating in the air in front of them. While they still interact with the Mac via the passthrough view, they see the display in 3D space, one that can also be scaled in size to be bigger than the real thing.

The feature also allows users to position the display in other parts of their environment, not just in front of the Mac itself.

However, while Apple's ecosystem means devices are deeply integrated with each other, there are quite a few things to bear in mind about the incredibly handy Mac Virtual Display feature.

Mac Virtual Display prerequisite and limitations



The first thing to remember is that you need to have a Mac running on macOS 14 Sonoma or later. It will work with both Intel and Apple Silicon Macs, but it does have to be using Apple's latest-generation operating system.

Both the Mac and the Apple Vision Pro must also be signed in to the same Apple ID. That Apple ID account must also be protected with two-factor authentication enabled.

You also must have Wi-Fi and Bluetooth enabled for the connection to work. Apple also says that internet connection sharing must be disabled.

If these are all satisfied, you're well on your way to using Mac Virtual Display, but you do have to be mindful of the limitations of the system.

For a start, it will only show one display. If you have multiple screens connected to your Mac, it will only show the one you have designated as the main display.

Depending on your Mac's processor, you may also see a variation in resolutions you can adjust to. For Intel Macs, you can have a transmitted display at a resolution of up to 3K, meanwhile Apple Silicon Macs can go up to 4K.

Only the picture will be piped through to the Apple Vision Pro, with the Mac's sounds continuing to be played from whatever the Mac's selected audio output source is, such as the Mac's built-in speaker or externally connected speakers.

Lastly, remember that you can locate the Mac Virtual Display away from the Mac itself, but there is a range to consider. Apple says the Apple Vision Pro can be up to 30 feet away from the Mac for the feature to continue working.

Starting to use Mac Virtual Display



There are a few ways you can start up the Mac Virtual Display using the Apple Vision Pro. This does vary depending on whether you're connecting to a Mac, or MacBook Air or MacBook Pro.

How to start an Apple Vision Pro Mac Virtual Display session with a MacBook Air or MacBook Pro


  1. Open the MacBook Air or MacBook Pro, and ensure the display is active.

  2. Wearing the Apple Vision Pro, look at the display.

  3. Tap the Connect button that will appear above the screen.

You can just look at a display and click Connect to work on a MacBook Pro from an Apple Vision Pro.
You can just look at a display and click Connect to work on a MacBook Pro from an Apple Vision Pro.



If the Connect button doesn't appear, or if you're using a desktop Mac like a Mac mini or Mac Studio, there's a second way to trigger the feature.

How to start an Apple Vision Pro Mac Virtual Display session with a Mac mini or Mac Studio


  1. Wearing the Apple Vision Pro and with the Mac turned on, look up then tap the down arrow near the top of your view to show Control Center.

  2. Tap the Control Center toggle button to show more options.

  3. Tap the Mac Virtual Display button, which is an icon that looks like a MacBook Pro next to an Apple Vision Pro.

  4. A list of connectable Mac desktops will appear. Select the correct one from the list.



To end a Mac Virtual Display session, simply tap the close button at the base of the Mac window to disconnect.

Using Mac Virtual Display



While using Mac Virtual Display, you can resize the Mac's screen in virtual space simply by pinching and dragging the window bars at the bottom corners of the window. Use the window bar in the middle to move the Mac display in space, and to rearrange your current layout.

To interact with the Mac Virtual Display, use the peripherals already connected to the Mac itself. This can include both built-in keyboards and trackpads, such as those on a MacBook Pro, and wired and wireless peripherals.

Change these options to use a Mac's keyboard and mouse with the Apple Vision Pro's apps
Change these options to use a Mac's keyboard and mouse with the Apple Vision Pro's apps



You can also use the Mac peripherals to control Apple Vision Pro windows and apps, which can be very useful for text entry. This is basically an extension of Universal Control.

How to use Mac peripherals to control Apple Vision Pro apps


  1. Within a Mac Virtual Display session, open Settings then Display on the target Mac.

  2. Tap Advanced.

  3. Tap Allow your pointer and keyboard to move between any nearby Mac or iPad.

  4. Once enabled, move the Mac pointer through the side of the Mac's display and into another Apple Vision Pro window.



Read on AppleInsider

Comments

  • Reply 1 of 15
    RespiteRespite Posts: 111member
    I’m glad that there is a more manual way of establishing the connection, it will be pretty cool to be able to connect a VP to a MacBook that’s stashed in a bag while on the train.
    watto_cobra
  • Reply 2 of 15
    MarvinMarvin Posts: 15,326moderator
    Respite said:
    I’m glad that there is a more manual way of establishing the connection, it will be pretty cool to be able to connect a VP to a MacBook that’s stashed in a bag while on the train.
    According to the video on the following page (at 1:50), the tracking doesn't work reliably on a train for some reason:

    https://forums.appleinsider.com/discussion/235305/apple-vision-pro-can-be-used-in-public-but-mind-your-manners

    The video slides out of view when the train starts moving. It might be a software bug that will be fixed because it should be able to track from the cameras and ignore the movement from the train.
    appleinsideruserwatto_cobra
  • Reply 3 of 15
    foregoneconclusionforegoneconclusion Posts: 2,689member
    Good news per desktop Macs. One of the YouTube reviews that I watched stated that mirroring only worked with M series laptops. 
    watto_cobra
  • Reply 4 of 15
    itinj24itinj24 Posts: 51member
    Does the desktop Mac need a display for this to work?  In other words, can I just setup a Mac Mini and use the AVP as its only/primary display?  Guessing I’ll need one initially to setup the prerequisites like Bluetooth and WiFi. 
    rcs1000watto_cobra
  • Reply 5 of 15
    RespiteRespite Posts: 111member
    Marvin said:
    Respite said:
    I’m glad that there is a more manual way of establishing the connection, it will be pretty cool to be able to connect a VP to a MacBook that’s stashed in a bag while on the train.
    According to the video on the following page (at 1:50), the tracking doesn't work reliably on a train for some reason:

    https://forums.appleinsider.com/discussion/235305/apple-vision-pro-can-be-used-in-public-but-mind-your-manners

    The video slides out of view when the train starts moving. It might be a software bug that will be fixed because it should be able to track from the cameras and ignore the movement from the train.
    I'm sure they'll figure it out by the time I get one.  Train and plane are such obvious use cases I imagine they'll put in a Transit Mode that ignores fast movement in the periphery, or somesuch solution.

    A bit surprised it wasn't there for launch, but they've had a lot on their plate.
    watto_cobra
  • Reply 6 of 15
    BuffyzDeadBuffyzDead Posts: 356member
    Yeah,
    TURN ON
    Travel Mode

    https://support.apple.com/en-us/HT214045
    watto_cobra
  • Reply 7 of 15
    hmlongcohmlongco Posts: 537member
    Marvin said:
    Respite said:
    I’m glad that there is a more manual way of establishing the connection, it will be pretty cool to be able to connect a VP to a MacBook that’s stashed in a bag while on the train.
    According to the video on the following page (at 1:50), the tracking doesn't work reliably on a train for some reason:

    https://forums.appleinsider.com/discussion/235305/apple-vision-pro-can-be-used-in-public-but-mind-your-manners

    The video slides out of view when the train starts moving. It might be a software bug that will be fixed because it should be able to track from the cameras and ignore the movement from the train.
    Wonder if it makes a difference if you're looking INTO the train (down the train, lengthwise), vs across the train where you're starting out a window at a moving background...
    watto_cobra
  • Reply 8 of 15
    MarvinMarvin Posts: 15,326moderator
    hmlongco said:
    Marvin said:
    Respite said:
    I’m glad that there is a more manual way of establishing the connection, it will be pretty cool to be able to connect a VP to a MacBook that’s stashed in a bag while on the train.
    According to the video on the following page (at 1:50), the tracking doesn't work reliably on a train for some reason:

    https://forums.appleinsider.com/discussion/235305/apple-vision-pro-can-be-used-in-public-but-mind-your-manners

    The video slides out of view when the train starts moving. It might be a software bug that will be fixed because it should be able to track from the cameras and ignore the movement from the train.
    Wonder if it makes a difference if you're looking INTO the train (down the train, lengthwise), vs across the train where you're starting out a window at a moving background...
    According to the support documents, it has trouble looking out the window. Someone tried it on a plane here and in travel mode, it shows tracking errors looking out the window:

    https://www.youtube.com/watch?v=5OUe9dXb_pI

    It will see the stationary parts inside the window so I wonder why it doesn't ignore what's outside and use the nearest stationary objects as an anchor.

    They could do it manually by tracking to a selected object like the back of the airplane seat in front or printed paper with a pattern on it, ideally something visible to the Vision Pro in the dark. They can also train a machine learning model to pick the best tracking solution in each type of environment.
    watto_cobra
  • Reply 9 of 15
    rcs1000rcs1000 Posts: 9member
    itinj24 said:
    Does the desktop Mac need a display for this to work?  In other words, can I just setup a Mac Mini and use the AVP as its only/primary display?  Guessing I’ll need one initially to setup the prerequisites like Bluetooth and WiFi. 
    And... is the connection between the two over an existing LAN? Or is it a dedicated Wifi/Bluetooth connection? 

    And will this work over the Internet if I'm in a coffee shop?
    watto_cobra
  • Reply 10 of 15
    Mike WuertheleMike Wuerthele Posts: 6,861administrator
    rcs1000 said:
    itinj24 said:
    Does the desktop Mac need a display for this to work?  In other words, can I just setup a Mac Mini and use the AVP as its only/primary display?  Guessing I’ll need one initially to setup the prerequisites like Bluetooth and WiFi. 
    And... is the connection between the two over an existing LAN? Or is it a dedicated Wifi/Bluetooth connection? 

    And will this work over the Internet if I'm in a coffee shop?
    In answer to the headless Mac mini question, set up originally using a display, connect a $8 HDMI spoofer plug so the Mac mini thinks it's connected to a monitor, and you're good to go.

    In answer to your question, RCS1000, it works with my Mac Studio with the Wi-Fi off, so existing LAN, it seems.

    It does not work over the Internet if you're in a coffee shop.
    muthuk_vanalingamitinj24watto_cobra
  • Reply 11 of 15
    hmlongcohmlongco Posts: 537member
    Mike Wuerthele said:
    In answer to the headless Mac mini question, set up originally using a display, connect a $8 HDMI spoofer plug so the Mac mini thinks it's connected to a monitor, and you're good to go.
    I didn't even know "spoofers" were a thing.... 
    watto_cobra
  • Reply 12 of 15
    itinj24itinj24 Posts: 51member
    Mike Wuerthele said:
    rcs1000 said:
    itinj24 said:
    Does the desktop Mac need a display for this to work?  In other words, can I just setup a Mac Mini and use the AVP as its only/primary display?  Guessing I’ll need one initially to setup the prerequisites like Bluetooth and WiFi. 
    And... is the connection between the two over an existing LAN? Or is it a dedicated Wifi/Bluetooth connection? 

    And will this work over the Internet if I'm in a coffee shop?
    In answer to the headless Mac mini question, set up originally using a display, connect a $8 HDMI spoofer plug so the Mac mini thinks it's connected to a monitor, and you're good to go.

    In answer to your question, RCS1000, it works with my Mac Studio with the Wi-Fi off, so existing LAN, it seems.

    It does not work over the Internet if you're in a coffee shop.
    Thanks for that!
    watto_cobra
  • Reply 13 of 15
    virgo56virgo56 Posts: 1member
    Once connected, it's great that the Mac virtual display won't get disconnected when one simply hides/closes the window with the Mac virtual display on Vision Pro. However, I haven't figured out how to "unhide" the Mac virtual display without having to disconnect it and reconnect again to my Mac. Has anyone figured this out yet? (That is, while the Mac virtual display is connected, how to unhide it after one makes it disappear to look at one's surroundings or else.) Thanks!
    watto_cobra
  • Reply 14 of 15
    rcs1000rcs1000 Posts: 9member
    Mike Wuerthele said:
    rcs1000 said:
    itinj24 said:
    Does the desktop Mac need a display for this to work?  In other words, can I just setup a Mac Mini and use the AVP as its only/primary display?  Guessing I’ll need one initially to setup the prerequisites like Bluetooth and WiFi. 
    And... is the connection between the two over an existing LAN? Or is it a dedicated Wifi/Bluetooth connection? 

    And will this work over the Internet if I'm in a coffee shop?
    In answer to the headless Mac mini question, set up originally using a display, connect a $8 HDMI spoofer plug so the Mac mini thinks it's connected to a monitor, and you're good to go.

    In answer to your question, RCS1000, it works with my Mac Studio with the Wi-Fi off, so existing LAN, it seems.

    It does not work over the Internet if you're in a coffee shop.
    I wonder if Tailscale will work?

    Of course, this is slightly bonkers, but I love the idea of being in a Starbucks and being able to "check in" on my MacMini. It would - of course - be absolutely useless for actual work. But it would be incredibly cool. 
    watto_cobra
  • Reply 15 of 15
    cabassicabassi Posts: 28member
    You can’t share pointer control using a mouse. Only with a trackpad. AVP doesn’t support mice. Try it. (I’d love to be proven wrong about  this.)
    watto_cobra
Sign In or Register to comment.