Craig Federighi is on a mission to let you move work across all of your devices, instantly...
From using an iPhone as a webcam on Mac to Universal Control, for years Apple has been making it easier to work across multiple devices -- and now it has a plan to mean you can instantly switch between them, too.
Turning iPad, Mac, and more into a single unit
Universal Control was the wow moment of WWDC 2021, as Craig Federighi dragged a file from his iPad, across his MacBook Pro screen, and dropped it into Final Cut Pro on an iMac. Universal Control gave us the ability to use one keyboard and trackpad -- in this case his MacBook Pro -- and seamlessly use other nearby devices.
No wonder Federighi looked excited. But it turns out that this may have been less his turn to present something at WWDC, and more of a project he is particularly invested in.
For a newly-revealed patent application about extending this feature still further, is credited to Federighi and two colleagues. "Continuity of Applications Across Devices" proposes a subtle but significant improvement on what Apple summarizes as its Continuity features.
Universal Control is the most striking of those, but there is also how the music playing on an iPhone can be handed off to a convenient HomePod. Then there's the tremendous AirDrop, the ability to use an iPhone as a camera, or to have your Apple Watch unlock your Mac.
Apple is all-in on this Continuity idea of recognizing that we tend to have multiple devices, and will benefit from integrating them more. The idea in this patent application centers on how we might turn to either the best or the handiest device to do something, only to realise another device would be better.
"[For example], the user may power-up a laptop, launch an e-mail application, find the specific e-mail for which a response is needed, and begin to prepare the response," says Apple. "It would be helpful if the user could transition from use of one device to another, such as transition from reading an e-mail on one device to drafting a reply on another device, in a seamless and cognitively continuous manner."
One Apple ID, one account
You've done this. You've begun replying to an email on your iPhone, only to find that there's more to say than a quick emoji. Right now, you could delete that draft and open up Mail on your Mac to get the benefit of typing on a full keyboard instead of tapping with your finger.
Right now you can even select all of the text you've written, copy it, turn to your Mac, open Mail, find the message, click on Reply, and paste your existing text into your reply. There is also iCloud syncing which for some apps will mean a draft is copied between devices, saving you even the copy-and-paste effort.
But Apple wants it to be that you literally just put down one device and pick up the other, to carry on working precisely where you were.
"[If] the user is using one application on a first device, it would be helpful for the second device to which the user is transitioning-to automatically launch the same application," says Apple, "so that the user may continue without loss of progress."
So you're in Mail, writing a reply, and you realise it would be better to do that on your Mac. Put down your iPhone, open your MacBook Pro's lid, and Mail has launched itself in readiness.
Mail is waiting for you -- and so is the message you were replying to. If you haven't cancelled the one on your iPhone, that's what you see now, the email you've begun writing.
That email reply is just waiting for you to carry on precisely where you were. This seems handy, it seems quite nicely convenient, but Apple argues that actually, there's more to it than convenience.
"Such techniques can reduce the cognitive burden on a user who switches between uses of multiple computing devices, thereby enhancing productivity," says the patent application. "Further, such techniques can reduce processor and battery power otherwise wasted on redundant user inputs."
Ultimately, while Apple would gladly have us buy very many devices, the aim is for us to feel as if we have just one. It comes in different sizes and has different capabilities, but it's the device we need to do what we have to right now.
Read on AppleInsider
Comments
Now, it never really happened like that; indeed, it really was the first edition of watch Apps that were hosted by the phone, but the interface was run by the watch as an app extension.
Still, it seemed like a great idea to expand. Why bring the whole app onlineon each device when all you need in the example is only a small part of it? Why couldn't drafting an email be a super-lightweight app extension that jumps between devices with ease?
Would help the CPU/GPU multi-task the app if if was divided to task interfaces.
I like this metaphor that suggests the way it will work—the devices work as though you have a virtual single device with arms and legs ( other devices) to work in concert with your task.