Craig Federighi talks about the challenges behind keeping Apple Intelligence private

Posted:
in iOS

Apple had to achieve what Craig Federighi says were breakthroughs so that Apple Intelligence could use large language models in the cloud while still protecting users' privacy. Here's what Apple did.

Man with gray hair looks intently at an Apple laptop screen in a dimly lit room, leaning closely.
Craig Federighi



During the "It's Glowtime" event, Apple talked about Private Cloud Compute as the way that user privacy is protected. Apple aims for as much of Apple Intelligence should work entirely on device, but there are also user requests that will require sending data to cloud services like ChatGPT.

"We set out from the beginning with a goal of how can we extend the kinds of privacy guarantees that we've established with processing on-device with iPhone to the cloud--that was the mission statement," Apple's senior vice president of software engineering, Craig Federighi, said in an interview with Wired. "It took breakthroughs on every level to pull this together, but what we've done is achieve our goal."

Users will always be prompted to approve that an Apple Intelligence request is going to use ChatGPT, it won't ever happen in the background. But then when such a request is approved, it's likely that ChatGPT will need access to date that is ordinarily held encrypted on device.

For instance, any request such as asking Apple Intelligence to look through photos or emails, will mean that data being exposed to ChatGPT.

"What was really unique about the problem of doing large language model inference in the cloud was that the data had to at some level be readable by the server so it could perform the inference," said Federighi. "And yet, we needed to make sure that that processing was hermetically sealed inside of a privacy bubble with your phone."

"So we had to do something new there," he continued. "The technique of end-to-end encryption -- where the server knows nothing -- wasn't possible here, so we had to come up with another solution to achieve a similar level of security."

The solution that Apple calls Private Cloud Compute required developing new servers that an iPhone can be certain is trustworthy. It involved changing how those servers then handle the data so that, for instance, it isn't retained once a request has been dealt with.

"Building Apple Silicon servers in the data center when we didn't have any before, building a custom OS to run in the data center was huge," says Federighi. "[Creating] the trust model where your device will refuse to issue a request to a server unless the signature of all the software the server is running has been published to a transparency log was certainly one of the most unique elements of the solution - and totally critical to the trust model."

" I think this sets a new standard for processing in the cloud in the industry," he continues. And following all of the development work, he says that the "rollout of Private Cloud Compute has been delightfully uneventful."

Apple Intelligence won't launch in Europe



That may be true for the technical challenges behind Private Cloud Compute, but the implementation of it and Apple Intelligence has had a bigger problem in Europe. Apple has said that Apple Intelligence will not be available in the EU because it says the territory's Digital Markets Act is unclear.

During the "It's Glowtime" presentation, Federighi did commit to Apple localizing Apple Intelligence in France during 2025. In the new interview, he goes further.

"Our goal is to bring ideally everything we can to provide the best capabilities to our customers everywhere we can," he said. "But we do have to comply with regulations, and there is uncertainty in certain environments we're trying to sort out so we can bring these features to our customers as soon as possible."

"So, we're trying," he concludes.



Read on AppleInsider

Comments

  • Reply 1 of 6
    ... is the bigger question now IP ... ?
    ... does this include coding and other less visible inventive original work ...?

    en.wikipedia.org/wiki/Google_and_the_World_Brain
    www.cbc.ca/news/entertainment/ai-generated-books-amazon-1.7319018
  • Reply 2 of 6
    Translation: EU=FAFO, no AI4U.
    edited September 12 wonkothesanewatto_cobra
  • Reply 3 of 6

    Apple has said that Apple Intelligence will not be available in the EU because it says the territory's Digital Markets Act is unclear.

    During the "It's Glowtime" presentation, Federighi did commit to Apple localizing Apple Intelligence in France during 2025. 

    Hmmm, has he just revealed Frexit!?
    watto_cobra
  • Reply 4 of 6
    F the EU. Their crazy undefinably laws. The will get features from Apple, Microsoft and Google, maybe never. Good luck with that plan.
    edited September 12 watto_cobra
  • Reply 5 of 6
    entropysentropys Posts: 4,268member
    Regulation can never keep up with technology. A cold dead hand on innovation.
    edited September 13 watto_cobra
  • Reply 6 of 6
    Regarding the apparent contradiction that the Apple Intelligence will be available "later"  in languages of countries in EU despite Apple Intelligence not due to be released to EU countries due to the EU Digital Marketing Act: Please remember that there are European countries that don't belong to the EU. Switzerland has four official languages, German, French, Italian and Rumantsch, and many Swiss speak and understand English better than a second language of Switzerland. We understand that Apple Intelligence will be released in Switzerland.
    appleinsideruserwatto_cobra
Sign In or Register to comment.