iOS 18 is coming soon with AI, a new interface, and accessibility: what to expect at WWDC ...
Apple is just months away from showing off its iOS 18 update that will arrive in the fall. This is what the rumor mill suspects is on the way in the next version of the iPhone operating system.
iPhone in a crystal ball
WWDC, Apple's annual gathering of developers that will take place from June 10 until June 14, is the venue for the tech giant to show off some of its future plans. The announcements during the keynote and throughout the week typically cover a lot of areas, but operating system changes are the main focus of proceedings.
With the iPhone being the main revenue generator for the company, Apple's changes to iOS are closely watched by developers and industry observers. The next version, destined to be called iOS 18 unless Apple makes a massive change to its naming system, will be just as important.
Following many rumors and reports about AI being worked on by Apple itself, iOS 18 could face considerable scrutiny, in an industry that is growing to embrace generative AI and machine learning.
What follows is a compilation of the rumors surrounding iOS 18, which should give an idea of what to expect Apple will show off this summer.
Siri's AI boost
With the rise of ChatGPT, Google Gemini, and other LLMs in the tech industry, it's understandable that quite a few rumors about Apple revolve around AI. That includes how it could affect iOS 18.
Given Apple SVP of Marketing Greg Joswiak gave a fairly hefty social media nudge that AI will feature at WWDC, and that CEO Tim Cook said more AI news is due in 2024, it's fair to say that iOS 18 will incorporate some into its fall release.
Changes to Siri in iOS 18 may be shown off at WWDC.
In February, a report claimed the A18 chip intended for the 2024 iPhone refresh will use a Neural Engine with more cores, allowing it to more easily process machine learning tasks.
Though AI rivals have released chatbots, there are no expectations for there to be an Apple chatbot anytime soon. Instead, Apple's changes will be feature-based, as well as a massive upgrade to its intelligent assistant, Siri.
One January compilation of job ads, AI investments, and research papers indicates that Apple is primed to make a big change to Siri. This inlcudes 21 acquisitions and investments in the field since 2017, as well as half of its job ads at the time including some reference to AI, Machine Learning, or Deep Learning.
In Siri, this could manifest in more personalization and natural conversation flows, on top of its existing slightly stilted conversational style.
The beta for iOS 17.4 also appeared to include signs of AI changes to Siri, with evidence that four different AI models were being tested. Two versions of AjaxGPT, Apple's in-house LLM, appeared, with one employing on-device processing while the other relied on external servers.
More AI features
Siri isn't the be-all-and-end-all of Apple's AI work, with it already incorporating machine learning features into various bits of its operating systems, and apps.
A January 7 leak listed off AI changes to iOS 18's apps, including the addition of auto-summarizing and auto-complete tools for Pages and Keynote. Apple has also added "iWork.ai" to its domain name roster, which helps bolster iWork speculation.
Apple Music will also apparently gain more AI elements, such as automated playlist generation.
While not strictly about iOS 18 apps, Apple could also make it easier for developers to make them using the technology. There have been murmurs of an update to Xcode that includes code autocompletion features.
An example from Apple's Keyframer test app
While not directly linked to tangible features, Apple has also been linked to other AI efforts, including image generation.
Apple and the University of California released an AI-based image editing model called MGIE in February. Other Apple researchers have also published a research paper on the creation of a test generative AI app called Keyframer, which let users describe an image and how it should be animated.
Along with its own work, Apple has also reportedly enquired about using technologies from Google and Baidu in some capacity.
There has even been speculation that Apple will open up an AI App Store, though that could easily be incorporated as a section within the main App Store itself, rather than being a separate entity.
Interfaces
While AI is expected to be a big part of the iOS 18 experience when it ships, there will almost certainly be a number of other changes to the operating system. That could include how users actually interact with the operating system.
On March 24, a newsletter insisted that Apple will make it a lot easier for users to customize their home screen in iOS 18. However, Bloomberg's Mark Gurman didn't go into details about the change.
iOS 17
There has also been a doubtful rumor that Apple will redesign iOS 18 to be more inspired by Apple Vision Pro, one which surfaced in early February. Later that month, Gurman wrote that Apple will be updating the design of iOS, but it would use glass textures or 3D buttons like visionOS since the aesthetic is made for headsets.
In November, reporting on a one-week development stoppage, Gurman commented that internal descriptions by Apple senior management said the updates will be "ambitious and compelling."
Maps and Freeform
Outside of AI-based features, there have been some rumors about a few of Apple's apps that should appear during WWDC.
Freeform, Apple's infinite canvas app, will gain a new "Scenes" feature to help users navigate across large boards. Users will be able to select specific sections of the freeform board, embedding anchor points which can be jumped to quickly when selected in the user interface.
These scenes, like the canvas itself, can be edited and synchronized with others via iCloud.
Golden Gate Bridge in Apple Maps
Apple Maps could also get a brand new route-planning feature. Code found in late March indicates there is a back-end file called "CustomRouteCreation."
If taken at face value, this could be a feature letting users create custom routes when planning a trip. Currently, users are only able to select from a group of specified routes, then have to add stopping points manually.
RCS, finally
After years of campaigning from Google, Apple announced in November that RCS messaging will be arriving on the iPhone in 2024. While Apple hasn't advised of when that would be, it seems the most opportune time would be in iOS 18.
Support for the RCS Universal Profile published by the GSM Association will "offer a better interoperability experience when compared to SMS or MMS," Apple said in a statement.
RCS support for iMessage is probably going to happen in iOS 18.
While good news for text users, the announcement isn't exactly declaring cut-and-dry support. Apple won't be adopting proprietary extensions to its implementation, such as Google's one that adds end-to-end encryption, with it preferring to work with GSMA to add encryption to the main profile itself.
For Android users who hope RCS will put blue iMessage text bubble snobbery to an end, they're out of luck. Apple will still continue to use blue bubbles for iPhone users and green for Android, even under RCS.
Accessibility features
Like other iOS releases before it, Apple will be enhancing the accessibility features of iOS 18 to make it better for users.
On March 7, the features rumored to be coming along include Voice Shortcuts. Vaguely similar to Siri Shortcuts, the feature could function without requiring the "Hey Siri" prompt beforehand, and it may end up being limited to activating other accessibility features.
Live Speech, which allows users to create phrases that can be spoken by the iPhone, will be bolstered by an organization upgrade. Category labels and 20 available icons will make it easier for users to select what they want the iPhone to say.
Some existing accessibility features in iOS and iPadOS
While users can already manage the size of fonts on a per-app basis in iOS, it does require apps to support it. Under a new improved font size control system, users will be able to control font sizes in more apps, including some system apps that don't yet offer the functionality.
The accessibility changes may also impact the AirPods Pro, with rumors that a new hearing aid mode is in the works for iOS 18. While it already offers assistive features like Listen Live or Conversation Boost, the feature could simply make the AirPods Pro a viable alternative to hearing aids for some users.
Supported iPhones
One late February leak offered that the list of iPhones that will support iOS 18 will be the same as those using iOS 17.
The list includes all models from the iPhone XS and iPhone XR generation to modern models. The second and third-generation iPhone SE are also expected to support the operating system.
Read on AppleInsider
Comments
Personally I would like to see Siri improved, the camera app improved to include something like best take and more editing features as well as a pause function for videos.
The AI panic at Apple is also seen in the press release for MBA M3 "World’s Best Consumer Laptop for AI". A fanless computer with 8 GB RAM shared for CPU, GPU, and AI. Neural Engine in M3 is far behind similar processors from Intel and even A16. Could Apple skip M3 Ultra to focus on M4 AI?
Will M4 include more AI power, will it launch late 2024 (I expect it to - with or without AI), and will the penny-pinchers at Apple keep pushing 8 GB with LPDDR5 instead of the 16 GB LPDDR5X other vendors are using in their premium products? The next years are going to be interesting. The legacy of Cook is directly linked to this. AI is the first seismic shift on his watch.
M3 was designed to allow for different core counts so M3 Ultra could be a monolithic chip instead of two separate chips and would allow the possibility of an M3 Extreme chip with 3x the GPU power of M3 Max.
One of Apple's biggest strengths for AI is unified memory. This shows up in tests with big models. Here there's a test of a 70 billion parameter model locally:
In the smaller models, the 4090 is around 2x the speed of M3 Max but at 5:50, the large model can't fit into the GPU memory. It needs 40GB VRAM and the 4090 has 24GB so the performance is much slower. GPUs with that amount of RAM are the expensive enterprise GPUs or they have to use dual GPUs.
M3 Ultra will be 2x the M3 Max and could have up to 256GB of RAM.
A17 has a 35TOPs Neural Engine. Microsoft Copilot running locally is reported to need 40TOPs:
https://www.tomshardware.com/pc-components/cpus/intel-confirms-microsoft-copilot-will-soon-run-locally-on-pcs-next-gen-ai-pcs-require-40-tops-of-npu-performance
I expect A17 and A18 will be fast enough for local AI models. They might prefer to still run them on a server to save battery life and RAM is very limited on mobile devices. It would need 16GB of RAM for even the smaller models.
Apple's vertically integrated hardware model shows its strength again with AI and is something most manufacturers will struggle to compete with. Intel, AMD, GPU hardware doesn't have the memory setup to handle it, nor are they efficient enough to run the models without heating up too much and the NPUs will be so varied across retail models that software can't scale across the whole platform.
I think RCS support is just the same as SMS and MMS support. It's just a 3rd Android option. There will still be green and blue bubbles. It's basic, standard RCS. So no Encryption like Google has added onto RCS. That will continue to only be with blue bubbles in Apple Messages. I don't think it's a huge change other than some added features that basic RCS supports. This is more than SMS and MMS. MMS added to SMS, and RCS just added to MMS. It's not some huge change. Android users are in for a shock if they think color bubbles will go away and be on an equal level. Nope!!!
it doesn't actually mean one platform is insecure and the other bullet-proof. That's more of a fan-base reaction, with two 1st party services that just aren't going to be cross-platform secure despite what one of the the two companies might desire.