External drive support in macOS Sonoma is partially broken, and it's probably Apple's faul...

Posted:
in Genius Bar

An issue preventing some external drives from mounting onto a Mac running macOS Sonoma has plagued users for months, and it probably was caused by changes Apple made to drive handling.

A LaCie external drive
A LaCie external drive



Hardware support is a common source of problems for operating system updates, and macOS is no exception. Updates to operating systems can cause some types of devices connected to a Mac or MacBook to suddenly stop working, infuriating users in the process.

In some cases, this is a relatively short-lived issue that Apple corrects quickly.

For example, macOS Sonoma 14.4 caused problems with some USB hubs in monitors, as well as breaking printing by removing the core CUPS software, and even causing Java processes to terminate unexpectedly.

Apple's macOS 14.4.1 update did fix these problems mere weeks after their discovery.

However, sometimes the issues are left to linger for a very long time before being addressed. In the case of some external drives, it's something that has been an issue for months, without any sign of inbound fixes on the way.

External drives and exFAT



If you're a user who lives in both the macOS and Windows ecosystems, you may have to ferry files between the two physically. While using network or cloud storage is an option, there are instances where using an external drive is better.

One example is for content creation, as video editing projects can easily swamp a Mac's storage, with fast external drives frequently used to handle massive file storage and project transfers to different systems.

Disk Utility can be used to format external drives to exFAT.
Disk Utility can be used to format external drives to exFAT.



In such cases, you would need a drive to be formatted in a way that both macOS and Windows can use without many problems. In most cases, the best way forward is to format the drive with exFAT (Extensible File Allocation Table), a file system that can easily handle large file sizes and works across many platforms.

Unlike the Windows-preferred NTFS or Apple's APFS, exFAT can be read from and written to by both Macs and Windows PCs without requiring any extra software assistance. In a multi-platform environment, it's almost always the best formatting option for external drives.

macOS Sonoma complaints



Shortly after the introduction of macOS Sonoma, complaints started to surface on Apple's Community Support forum. The complaints featured irate users discovering that their external disks were not reliably being mounted in macOS at all.

Many complaints followed the same tropes, namely that the disks wouldn't appear after plugging them in to a USB or Thunderbolt port. In some instances, users would try to get the drives mounted in Disk Utility, but they wouldn't be accessible either.

In some cases, it appeared that the complainants thought the drives were unreadable, causing projects and files to not be usable and impacting productivity.

In a few instances, users encountered periodic bouts of drive failure. One from March 8 explains that multiple drives mounted correctly at first, but didn't after a reboot.

The same user formatted the drive and encountered the same thing, with an initial mount before a post-reboot failure.

Multiple external hard drives
Multiple external hard drives



From checking multiple posts on the topic, it seems that the problem isn't drive specific, nor is it affecting just single drives or RAID assemblies. It also appears to affect both Apple Silicon and Intel-based Macs, eliminating that as a variable.

While there is some confusion about encryption, it again doesn't seem to be a factor here, as others report the issue with plainly-formatted drives.

There are some commonalities at play, though.

For a start, nearly all of the complaints about the issue mention the use of exFAT on the drive. There are some complaints about APFS but they are rare compared to exFAT.

Secondly, it's only on Macs running macOS Sonoma. In the few early instances of users downgrading back to macOS Ventura, the drives were accessible again without issue.

That narrows the field of potential issues down, making it likely to be something to do with how macOS Sonoma handles exFAT.

An exFAT change



Back in the release notes of macOS Sonoma 14, Apple mentions a "New Feature" under the topic of File System. It states:

The implementations of the exfat and msdos file systems on macOS have changed; these file systems are now provided by services running in user-space instead of by kernel extensions. If the application has explicit checks or support for either the exfat or msdos file systems, validate the applications with those file systems and report any issues. (110421802)



Checking through subsequent notes, there are no further changes relating to exFAT in later macOS Sonoma updates. Given the timing of complaints coming to light and the lack of changes to the situation in macOS itself, this seems like the most likely candidate behind the problems.

It isn't entirely clear why Apple made the change, as it doesn't explicitly spell out why it shifted from running exFAT under user-space instead of under kernel extensions. However, it is likely to be a preemptive security move on Apple's part.

In short, "user-space" refers to everything within macOS that isn't the kernel. This means anything running within it is subject to the access rules of user IDs, which can limit the utility of files depending on how they are set up.

Services running under a kernel extension don't have to deal with any access rules, since they effectively run under "root" instead.

By shifting exFAT away from the kernel and running under user-space, the related services are theoretically more secure. But, it's only truly useful if everything is set up perfectly and that nothing will interfere with the service when used under normal conditions.

While we don't know exactly what's happening here, there is evidently something going awry that Apple needs to look into.

A fix or a long wait



From the sheer number of complaints in the Apple Support forum, it is an issue that Apple will almost certainly know about. Some posts also claim they have contacted Apple Support directly and that they are "aware" of reports.

However, knowing if a fix is on the way or not is another matter entirely. With no change in the situation since launch, it may be quite a while longer before Apple actually fixes whatever is wrong in macOS Sonoma.

In lieu of an Apple-provided fix, there are still a few options available to users stuck in this situation.

Some users have reported that downgrading to macOS Ventura worked for them. For the more technologically inclined, they may wish to check out some third-party tools that could help, such as macFUSE.

Switching from exFAT to another Mac-compatible format would also be a workaround, but not necessarily if you have data stored on the drives you want to keep. In that particular instance, connecting the drive up to a Mac running an older operating system or to a Windows PC that could read exFAT drives would be required.

After mounting the drives, the next move would be to back up the data, allowing you to format the drive and restore it from the backup.

There is also the possibility of using APFS or HFS with the external drives. While they will work with Mac without issue, it is possible to mount the drives onto a Windows PC using some extra software.

None of the solutions offer a quick fix that provides total access to the data on the Mac itself. Since Apple hasn't really made a move for itself to solve the problem, unfortunate users may have to force themselves to fix things for themselves.



Read on AppleInsider

dewme

Comments

  • Reply 1 of 18
    Alan1Alan1 Posts: 3member
    For what it's worth, I recently experienced this problem with several drives, none of which use the exFAT format.
    I experienced the problems on an M2 Mac, but was able to mount the drives on an older Intel Mac running an older version of Sonoma.
    dewmewatto_cobra
  • Reply 2 of 18
    webweaselwebweasel Posts: 138member
    ExFAT is an ancient format. There really ought to be something better. I used to use HFS+ with MacDrive on the PC which worked fine
    pulseimagesAlex1Nwatto_cobra
  • Reply 3 of 18
    I haven't had any issues with APFS drives. I've got one SSD connected via a monitor and two HDDs that are connected directly to my Mac. 
    watto_cobra
  • Reply 4 of 18
    I lost about 3 TB of data due to this first thinking it was faulty drives. Once I realized it was an OS problem I was in the process of restoring from a backup drive and lost data there as well killing my only other copy. The data can be reproduced but WTF Apple? 

    Not a happy camper here. 
  • Reply 5 of 18
    iPadreiPadre Posts: 1member
    I use a SanDisk Extreme Portable SSD for Time Machine. I'm not sure what update, but if I leave the drive plugged in my MacBook Pro freezes and I have to rebook. It's very frustrating.
    dewmewatto_cobra
  • Reply 6 of 18
    brianmbrianm Posts: 44member
    webweasel said:
    ExFAT is an ancient format. There really ought to be something better. I used to use HFS+ with MacDrive on the PC which worked fine
    ExFAT was released in 2006 - not really ancient (APFS was introduced in 2016).  It was specifically developed for Flash memory like USB sticks.  Microsoft even published the full specification in 2019

    Maybe you are thinking FAT32? (which was 1996, itself based on the earlier FAT16, FAT12, etc...)

    HFS+ was introduced 1998, and was an expansion/improvement on HFS introduced in 1985. wouldn't call it new either.
    Alex1Ndewmeneoncatwatto_cobra
  • Reply 7 of 18
    BGnATCBGnATC Posts: 32member
    I had a problem with a microSD card formatted as exFAT, for use with a dashcam. I was unable to access it using a card reader connected to my Mac. The same reader and card worked fine when connected to my windows PC. 
    watto_cobra
  • Reply 8 of 18
    webweaselwebweasel Posts: 138member
    brianm said:
    webweasel said:
    ExFAT is an ancient format. There really ought to be something better. I used to use HFS+ with MacDrive on the PC which worked fine
    ExFAT was released in 2006 - not really ancient (APFS was introduced in 2016).  It was specifically developed for Flash memory like USB sticks.  Microsoft even published the full specification in 2019

    Maybe you are thinking FAT32? (which was 1996, itself based on the earlier FAT16, FAT12, etc...)

    HFS+ was introduced 1998, and was an expansion/improvement on HFS introduced in 1985. wouldn't call it new either.
    Yes I was thinking of FAT32 probably, AFAIK exFAT still doesn’t have journaling or metadata support unlike the ‘older’ HFS+ so technically it’s not as advanced. 
    watto_cobra
  • Reply 9 of 18
    mdwmdw Posts: 9member
    I have 3 external Nekteck ssd hard drives, 2 are used for Carbon Copy Cloner and 1 I update every time there is a new OS to make it a install drive.
    I haven't had any problems with them.
    edited April 3 watto_cobra
  • Reply 10 of 18
    funny thing is that i had a similar issue under sonoma where i couldn’t mount an external cd drive. the system was throwing up a dialog asking permission to use the device but it was only onscreen for a blink so i couldn’t approve. to ge it to work i had to turn off that security feature 

    maybe it’s something similar. maybe it’s not. 
    watto_cobra
  • Reply 11 of 18
    MacProMacPro Posts: 19,822member
    The last Sonoma update fixed Desktop Remote on my M2 Mac Studio Ultra, it had not worked since the previous update.
    dewmewatto_cobra
  • Reply 12 of 18
    I just updated to 14.4.1 and when my computer restarted, an encrypted HFS formatted drive directory showed most of my folders were missing. I figured it was a weird glitch and ejected the drive and now it won’t mount. Says drive can’t be unlocked. Tried plugging into my laptop which is on 14.2 and I get the same error message. Can’t access through Disk Utility either. Show the drive but won’t fully mount.

    Would the update have messed with the drive in some way?
    watto_cobra
  • Reply 13 of 18
    fdogfdog Posts: 8member
    Guess I won't be checking to see if my Thunderbolt 3 Caltech NAS still works on Sonoma after all… I had been thinking about it since I belatedly moved to Ventura from Mojave last year sometime, pre final Sonoma.

    As luck would have it, it still works aside from occasional unmount issues on Ventura for me (iMac Pro)… and perhaps some Ventura crashes from the kernel extension (but I'm not going to delete it and find out I can't re-install it to verify).  Catalina was its last officially supported macOS.
    edited April 9
  • Reply 14 of 18
    What appears to be this problem has plagued the CircuitPython project since the introduction of Sonoma. The details are here: https://github.com/adafruit/circuitpython/issues/8918 with more history here: https://github.com/adafruit/circuitpython/issues/8449

    In the CircuitPython case FAT12, FAT16, and FAT32 filesystems are affected. Our analysis shows that the problem begins with the new user-space FAT drivers. With Sonoma versions prior to 14.4 the original kernel-space KEXT is also present and can be forced to load by remounting the filesystem from the command line. The problems go away when the KEXT is loaded.
    edited April 9
  • Reply 15 of 18
    mpantonempantone Posts: 2,179member
    webweasel said:
    ExFAT is an ancient format. There really ought to be something better. I used to use HFS+ with MacDrive on the PC which worked fine
    Unfortunately ExFAT is the highest common free denominator between Macs and Windows PC short of paying for a third party solution (like NTFS support from Paragon on Macs).

    I've been sneakernetting files between my Macs and Windows PCs (and sometimes Linux systems) for 25+ years and ExFAT (and FAT) are the only free ways to do things.

    MacOS can mount NTFS as read-only filesystems. I don't recall Windows even recognizing APFS filesystems. It'll see the partitions but won't mount any of them.

    It's really up to Apple and/or Microsoft to build in additional filesystem support but neither seems to be motivated to do so.
    edited April 15
  • Reply 16 of 18
    jdiamondjdiamond Posts: 131member
    This is a sad show stopper for me in upgrading to Sonoma.  I looked into MacFuse, and guess what?  They don't support exFat, because as they put it "exFat is natively supported in MacOS".  There's yet another third party package that could in principle deal with exFat.  But none of these things would prevent a defective MacOS implementation from destroying your hard drive.

    I get that Apple would probably not want to endorse exFat, but they need to either find a better solution (like support NTFS), or, since they love open source, maybe they can take MacFuse and use it to help solve their current issues?  I mean, seriously, if you have to move multi terabyte files between Mac and Windows machines, how else can it be done?
  • Reply 17 of 18
    I never have had that problem. Once I moved from Ventura to Sonoma I reformatted my Samsung external backup drives using this tutorial for both Carbon Copy Cloner and TimeMachine as well as other Samsung SSD's. They are encrypted as well. 
  • Reply 18 of 18
    Has the exFAT external drive problem been fixed in MacOS Sequoia, which was released a few days ago?
Sign In or Register to comment.