Apple Silicon Mac Pro could combine two M1 Ultra chips for speed

Posted:
in Future Apple Hardware
The Apple Silicon Mac Pro may follow the lead of the Mac Studio's M1 Ultra, a rumor claims, by effectively combining two M1 Ultra chips into a single 40-core SoC.




Apple's "Peek Performance" event included a brief tease for a Mac Pro using Apple Silicon, opening the door to speculation about the inbound update. In one rumor, it is said that Apple will go one stage further than it did with the Mac Studio in reusing its existing chips in new ways.

For the Mac Studio, Apple introduced the M1 Ultra, a chip that connected together two M1 Max chips with a die-to-die interconnect called UltraFusion. The concept effectively makes two chips work as one singular powerful version, complete with 20 CPU cores, a 64-core GPU, and 32 Neural Engine cores.

An image leak by "Majin Bu" on Twitter claims to show a schematic for an interconnect that will connect "2 M1 Ultra together," extending the concept by another level. The leaker says the bridge will be "found in the new 2022 Mac Pro," with a processor name of "Redfern," and is scheduled for a September release.

If the image is correct, the supposed four-chip assembly will practically introduce a new long bridge that sits the two M1 Ultra assemblies side by side. Three interconnects would be used in total to connect the four M1 Max chips, including the two used to form a pair of M1 Ultra chips.

However, the interconnect as shown would have some limitations. Without a newer bridging technology, RAM would be limited to the same 128GB as the Mac Studio supports.

The idea of a Mac Pro with such a high number of cores has been presented in earlier rumors. In May 2021, there were claims the Mac Pro could use chips with 20 or 40 computing cores, and graphics options with either 64 or 128 cores.

If the leak is genuine, the proposed Apple Silicon chip will offer considerably more cores than the existing Mac Pro offers. Under the existing Intel version, the maximum amount of cores is offered by a 28-core Intel Xeon W processor. But, maximum RAM would be less on the Apple Silicon Mac Pro versus the Intel Mac Pro.

Read on AppleInsider
«134

Comments

  • Reply 1 of 73
    stuartfstuartf Posts: 64member
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart
    tmayviclauyyclkruppy2anapplguyargonautwatto_cobra
  • Reply 2 of 73
    If Mac Pro makes it before M2 Gen, then I’d say this is pretty much what we expect. M1 Ultra x1, x2, x4, x6, and x8. Major power. Hefty price tag. And possibly 2nd Gen ProDisplay XDR launches with it.

    And, fingers crossed, some expandability.

    We shall see…
    watto_cobra
  • Reply 3 of 73
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart
    John Ternus, yeah. It makes more sense to present an M2 chip with new tech that allows for 2 or 4 TB RAM, as there are likely game studios and animation studios like Pixar and their Dreamworks rival wanting massive amounts of RAM for highly sophisticated 3D rendering. I know rhey hot rendering farms already, but I imagine Apple’s hardware could make initial animation sketching and storyboarding more efficient?
    williamlondonwatto_cobra
  • Reply 4 of 73
    I’m waiting for a video meme where you see a super-long chip, which just goes on and on for a minute until it is presented as the ”Apple M1 200X Ultra” or something.
    watto_cobra
  • Reply 5 of 73
    22july201322july2013 Posts: 3,753member
    I'm surprised TSMC can keep a new headlining chip for Apple a secret.
    watto_cobra
  • Reply 6 of 73
    crowleycrowley Posts: 10,453member
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart
    Something can be complete and still be added to.
    mwhite
  • Reply 7 of 73
    MarvinMarvin Posts: 15,515moderator
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    williamlondonviclauyycwatto_cobra
  • Reply 8 of 73
    XedXed Posts: 2,928member
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    I think Ultra Pro could still be on the table since it would reference the Mac Pro. Since these are marketing names, adhering strictly to Latin etymology doesn't need to happen.
    edited March 2022 Beatstenthousandthingswatto_cobraFileMakerFeller
  • Reply 9 of 73
    rob53rob53 Posts: 3,325member
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    This isn't what I've seen from people on youtube. There isn't an UltraFusion connector to tie into the vertical area you're showing and simply rotating them doesn't work either. What I've seen is two stacked Ultras with a double height connector in the middle so connection lengths are minimal. The only way they get the bus speed is to keep the UltraFusion as short as possible. They've also talked about how the Ultra's UltraFusion connection is added once the Maxes have been created and tested. The Ultra is only created when two Maxes test 100% side by side, then the 10K connections are made.The good Maxes next to bad Maxes are cut out and used in MBPs while some of the bad Maxes can still be used as binned or have some parts cut off and used as a Pro. Apple is trying to maximize chip production. Putting two Ultras together like you're suggesting means very few Duo Ultras can be produced from a single platter. It would make more sense to create Ultras, test them, cut them out then stack them together. 

    I don't want to violate copyrighted images so check out max tech, Apple's M2 Ultra DUO Mac Pro, 7:34 mark.
    edited March 2022 tenthousandthingsfastasleepwatto_cobraFileMakerFeller
  • Reply 10 of 73
    BeatsBeats Posts: 3,073member
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart

    I was sure he said there was one more in the lineup but I’m probably wrong at this point. 
  • Reply 11 of 73
    programmerprogrammer Posts: 3,490member
    My guess is that the Mac Pro will use the same M1 Ultra as the Mac Studio does.  The difference will be in the system around the SoC.  With a larger form factor, they have more cooling potential and could bump up the clock rates a little... but really, the M1 Ultra is a monster as it is (both in terms of size and performance).  I would just take what Turnes said at face value, this is already the last of the M1 series.  And I think we will see a Mac Pro that uses it.

    So what could differentiate the Mac Pro?  In a word:  expandability.

    1) PCIe slots.  The M1 Ultra seems to have plenty of I/O potential, and a fast PCIe bridge chip would easily enable a lot of expansion potential.

    2) Drive bays.  The Mac Pro would have the same built-in super fast SSD, but in a large case a whole lot of additional storage can be accommodated.

    3) RAM.  This is where it gets tricky.  The Apple Silicon approach is to use in-package memory, and there are real constraints on how much can be put into a single package.  Some Pros just need more than can be fit into a single package, or more than is worth building in the TSMC production run.  So conventional DIMMs are needed to supplement the super fast in-package memory.  The question is, how does OSX use it?  Apple seems to want to keep the programming model simple (i.e. CPU/GPU shared memory with a flat/uniform 64-bit virtual address space), so having some fast vs slow areas of memory doesn't seem like the direction they want to go in (although they could and just rely on the M1 Ultra's ENORMOUS caches).  They are already doing virtual memory paging to flash, however... so why not do virtual memory paging to the DIMMs instead?  Big DMA data transfers between in-package and on-DIMM memory across the very fast PCIe 5.0 lanes would ensure that the available bandwidth is used as efficiently as possible, and the latency is masked by the big (page-sized) transfers.  A 128GB working memory (the in-package RAM) is huge, so doing VMM to get to the expanded pool is not as bad as you might think.  Such a memory scheme may even just sit on PCIe cards so buyers only need to pay for the DIMM slots if they really need it.  Such "RAM disk" cards have been around for ages, but are usually hampered by lack of direct OS support... and issue Apple could fix easily in their kernel.

    bsimpsenmjtomlinviclauyycrundhvidfastasleepwatto_cobra
  • Reply 12 of 73
    dk49dk49 Posts: 287member
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart
    Agreed. I think Apple will have a new architecture for the Pro that focuses on scalability and modularity too. Giving Pro users a fixed set of specs for its lifetime is not a great idea, even if the specs are the best by far.

    I think Apple will comeup with a version of Ultra fusion that allows using multiple SOCs without performance issues. They might even come up with GPU only chips that users can add as an extra GPU, or maybe give users the ability to swap entire SOCs in future.
    watto_cobra
  • Reply 13 of 73
    crowleycrowley Posts: 10,453member
    Beats said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart
    I was sure he said there was one more in the lineup but I’m probably wrong at this point. 
    He said there was one more Mac, the Mac Pro.
    fastasleepFileMakerFeller
  • Reply 14 of 73
    bsimpsenbsimpsen Posts: 402member
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    The UltraFusion interconnect strip was first spotted months ago, and it's only on one edge of the Max die. There is nothing on the die that would connect to the vertical strip shown in your mockup. Any interconnect circuitry on the die would also have to be on both sides, as the die is rotated 180 degrees for the M1 Ultra connection. Memory bandwidth in the configuration you've shown would also be cut in half for each M1 Max chip, as each is now connected to only two memory modules instead of four.

    I think it's safe to say this isn't happening.

    My guess is that the Mac Pro will use the same M1 Ultra as the Mac Studio does.
    I agree.
    williamlondonnetroxprogrammerwatto_cobraFileMakerFeller
  • Reply 15 of 73
    crowleycrowley Posts: 10,453member
    bsimpsen said:
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    The UltraFusion interconnect strip was first spotted months ago, and it's only on one edge of the Max die. There is nothing on the die that would connect to the vertical strip shown in your mockup. Any interconnect circuitry on the die would also have to be on both sides, as the die is rotated 180 degrees for the M1 Ultra connection. Memory bandwidth in the configuration you've shown would also be cut in half for each M1 Max chip, as each is now connected to only two memory modules instead of four.

    I think it's safe to say this isn't happening.
    While it certainly isn't as easy as copy and pasting the UltraFusion interconnect and transposing it to the side, it's also not impossible that Apple have an additional interconnect designed that they aren't currently shipping, or that they'll use an I/O bridge with the existing interconnect to connect more than two together.  Unlikely perhaps, but not impossible.

    This was speculated on shortly after the M1 Pro and Max reveal: 


    edited March 2022
  • Reply 16 of 73
    XedXed Posts: 2,928member
    bsimpsen said:
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    The UltraFusion interconnect strip was first spotted months ago, and it's only on one edge of the Max die. There is nothing on the die that would connect to the vertical strip shown in your mockup. Any interconnect circuitry on the die would also have to be on both sides, as the die is rotated 180 degrees for the M1 Ultra connection. Memory bandwidth in the configuration you've shown would also be cut in half for each M1 Max chip, as each is now connected to only two memory modules instead of four.

    I think it's safe to say this isn't happening.
    I hear what you're saying, but I don't think your logic that because we haven't got a glimpse about another interconnect means that it's impossible. As for "nothing on die" we have no way of knowing what's on that die that could tie 4 chips together. If Apple can make an interconnect to tie two M1 Maxes together why do you think it's impossible for them make another one that will tie 4 of them together? Is this based solely on the configuration shown above?

    How about putting all the M1 Max interconnects facing towards each other with Apple obviously making another Interconnect that would tie all 4 together with another chip? I think it's doable, I just don't know if the number of Mac Pros being sold would warrant the cost of development and production.

    I have no idea what Apple will do, but I'm not going to say it's impossible simply because it hasn't been done yet.


    edited March 2022 williamlondonfastasleepwatto_cobra
  • Reply 17 of 73
    mjtomlinmjtomlin Posts: 2,694member
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design


    Stuart

    1. It could in fact still be called an M1 Ultra, just adds two new upgrade options…
    20/48, 20/64, 40/96, 40/128

    2. That’s definitely possible. Maybe they break apart the SoC into a few discrete chips; X1 CPU (32/48/64), G15 GPU (96/128/160), and a new “Afterburner” card with all the other bits; Neural Engine, Video Codecs, ISP, etc. that way they could still offer Intel XEON and AMD GPUs for professionals that needed it.
    watto_cobra
  • Reply 18 of 73
    MarvinMarvin Posts: 15,515moderator
    rob53 said:
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.
    This isn't what I've seen from people on youtube. There isn't an UltraFusion connector to tie into the vertical area you're showing and simply rotating them doesn't work either. What I've seen is two stacked Ultras with a double height connector in the middle so connection lengths are minimal. The only way they get the bus speed is to keep the UltraFusion as short as possible. They've also talked about how the Ultra's UltraFusion connection is added once the Maxes have been created and tested. The Ultra is only created when two Maxes test 100% side by side, then the 10K connections are made.The good Maxes next to bad Maxes are cut out and used in MBPs while some of the bad Maxes can still be used as binned or have some parts cut off and used as a Pro. Apple is trying to maximize chip production. Putting two Ultras together like you're suggesting means very few Duo Ultras can be produced from a single platter. It would make more sense to create Ultras, test them, cut them out then stack them together. 

    I don't want to violate copyrighted images so check out max tech, Apple's M2 Ultra DUO Mac Pro, 7:34 mark.
    If they can do stacking with the UltraFusion, that would be good. The connector between separate M1 Ultra chips wouldn't have to be UltraFusion, it can be a lower bandwidth connection. Apple has used Infinity Fabric for the GPUs in the Mac Pro (84GB/s). Nvidia's NVLink can transfer at up to 600GB/s.

    The faster the better of course but for machines like the Mac Pro where the workloads will be highly parallel, they can treat them independently and it will still scale very well as it does for the AMD GPUs:

    https://barefeats.com/pro-w6800x-quadruple.html

    Apps like After Effects and Da Vinci can send the same data to each Ultra chip and render different frames and it will give a linear speedup. Even single frames can be split and processed separately, including real-time. Multi-GPU systems do this all the time.

    From what Apple described, it doesn't sound like they'll make a 4-die chip with a 4-way UltraFusion unless they figured out a way to stack it. They can just connect two separate M1 Ultras with a lower bandwidth connection. They can call it Ultra Duo or Ultra II. They could have more than two if they have a bigger box but I don't think they need to.
    williamlondonfastasleepwatto_cobra
  • Reply 19 of 73
    zimmiezimmie Posts: 651member
    My guess is that the Mac Pro will use the same M1 Ultra as the Mac Studio does.  The difference will be in the system around the SoC.  With a larger form factor, they have more cooling potential and could bump up the clock rates a little... but really, the M1 Ultra is a monster as it is (both in terms of size and performance).  I would just take what Turnes said at face value, this is already the last of the M1 series.  And I think we will see a Mac Pro that uses it.

    So what could differentiate the Mac Pro?  In a word:  expandability.

    1) PCIe slots.  The M1 Ultra seems to have plenty of I/O potential, and a fast PCIe bridge chip would easily enable a lot of expansion potential.

    2) Drive bays.  The Mac Pro would have the same built-in super fast SSD, but in a large case a whole lot of additional storage can be accommodated.

    3) RAM.  This is where it gets tricky.  The Apple Silicon approach is to use in-package memory, and there are real constraints on how much can be put into a single package.  Some Pros just need more than can be fit into a single package, or more than is worth building in the TSMC production run.  So conventional DIMMs are needed to supplement the super fast in-package memory.  The question is, how does OSX use it?  Apple seems to want to keep the programming model simple (i.e. CPU/GPU shared memory with a flat/uniform 64-bit virtual address space), so having some fast vs slow areas of memory doesn't seem like the direction they want to go in (although they could and just rely on the M1 Ultra's ENORMOUS caches).  They are already doing virtual memory paging to flash, however... so why not do virtual memory paging to the DIMMs instead?  Big DMA data transfers between in-package and on-DIMM memory across the very fast PCIe 5.0 lanes would ensure that the available bandwidth is used as efficiently as possible, and the latency is masked by the big (page-sized) transfers.  A 128GB working memory (the in-package RAM) is huge, so doing VMM to get to the expanded pool is not as bad as you might think.  Such a memory scheme may even just sit on PCIe cards so buyers only need to pay for the DIMM slots if they really need it.  Such "RAM disk" cards have been around for ages, but are usually hampered by lack of direct OS support... and issue Apple could fix easily in their kernel.
    On the topic of RAM, there's nothing inherent in the M1's design which precludes off-package RAM. They have a RAM controller on the chips, and the RAM controller is shared between CPU and GPU cores, but there's no fundamental reason the RAM couldn't be in DIMMs. Apple just hasn't chosen to do that. They might do so with the Mac Pro, or they might not. I don't see them doing a tiered memory structure, though. They just went to significant lengths to do away with NUMA concerns on the M1 Ultra.

    With the introduction of the Mac Studio, I wouldn't be surprised to see the Mac Pro go primarily rackmount. Very few people need more computing power than the Mac Studio offers at their desks. Almost everyone who does need more computing power is in an environment where they can rack the computer in a closet. For example, recording studios, film studios, scientific labs, and so on all have 19" rack space for other equipment, so putting specialist workstations in there isn't a stretch. That said, rackmount would mostly be relevant for a box with several full-height, full-length PCIe slots (e.g., to add hardwired audio and video inputs), and I'm not yet convinced Apple is interested in that at all. They might say the future is a rackmount interface which connects to the system via Thunderbolt. I'd be curious to know what they have seen the current rackmount Mac Pro doing.

    Called the idea of using one high-end die in the laptops, then multiple high-end dies in the high-performance desktops, but I expected it to be the M1 Max Duo or something rather than a whole new name. I did get the dGPU very wrong, though. I didn't quite understand at that time just how powerful Apple's GPU cores are.
    williamlondonrundhvidwatto_cobraFileMakerFeller
  • Reply 20 of 73
    mjtomlinmjtomlin Posts: 2,694member
    Marvin said:
    stuartf said:
    Except…

    John Turnes of Apple quite literally said that the M1 Ultra completes the M1 line up just days ago

    It is more likely that the MacPro will be based on M2 silicon or even a completely different design
    Maybe but they could also have designed the Ultra chip to be able to join to other Ultra chips in which case it doesn't need a new name. The diagram shows two M1 Ultras connected in the middle using a different connector:



    The Mac Pro can be offered with M1 Ultra at the entry level and an M1 Ultra Duo. There is no higher name than Ultra. Pro = better, Max = maximum, Ultra = beyond maximum. They can only call it Ultra something like infinity + 1. I expect they will be able to offer 256GB RAM on the Ultra Duo. The amount of RAM they need to offer is just what people have been installing, they don't need to support 1TB+ just because other computers do.

    Not quite sure that’s physically possible as the memory interfaces are on the sides of the chip…


    edited March 2022 watto_cobraFileMakerFeller
Sign In or Register to comment.