y2an

About

Username
y2an
Joined
Visits
39
Last Active
Roles
member
Points
457
Badges
1
Posts
193

Reactions

239Like24Informative

  • Your next iPhone could be the iPad mini - iPhone 15 vs iPad mini showdown

    y2any2an
    The mini 4 screen size was great. I still have mine because the new mini has too small a screen for browsing YouTube in landscape. 
    williamlondon

  • Apple's macOS 15 to get rare cognitive boost via Project GreyParrot

    y2any2an
    One has to wonder about the why here, if this is true. Apple is deliberate. Where would this fit into their strategy? Or was this just the result of a summer intern project that was good enough to release?

    Having experimented with multiples, I use Free42 for most of my needs. RPN is essential. 
    williamlondon

  • Apple in talks to license Google Gemini AI for iPhones

    y2any2an
    Talks would be aimed at establishing whether Apple can move better and faster with its own LLM technology, Open AI, or Google. They are under tremendous competitive pressure versus every other tech company and have to accelerate. This is what you do. They bought Beats to get into streaming faster. They turned on a dime to use Imagination Tech for their new GPUs (after very publicly dropping them). I see no hand-wringing here, just exploring all options to move much faster. Likewise they moved the (supposed) car team engineers into other products, I would guess likewise to shore up their AI acceleration efforts in those the immediate future. 
    9secondkox2Alex1Nwatto_cobra

  • Apple demonstrates its commitment to AI with new open source code release

    y2any2an
    discountopinion said:
    I think the view that Apple may develop dedicated server side ML/AI accelerators for their own internal use with iCloud is right on the money and is on trend with what the other hyper scalers have been doing or are doing. Services is increasingly a larger proportion of overall gross margin and a reason why flat/sluggish device sales do not dramatically affect earnings. Apple will have the margins and incentive to go all in on server side AI for internal use.

    Generative AI is here to stay and we are seeing very early days of adoption and what is clear is that it will be an incredible eater of compute. Anyone wanting to be in the services game going forward will have to spend a lot so it makes perfect business sense for Apple to build in house.

    Nvidia has held the generative AI server side market captive for a while and AMD is now providing some competition and more importantly more supply. Nvidia have been supply blocked for a long time.

    Apple's privacy ethos will likely continue to drive model inference to be run on end user devices so as little as possible runs over the wire back to Apple. How this affects their model development I do not know. Likely we may see increasing self-tuning of models on device to enable your local context to be optimally effective. This will likely mean there is a nice client chip - server chip co-development synergy and maybe also interesting opportunities for optimisation.

    Training of models and model development is super heavy lifting so Mac Pro will likely evolve into an AI beast to run as much locally rather than have to phone home to cloud based services. I cannot see AI heavy video tools uploading terabytes of video to the cloud instead of running locally.

    People have posted that inference requires a lot of memory bandwidth and expressed disappointment in the lower memory bandwidth of M3 vs M2 and overall much lower than a Nvidia 40XX. I am no expert in the topic and I hope that the released libs from Apple may help the common inference tool stack leverage the Apple Silicon design instead of executing like it was on a vanilla GPU.

    Will we see multiple M4 Ultra SoCs in a Mac Pro AI edition in the future? A clue to this would be if there is a fast interconnect fabric available for the M series chips. Overall Apple's lead in performance per watt will be a massive advantage as Nvidia cards will soon require a side loaded small fusion reactor to run.


    This bears all the hallmarks of being written by an AI :-O
    gatorguywilliamlondon

  • MacBook Pro 16-inch M3 Max review: Battery-powered Mac Pro power

    y2any2an
    The most notable thing here is not the M3 performance but that Apple is capable of delivering 3 versions of one of the most complex SoC’s in the world on the world’s most advanced node in one step. Competitor design houses, take note. Also, remember (to everyone’s surprise and puzzlement) when they bought all the flash memory around the world - they knew what was coming next. They’ve bought all TSMC’s 3nm capacity, so what comes next…?
    killroywilliamlondon