discountopinion

About

Username
discountopinion
Joined
Visits
66
Last Active
Roles
member
Points
358
Badges
0
Posts
154
  • Apple researchers add 20 more open-source models to improve text and image AI

    Super happy about this trend of Apple embracing the OSS AI movement. MLX has been a game changer as well and the recent additions of distributed sharing of models across multiple Apple devices is fantastic and X has a lot of chatter about multiple Apple Studios linked via Thunderbolt cables achieving runs of massive models at good performance levels.

    This may likely spark a lot of upsells in companies that do not want to go full Nvidia on prem.
    Akh22watto_cobra
  • M4 MacBook Pro upgrade could arrive by end of 2024

    Gosh just shut up and take my money. M1Max here and it is amazing, but my arm could be twisted to get the M4. I had initially targeted upgrade by M6.

    The news that OLED may be coming for the MacBook may shave some of the weight off the 16" MacBook Pro?

    jas99watto_cobra
  • M4 Macs, iPhone 16, and more: What Apple has planned for the rest of 2024

    Yeah agreed and this is the clincher.. providing above as-is experience will cost a tonne in inference and thus Amazon may bow out as cannot see the business case. Apple on the other hand as a you and I mentioned can do PCC based queries for old HomePods and either go augmented local SoC for better experience or remain full cloud. The trend is that Apple will favour on device LLMs as CapEx is borne by the customer and given the likely SoC evolution of Apple Watch then future HomePods may have a strong local slim LLM processing capability in addition to PCC offloading.

    It does not seem to be too expensive to add the beefed up NPU to the next SoC for AW and HomePods to deliver 38+ TOPS locally. HomePod AI edition for the win.

    In summary Apple's AI roll out is super smart, business aligned and CapEx light. I am a huge fan of the HomePod format of compute and I really home Apple doubles down on its value prop.

    roundaboutnow said:
    Hi Dewme,

    I see your points and my points were not articulated well.

    Amazon seems to be abandoning Alexa and giving up on the ecosystem since it was an initial loss leader for a way to shop with Amazon that never appeared. Amazon will not continue to subsidize the Alexa ecosystem forever.

    the current use cases for both Siri and Alexa merely scratches the surface of what voice based computing can offer. Children in particular love having conversations and learning. People with vision impairment benefit from HomePods a lot.

    i didn’t mean for apple to aim for the price point of the cheap echo dots, I meant for apple to lean in on device local ai above and beyond what Alexa and current Siri are capable of.

    As home automation becomes ever more intrusive in our lives then apples privacy ethos is a great selling point. Amazon is terrible.

    the cost and price point will be determined by the capabilities of the next Apple Watch Ultra soc.



    dewme said:


    Ideally Apple will want to do a platform play and invest to also kick Alexa in the teeth. The Echo Dots of this world would then be painfully obsolete. If Apple can do a software only upgrade of AI capability through some magic then they will win the internet. There is a slight chance they can make it happen as current Siri models have a larger proportion of on device processing.

    The Echo Dots are sub $50 USD devices that get heavily discounted during Amazon’s sales events. I don’t see Apple targeting anything in that price range and sales volume. They are ubiquitous, cheap, work well, have voice recognition that puts Siri to shame, and could probably be sold in the checkout line in grocery stores. I use mine for turning on/off smart lights and smart plugs, in-house intercom, getting weather updates, setting alarms and timers, monitoring interior temperature, and automation. None of these things require more horsepower than what’s already in them. Some of the other more advanced capabilities of the Echo Dot, including integration with alarm systems using sound recognition, serving as mesh points on certain brand WiFi systems, and in the larger models, halfway decent audio playback.

    Even the cheapest and oldest Dots are more than enough for listening to radio quality music, sports broadcasts, talk shows, podcasts, etc., especially while working in the garage or shed. I wouldn’t dare put an HomePod in my garage due to living in a fairly challenging 4-season climate with snow, rain, cold, high humidity, and dust always present, regardless of the much higher price and lower functionality of Apple’s smart speakers.  Even older Echo Dot models have been updated to support Thread and Matter. How many older Apple devices are being backfitted with Thread and Matter support? 

    There’s no doubt that a 20-ton excavator would kick in the teeth of a hand shovel. But what’s the point? The Echo Dot and pretty much every current Echo device is way too low of a bar for Apple to aim for. Apple also needs to figure out how to monetize AI on some of these devices. Unlike Amazon, Apple has far more options available to take advantage of, like its customer centric ecosystem. Apple has clearly set its targets appropriately and is executing on a plan that is at least a decade in process. 

    Obviously, the Echo Dots rely on server based processing to provide what voice capabilities they have. One possible solution for the HomePods and Apple TVs would be to give the customer the ability to opt-in to Apple's Private Cloud in a manner similar to what is being proposed for access to ChatGPT when a request exceeds Apple Intelligence on-device capability.

    Alex1Nwatto_cobra
  • M4 Macs, iPhone 16, and more: What Apple has planned for the rest of 2024

    Hi Dewme,

    I see your points and my points were not articulated well.

    Amazon seems to be abandoning Alexa and giving up on the ecosystem since it was an initial loss leader for a way to shop with Amazon that never appeared. Amazon will not continue to subsidize the Alexa ecosystem forever.

    the current use cases for both Siri and Alexa merely scratches the surface of what voice based computing can offer. Children in particular love having conversations and learning. People with vision impairment benefit from HomePods a lot.

    i didn’t mean for apple to aim for the price point of the cheap echo dots, I meant for apple to lean in on device local ai above and beyond what Alexa and current Siri are capable of.

    As home automation becomes ever more intrusive in our lives then apples privacy ethos is a great selling point. Amazon is terrible.

    the cost and price point will be determined by the capabilities of the next Apple Watch Ultra soc.



    dewme said:


    Ideally Apple will want to do a platform play and invest to also kick Alexa in the teeth. The Echo Dots of this world would then be painfully obsolete. If Apple can do a software only upgrade of AI capability through some magic then they will win the internet. There is a slight chance they can make it happen as current Siri models have a larger proportion of on device processing.

    The Echo Dots are sub $50 USD devices that get heavily discounted during Amazon’s sales events. I don’t see Apple targeting anything in that price range and sales volume. They are ubiquitous, cheap, work well, have voice recognition that puts Siri to shame, and could probably be sold in the checkout line in grocery stores. I use mine for turning on/off smart lights and smart plugs, in-house intercom, getting weather updates, setting alarms and timers, monitoring interior temperature, and automation. None of these things require more horsepower than what’s already in them. Some of the other more advanced capabilities of the Echo Dot, including integration with alarm systems using sound recognition, serving as mesh points on certain brand WiFi systems, and in the larger models, halfway decent audio playback.

    Even the cheapest and oldest Dots are more than enough for listening to radio quality music, sports broadcasts, talk shows, podcasts, etc., especially while working in the garage or shed. I wouldn’t dare put an HomePod in my garage due to living in a fairly challenging 4-season climate with snow, rain, cold, high humidity, and dust always present, regardless of the much higher price and lower functionality of Apple’s smart speakers.  Even older Echo Dot models have been updated to support Thread and Matter. How many older Apple devices are being backfitted with Thread and Matter support? 

    There’s no doubt that a 20-ton excavator would kick in the teeth of a hand shovel. But what’s the point? The Echo Dot and pretty much every current Echo device is way too low of a bar for Apple to aim for. Apple also needs to figure out how to monetize AI on some of these devices. Unlike Amazon, Apple has far more options available to take advantage of, like its customer centric ecosystem. Apple has clearly set its targets appropriately and is executing on a plan that is at least a decade in process. 

    williamlondondewmeAlex1Nwatto_cobra
  • M4 Macs, iPhone 16, and more: What Apple has planned for the rest of 2024

    HomePod upgrade path for AI is sorely needed as Siri for HomePod is just awful at this stage. I have observed a deterioration over the past updates of OS or maybe the HomePod 2's have worse microphones. Frustrating part is that there are no diagnostics mechanisms that easily enable a customer to understand why there are challenges.

    HomePod compute will likely follow Apple Watch Ultra 3 SoC upgrade to build volume for the SoC. The mini may not benefit in the same way unless as previous commentators have mentioned that AI on HomePod can be more lightweight due to fewer use cases needed support.

    Ideally Apple will want to do a platform play and invest to also kick Alexa in the teeth. The Echo Dots of this world would then be painfully obsolete. If Apple can do a software only upgrade of AI capability through some magic then they will win the internet. There is a slight chance they can make it happen as current Siri models have a larger proportion of on device processing.

    As a minimum a software only upgrade of Siri will defer more back to the Private Cloud Compute again to lean in on larger models for the older HomePods and then a new series HomePod 3 will be fully on device. I would revert back to the extra latency again for proper fidelity Siri on older devices rather than the current issues.
    williamlondonwatto_cobra