discountopinion
About
- Username
- discountopinion
- Joined
- Visits
- 60
- Last Active
- Roles
- member
- Points
- 348
- Badges
- 0
- Posts
- 130
Reactions
-
M4 Macs, iPhone 16, and more: What Apple has planned for the rest of 2024
Yeah agreed and this is the clincher.. providing above as-is experience will cost a tonne in inference and thus Amazon may bow out as cannot see the business case. Apple on the other hand as a you and I mentioned can do PCC based queries for old HomePods and either go augmented local SoC for better experience or remain full cloud. The trend is that Apple will favour on device LLMs as CapEx is borne by the customer and given the likely SoC evolution of Apple Watch then future HomePods may have a strong local slim LLM processing capability in addition to PCC offloading.
It does not seem to be too expensive to add the beefed up NPU to the next SoC for AW and HomePods to deliver 38+ TOPS locally. HomePod AI edition for the win.
In summary Apple's AI roll out is super smart, business aligned and CapEx light. I am a huge fan of the HomePod format of compute and I really home Apple doubles down on its value prop.
roundaboutnow said:discountopinion said:Hi Dewme,
I see your points and my points were not articulated well.
Amazon seems to be abandoning Alexa and giving up on the ecosystem since it was an initial loss leader for a way to shop with Amazon that never appeared. Amazon will not continue to subsidize the Alexa ecosystem forever.
the current use cases for both Siri and Alexa merely scratches the surface of what voice based computing can offer. Children in particular love having conversations and learning. People with vision impairment benefit from HomePods a lot.
i didn’t mean for apple to aim for the price point of the cheap echo dots, I meant for apple to lean in on device local ai above and beyond what Alexa and current Siri are capable of.
As home automation becomes ever more intrusive in our lives then apples privacy ethos is a great selling point. Amazon is terrible.
the cost and price point will be determined by the capabilities of the next Apple Watch Ultra soc.dewme said:discountopinion said:
Ideally Apple will want to do a platform play and invest to also kick Alexa in the teeth. The Echo Dots of this world would then be painfully obsolete. If Apple can do a software only upgrade of AI capability through some magic then they will win the internet. There is a slight chance they can make it happen as current Siri models have a larger proportion of on device processing.
Even the cheapest and oldest Dots are more than enough for listening to radio quality music, sports broadcasts, talk shows, podcasts, etc., especially while working in the garage or shed. I wouldn’t dare put an HomePod in my garage due to living in a fairly challenging 4-season climate with snow, rain, cold, high humidity, and dust always present, regardless of the much higher price and lower functionality of Apple’s smart speakers. Even older Echo Dot models have been updated to support Thread and Matter. How many older Apple devices are being backfitted with Thread and Matter support?
There’s no doubt that a 20-ton excavator would kick in the teeth of a hand shovel. But what’s the point? The Echo Dot and pretty much every current Echo device is way too low of a bar for Apple to aim for. Apple also needs to figure out how to monetize AI on some of these devices. Unlike Amazon, Apple has far more options available to take advantage of, like its customer centric ecosystem. Apple has clearly set its targets appropriately and is executing on a plan that is at least a decade in process.
-
M4 Macs, iPhone 16, and more: What Apple has planned for the rest of 2024
Hi Dewme,
I see your points and my points were not articulated well.
Amazon seems to be abandoning Alexa and giving up on the ecosystem since it was an initial loss leader for a way to shop with Amazon that never appeared. Amazon will not continue to subsidize the Alexa ecosystem forever.
the current use cases for both Siri and Alexa merely scratches the surface of what voice based computing can offer. Children in particular love having conversations and learning. People with vision impairment benefit from HomePods a lot.
i didn’t mean for apple to aim for the price point of the cheap echo dots, I meant for apple to lean in on device local ai above and beyond what Alexa and current Siri are capable of.
As home automation becomes ever more intrusive in our lives then apples privacy ethos is a great selling point. Amazon is terrible.
the cost and price point will be determined by the capabilities of the next Apple Watch Ultra soc.dewme said:discountopinion said:
Ideally Apple will want to do a platform play and invest to also kick Alexa in the teeth. The Echo Dots of this world would then be painfully obsolete. If Apple can do a software only upgrade of AI capability through some magic then they will win the internet. There is a slight chance they can make it happen as current Siri models have a larger proportion of on device processing.
Even the cheapest and oldest Dots are more than enough for listening to radio quality music, sports broadcasts, talk shows, podcasts, etc., especially while working in the garage or shed. I wouldn’t dare put an HomePod in my garage due to living in a fairly challenging 4-season climate with snow, rain, cold, high humidity, and dust always present, regardless of the much higher price and lower functionality of Apple’s smart speakers. Even older Echo Dot models have been updated to support Thread and Matter. How many older Apple devices are being backfitted with Thread and Matter support?
There’s no doubt that a 20-ton excavator would kick in the teeth of a hand shovel. But what’s the point? The Echo Dot and pretty much every current Echo device is way too low of a bar for Apple to aim for. Apple also needs to figure out how to monetize AI on some of these devices. Unlike Amazon, Apple has far more options available to take advantage of, like its customer centric ecosystem. Apple has clearly set its targets appropriately and is executing on a plan that is at least a decade in process.
-
M4 Macs, iPhone 16, and more: What Apple has planned for the rest of 2024
HomePod upgrade path for AI is sorely needed as Siri for HomePod is just awful at this stage. I have observed a deterioration over the past updates of OS or maybe the HomePod 2's have worse microphones. Frustrating part is that there are no diagnostics mechanisms that easily enable a customer to understand why there are challenges.
HomePod compute will likely follow Apple Watch Ultra 3 SoC upgrade to build volume for the SoC. The mini may not benefit in the same way unless as previous commentators have mentioned that AI on HomePod can be more lightweight due to fewer use cases needed support.
Ideally Apple will want to do a platform play and invest to also kick Alexa in the teeth. The Echo Dots of this world would then be painfully obsolete. If Apple can do a software only upgrade of AI capability through some magic then they will win the internet. There is a slight chance they can make it happen as current Siri models have a larger proportion of on device processing.
As a minimum a software only upgrade of Siri will defer more back to the Private Cloud Compute again to lean in on larger models for the older HomePods and then a new series HomePod 3 will be fully on device. I would revert back to the extra latency again for proper fidelity Siri on older devices rather than the current issues. -
Apple Intelligence & Private Cloud Compute are Apple's answer to generative AI
Completely blown away with the measured and savvy AI strategy from Apple. Rather than getting into the Buy all the Nvidia cards war of attrition they are doing things a lot smarter. Much of the inference "Capex" will be borne by the customer since inference is on device. Brilliant PCC stuff and smart pluggable OpenAI integration that can be swapped out if needed in the future.
I also think their image generation models are careful as to not alienate their key partners in the creative space, while providing useful things for all consumer normies.
Big letdown was no explicit reveal on HomePod Siri which is frankly lobotomised at this stage.
Overall I see mass device upgrades in the future as people want to benefit from all the benefits. Math Notes is incredible.
I am thinking that Apple may have some form of optionality in models they use for M1, 2, 3 and 4 given that their RAM config and NPU spec varies a lot. -
Apple and OpenAI allegedly reach deal to bring ChatGPT functionality to iOS 18
Hmmm not convinced they will do it as portrayed as there as some similar adoption use cases in the past that bit Apple while at the same time bought them time.
It makes sense for Apple to bundle a LLM service into their iCloud+ subscription, be it OpenAI or Anthropic. Google's Gemini is a no-go since they are embedding it into Android and also since they are already in hot water with the Google search deal.
Would not an option be to lean into the OSS movement and I am also thinking that if Apple takes Llama 3 and throws a lot of tuning and compute at it could form the core of a service offering as well?
I think they will go Apple in house for Siri given that they have great on device models already in open source.