loopless

About

Username
loopless
Joined
Visits
157
Last Active
Roles
member
Points
1,134
Badges
1
Posts
369
  • A Powerbook G4 is barely fast enough to run a large language model

    mknelson said:
    "The latest M3 Ultra Mac Studio is a great, if extremely expensive, way to run massive LLMs locally. But for the hobbyist dabbling in the subject, tinkering with projects like the PowerBook G4 can still be rewarding."

    Meanwhile, over at The Cult of Mac

    "The new Mac Studio with an M3 Ultra chip, which supports up to 512 GB of unified memory, is the easiest and cheapest way to run powerful, cutting-edge LLMs on your own hardware."
    https://www.cultofmac.com/news/mac-studio-ai-performance
    Both statements are true.  To run LLMs locally you either need to invest in expensive and power-hungry GPU cards to plug into your PC OR get a 'loaded' Mac Studio . 

    Either option is not for the "hobbyist". The big advantage of the Mac Studio is low power usage and unified memory. It's a massive software PITA using GPUs with separate memory spaces.
    watto_cobra
  • iOS 18.4 will force users to upgrade to the latest HomeKit architecture

    I don't think there is any evidence that the new HomeKit architecture will make "older smart home accessories inoperable". Nothing in my home , which included some fairly old accessories , had any issues.

    I switched over fairly early to the new  architecture and my only issue at the time was with my family joining my "Home" via invitations. 

    HomeKit seems very solid now.
    ForumPostmike1jibwilliamlondonwatto_cobra
  • Apple confirms that Apple Intelligence Siri features are taking longer than expected

    You guys don’t reflect what most people use Siri for. 99% of people use Siri to dictate text and read messages or emails, and get directions using maps-  and it’s damn good at that. I don’t find google much better with understanding speech, if at all. And the second use case is to control a smart home. For both of these use cases Siri works great. If you want to ask idiotic questions about how many super bowls some team won, then go ask google. For complex questions, you want to have an interaction with ChatGPT but that’s a separate way to work with AI, and not really what Siri is intended for. Apple intelligence is not Siri. All the other tools like summaries and email categories are actually super useful. Apple has to build out massive AI compute farms and integrate Siri into iOS and apps, that takes time. And Apple likes to get things right.
    jas99ssfe11pulseimagesneoncatwilliamlondoncharlesnwatto_cobra
  • Apple's new research study is the most ambitious one yet

    SleepDoc said:
    I was excluded from the study because I have a shared icloud account. Thats going to cause problems from many people willing to participate. Thats too bad. 
    Same here
    forgot usernamebyronlwatto_cobra
  • Tim Cook quits Apple for Lumon Industries in 'Severance' promo

    Tim Cook is the ultimate CEO.. he puts his personal feelings on hold and just does what has to be done . I imagine him washing his hands for 2 minutes and maybe up chucking after dealing with the petty orange dictator.
    M68000jas99grandact73watto_cobraJanNL