virgilisleading42

brianus said:

tiredskills said:

Why on earth would I want to run an AI model?  Locally or otherwise?

I’m sure this was meant to be snarky, but for me it’s a genuine question: what are the envisioned real world use cases? What might a business (even a home one) use a local LLM for?

The article mentions a hospital in the context of patient privacy, but what would that model actually be *doing*?

I think the big thing is for creative tasks. There are a lot of uses for AI in creative industries, but we don't want our material input being used to output somewhere else. So all image generation stuff is helpful to do locally. You know, as an artist, your content isn't being fed into the online system for others to use, but you still gain the value of using AI tools. Another amazing use case is text-to-video generation. It is prohibitively expensive to use text-to-video generation online, and very little output for the price. The ability to do that locally would be game-changing from a business perspective. Well worth the money. Leading-edge text-to-video models cost 1k or more to have enough output to make them valuable for business. Also there are tons of other use cases. 

This rumor seems highly unlikely. Very few people use a cable to transfer anything from a phone. They really only use lighting or usb-c for charging. It seems like an expanse that is only needed by such a small minority of users.  It seems more likely that iPhone 15 goes completely wireless charging. 

This article says the speed improvements only work on Mac OS 12.3 but 12.3 isn't out yet. Is that a typing error or do we need to wait for the operating system update to take advantages of the speed enhancements. 

Xed said:

I'm glad to see this as the outcome. I believe this will not only help ARM's future, but also the future of computing as a whole.

I actually think this is going to be really hard for ARM. Probably a great thing for Nvidia though but hard for ARM. They are not a very profitable company and need a bigger company to own them and put up with the lack of profitability for the prestigae of it. Their business model requires a lot of money on R&D. Last year they made only 274 million dollars of Net income. Intel, AMD, and Nvidia make almost 65% margin on their businesses and large profits. Intel for example made 19 billion dollars in Net Income last year even though ARM was in far more machines. I'm not sure the stock market is going to look to favorable on a company that's been around for over 30 years and barely making any profit at all.  

Another thing is people get so much botox now that their mouths don't move fully anymore. Making them look unnatural.