blastdoor

DAalseth said:

They’re going to be surprised when a lot of sites, likely including AI, just turn comments off due to liability concerns. Most of the web will just go silent. 

The news of expanded office space follows a report that Apple TV+ budgets are being cutbecause the service is losing Apple money

tiredskills said:

blastdoor said:

tiredskills said:

blastdoor said:

tiredskills said:

jeff fields said:

tiredskills said:

Why on earth would I want to run an AI model?  Locally or otherwise?

If you don't already know, perhaps you should pause on commenting in public until you've spent 15 seconds figuring it out.

Suffice it to say that many people have very good reasons to do this.

Such as?

I am obviously not one of those people, so am asking why.  Your answer is not illuminating.

Are you retired? If so then don’t worry about it. 

I am not.  I work in enterprise software development.  I have seen nothing significantly useful from this AI revolution so far, just a lot of fakery, deception and disruption of trust.  These are unequivocally bad things to my mind.

So I ask again, why would I want to run an AI model?  Locally or otherwise?

It's probably best that you don't use them -- leave it to others. Just stick to your comfort zone. 

If you can’t think of any answers it’s perfectly fine to just say so.

tiredskills said:

blastdoor said:

tiredskills said:

jeff fields said:

tiredskills said:

Why on earth would I want to run an AI model?  Locally or otherwise?

If you don't already know, perhaps you should pause on commenting in public until you've spent 15 seconds figuring it out.

Suffice it to say that many people have very good reasons to do this.

Such as?

I am obviously not one of those people, so am asking why.  Your answer is not illuminating.

Are you retired? If so then don’t worry about it. 

I am not.  I work in enterprise software development.  I have seen nothing significantly useful from this AI revolution so far, just a lot of fakery, deception and disruption of trust.  These are unequivocally bad things to my mind.

So I ask again, why would I want to run an AI model?  Locally or otherwise?

Stabitha_Christie said:

blastdoor said:

Stabitha_Christie said:

blastdoor said:

Stabitha_Christie said:

blastdoor said:

Even though the Mac Studio with M3 Ultra seems like a great option for LLM usage and development, there is a big drawback in terms of cost.

But compared to what? How much would you have to spend to do the same job on a PC?

This was actually covered in the video. You can rent a ton of server time for the cost of a maxed out Mac Studio. So if you are just using it for development or general LLM usage then it really doesn't make sense financially. That said, the maker of the video also gave examples of why it would be worth it to pay to run an LLM locally. Specially when it has to do with privacy.

My question isn’t the cost to rent but the cost to buy.

If that was the intent of your questions then your questions were really poorly worded as buying didn't come up at all.

Anyway, to answer your question, you could build a PC that could to this cheeper than you could buy a Mac Studio. The big deal about Deepseek was that it ran on consumer hardware. 

There are many versions and the 671 billion parameter version is not going to run on anything resembling a standard PC. So I think you just don't know. 

blastdoor said:

Stabitha_Christie said:

blastdoor said:

Stabitha_Christie said:

blastdoor said:

Even though the Mac Studio with M3 Ultra seems like a great option for LLM usage and development, there is a big drawback in terms of cost.

But compared to what? How much would you have to spend to do the same job on a PC?

This was actually covered in the video. You can rent a ton of server time for the cost of a maxed out Mac Studio. So if you are just using it for development or general LLM usage then it really doesn't make sense financially. That said, the maker of the video also gave examples of why it would be worth it to pay to run an LLM locally. Specially when it has to do with privacy.

My question isn’t the cost to rent but the cost to buy.

If that was the intent of your questions then your questions were really poorly worded as buying didn't come up at all.

Anyway, to answer your question, you could build a PC that could to this cheeper than you could buy a Mac Studio. The big deal about Deepseek was that it ran on consumer hardware. 

There are many versions and the 671 billion parameter version is not going to run on anything resembling a standard PC. So I think you just don't know. 

So… when I said “this is covered in the video” I literally meant that is was covered in the video. All we have established here is that  you haven’t watched the video.