Is anyone here using Mac Studio? If so, what is your view?


I'm considering to buy a Mac Studio - anyone here used it to run LLMs locally? 

It comes at a high price tag so don't want to buy it and regret my purchase.

For most AI/ML work you need a GPU, my mac studio is doing fine running LLMs locally but if you want todo large processing yourself I would just go to the cloud

I know the GPU benefits. I'm exploring options :)

if its your main purpose I would not get one (but as a general good development mac it's really good)

@klaaz0r We cross-posted, explained my main purpose in the second comment. Thoughts on that?

My use case would be to just run the models. So think running 100B+ parameter chat-LLMs locally.

You can always try it out and return if you don't like it. 🙂

It's 12k. Not sure I want to risk Apple not taking it back.
And even if you return it, a beast like that costs to return.

If you don't damage it, they have to take it back and you don't have to worry about shipping just fill out the form and get it for free.