Is anyone here using Mac Studio? If so, what is your view?

Question

Hey,

I'm considering to buy a Mac Studio - anyone here used it to run LLMs locally?

It comes at a high price tag so don't want to buy it and regret my purchase.

Klaas Foppen · Accepted Answer

if its your main purpose I would not get one (but as a general good development mac it's really good)

Siavosh Zarrasvand · Answer

@klaaz0r We cross-posted, explained my main purpose in the second comment. Thoughts on that?

Siavosh Zarrasvand · Answer

I know the GPU benefits. I'm exploring options :)

Szymon Rączka · Answer

You can always try it out and return if you don't like it. 🙂

Klaas Foppen · Answer

For most AI/ML work you need a GPU, my mac studio is doing fine running LLMs locally but if you want todo large processing yourself I would just go to the cloud

Szymon Rączka · Answer

If you don't damage it, they have to take it back and you don't have to worry about shipping just fill out the form and get it for free.

Siavosh Zarrasvand · Answer

My use case would be to just run the models. So think running 100B+ parameter chat-LLMs locally.

Siavosh Zarrasvand · Answer

It's 12k. Not sure I want to risk Apple not taking it back. 
And even if you return it, a beast like that costs to return.

Go to Homepage	`g` `h`
Go to Done Todos	`g` `d`
Go to Questions	`g` `q`
Compose a New Todo	`n`
Go to Search	`/`
Show this dialog	`?`

Is anyone here using Mac Studio? If so, what is your view?

Keyboard Shortcuts