Thank you for the long answer! That all makes sense.

One thing I don't get is: why the mac mini? Why not just using a VPS for this? In the end, you're using LLMs in cloud right? Or do you run them locally on the Mac to save on costs?

Thank you!