$15k would get you a used AMD server, a 5090 or a set of 3090s, and enough leftover cash for electricity to just run a 1T parameter LLM at home. Plus, it’s yours.
And that’s hilariously inefficient.
It’s completely nuts to me that people pay Anthropic per token, at that rate. I think 1 whole year for GLM’s coding plan was a flat $30, or something.
$15k would get you a used AMD server, a 5090 or a set of 3090s, and enough leftover cash for electricity to just run a 1T parameter LLM at home. Plus, it’s yours.
And that’s hilariously inefficient.
It’s completely nuts to me that people pay Anthropic per token, at that rate. I think 1 whole year for GLM’s coding plan was a flat $30, or something.
fr, I mean, Mac Studios cost a third of that and are excellent at LLMs