Is… Is this a New Vegas reference? Or a different evil toaster? Find out this and more on the next exciting episode of: Extreme Hillbilly Armageddon T-Rex Jamboree 7
Is… Is this a New Vegas reference? Or a different evil toaster? Find out this and more on the next exciting episode of: Extreme Hillbilly Armageddon T-Rex Jamboree 7
Do they really run completely locally? I honestly had no clue. I figured they’d take vast computing power to run as well as train
Yup. I’ve run some on my gaming rig. They just have the normal lack of reasoning and therefore lack of use.
The only reason the fuckheads running grok need that much water and power is because they have thousands of users pinging it. Shove the model in a toaster and it’ll run, just only for one user though.
There are single board computers out there marketed for AI use like the Nvidia Jetson nano, and LattePanda’s boards. You can run generative AI on them, it’s just going to be a little slower.
AFAIK you can even train really small models at home, too, they’ll just be even less useful than the big ones.
I had some! They can be pretty endearing, like houseplants to water. Which is why I stopped using them entirely. Seeing it compose sentences was neat, but intensely uncanny and I just need to kill it now get it away from me fucking die. Kinda like modern AI.