Is… Is this a New Vegas reference? Or a different evil toaster? Find out this and more on the next exciting episode of: Extreme Hillbilly Armageddon T-Rex Jamboree 7
Is… Is this a New Vegas reference? Or a different evil toaster? Find out this and more on the next exciting episode of: Extreme Hillbilly Armageddon T-Rex Jamboree 7
Yup. I’ve run some on my gaming rig. They just have the normal lack of reasoning and therefore lack of use.
The only reason the fuckheads running grok need that much water and power is because they have thousands of users pinging it. Shove the model in a toaster and it’ll run, just only for one user though.
There are single board computers out there marketed for AI use like the Nvidia Jetson nano, and LattePanda’s boards. You can run generative AI on them, it’s just going to be a little slower.