• AVincentInSpace@pawb.socialEnglish
    4·
    12 hours ago

    I apologize for presenting an insufficiently nuanced view of your pet project. It’s not an excuse, but being subjected (and seeing my friends subjected) to the massive material harms done by LLM companies has a tendency to make me very angry, and I lash out at the obvious target. In retrospect, I realize only about 90% of current LLM deployments and use cases fit the both-unethical-and-harmful-to-the-user model I describe, and the remaining 10% is crucial. We mustn’t throw the baby out with the bathwater.

    Please do elucidate what exactly these ethical uses of LLMs are.

    You mentioned in another thread you use them for research. Have you figured out how to get them to stop confidently presenting incorrect information because they don’t know the difference between a sequence of tokens that represents a true fact and one that doesn’t hallucinating yet?

    • Fawkes@lemmy.zip
      1·
      11 hours ago

      My wife is a materials science researcher, and works for a university here in Germany. She uses AI to drastically increase the speed that she programs calculations and simulations. Yes, it regularly spits out nonsense, and she’s constantly having to refine and tweak it, which she can effectively do because she has a PhD in the field. She has repeatedly told me that the actual programming was always the least favourite part of her job. But now that she can get an LLM to write the actual code, all she has to do is go back to refine it, and spend more time thinking, and less time reading stack exchange.

      Another group used Evo 1 and Evo 2 to create novel genomes for bacteriophages in the fight against antibiotic resistance. There is a nuanced debate on whether those models are technically LLMs, since their language is actual sequencing rather than written descriptions. But they are structurally nearly identical.

      My personal project is iterally just for funsies, to see if I can mimick human learning and dreaming by combining an LLM with a more abstract NN. So the weights are never frozen, and it actively hallucinates and dreams scenarios between weight adjustments and re-initialization.

      I don’t know how to make it not lie, and I’m not sure if that’s possible. But I see that akin to asking “But how can we make X-rays safe to be used in shoe stores again?” Maybe we can’t, but that doesn’t mean we should ban them entirely.

      You and I seem to agree whole heartedly with the harms. Over use, abuse, misunderstanding, etc. are terrible and causing real harms.

      But I see people pointing their ire at every instance of the word indiscriminately, actively antagonizing those who are actively trying to make the changes they supposedly support.