• AllonzeeLV@lemmy.world
    link
    fedilink
    arrow-up
    30
    ·
    11 months ago

    As humanity has found yet another way to pass the buck, it’ll be interesting to see the diminishing returns of LLMs as they begin to feed more and more on derivative content made by LLMs.

    • jacksilver@lemmy.world
      link
      fedilink
      arrow-up
      24
      ·
      11 months ago

      It’s interesting, because people say they can only get better, but I’m not sure that’s true. What happens when most new text data is being generated by LLMs or we accidentally start labeling images created through diffusion as real. Seems like there is a potential for these models to implode.

    • livus@kbin.social
      link
      fedilink
      arrow-up
      13
      ·
      11 months ago

      Even before the LLMs, back when I was on reddit I would sometimes see conversations between bots that were 3 or 4 bots replying to each other with scraped content (usually in the personal advice subs) and getting upvotes.

      I only noticed because I used to hunt bots as a hobby.