• 8ender@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      1 year ago

      Words are how we communicate knowledge so sometimes the most probable combinations of words end up being facts

    • SkaveRat
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      1 year ago

      while it’s technically true that it “just predicts the next word”, it’s a very misleading argument to make.

      Computers are also “just some basic logic gates” and yet we can do complex stuff with them.

      Complex behaviour can result from simple things.

      Not defending the bullshit that LLMs generate, just to point out that you have to be careful with your arguments

    • Thales@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      edit-2
      1 year ago

      “ChatGPT, please provide your rebuttal to this statement about you: […]”

      Hey! That’s a common misconception. While I do predict the next word based on patterns in the data I was trained on, I’m not just making things up. I provide information and answers based on the vast amount of text I’ve been trained on. It’s more about recognizing patterns and providing coherent, relevant responses than just “guessing.” Cheers!

      • thbb@kbin.social
        link
        fedilink
        arrow-up
        7
        ·
        1 year ago

        Not really. We also have deductive capabilities (aka “system 2”) that enable us to ensure some level of proof over our statements.

      • sky@codesink.io
        link
        fedilink
        English
        arrow-up
        7
        ·
        1 year ago

        right, and they’re actually pretty bad at remembering facts, that’s why we have entire institutions dedicated to maintain accurate reference material!

        why do people throw all of this out the window for advice from a dumb program I’ll never understand