• F/15/Cali@threads.net@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      7 个月前

      They want people to try. It’s independent bug testing that costs only as much as publishing an article on a website and incrementing a version number

      • Feyd@programming.dev
        link
        fedilink
        English
        arrow-up
        8
        ·
        7 个月前

        “AI” has a massive inability (or is purposefully deceptive) to distinguish the difference between bugs, which can be fixed, and fundamental aspects of the technology that disqualify it from various applications.

        I think the more likely story is that they know this can be done, know about this particular jailbreak person, can replicate their work (because they didn’t so anything they hadn’t done with previous models in the first place), and are straight up lying and betting the people that matter to their next investment round (scam continuation) won’t catch wind.

        You’re giving these grifters way too much credit.

  • DarkCloud@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    ·
    7 个月前

    I mean, it’s fundamental to LLM technology that they listen to user inputs. Those inputs are probablistic in terms of their effects on outputs… So you’re always going to be able to manipulate the outputs, which is kind of the premise of the technology.

    It will always be prone to that sort of jailbreak. Feed it vocab, it outputs vocab. Feed it permissive vocab, it outputs permissive vocab.

    • Feyd@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      7 个月前

      Ok? Either openai knows that and lies about their capabilities, or they don’t know it and are incompetent. That’s the real story here.

      • crumbguzzler5000@feddit.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        7 个月前

        I think the answer is that they are incompetent but also that they are lying about their capabilities. Why else have they rushed everything so much and promised so much?

        They don’t really care about the fallout, they are just here to make big promises and large amounts of money on their shiny new tech.