Over just a few months, ChatGPT went from accurately answering a simple math problem 98% of the time to just 2%, study finds::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

  • Zaphod
    link
    fedilink
    English
    arrow-up
    17
    ·
    1 年前

    I’ve been regularly using ChatGPT these last weeks and can confirm it got indeed “dumber”

    • Cybermass@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 年前

      That’s because they paywalled the good versions, and only corporations get access to that one.

      • kromem@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 年前

        No, even corporations can’t get access to the pretrained models.

        And given this is almost certainly the result of the fine tuning for ‘safety,’ that means corporations are seeing worse performance too (which seems to be the sentiment of developers working with it on HN).