archive.is link

Earlier this year, WIRED asked AI detection startup Pangram Labs to analyze Medium. It took a sampling of 274,466 recent posts over a six week period and estimated that over 47 percent were likely AI-generated. “This is a couple orders of magnitude more than what I see on the rest of the internet,” says Pangram CEO Max Spero. (The company’s analysis of one day of global news sites this summer found 7 percent as likely AI-generated.)

  • Black616Angel
    link
    fedilink
    arrow-up
    5
    ·
    23 days ago

    That is why I liked the comparison with articles from 2018. Then you have comparable texts in the same format and can more easily figure out differences in your analysis.
    If true, a jump from 3% to 40% is significant to say the least.

    • Dr. Juande Santander-Vela@astrodon.social
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      23 days ago

      @Black616Angel numbers in the article blurb are 7% for the pre-2018 corpus, and 40% for the post-2018 corpus. That is from less than 1 in 10 to almost 1 in 2, or a coin toss…

      (Update: the blurb from the link speaks about 7% and 47%, but the article itself indeed speaks of 3% and 40%, apologies! That is even more dramatic, going from less than 1 in 20 to 2 out of 5, very close to 1 in 2…)

      • Black616Angel
        link
        fedilink
        arrow-up
        2
        ·
        23 days ago

        In 2018, 3.4 percent were estimated as likely AI-generated.

        For 2024, with a sampling of 473 articles published this year, it suspected that just over 40 percent were likely AI-generated.

        My numbers were from the Originality AI part.