Shut down all the large GPU clusters (the large computer farms where the most powerful AIs are refined). Shut down all the large training runs. Put a ceiling on how much computing power anyone is allowed to use in training an AI system, and move it downward over the coming years to compensate for more efficient training algorithms. No exceptions for governments and militaries. Make immediate multinational agreements to prevent the prohibited activities from moving elsewhere. Track all GPUs sold. If intelligence says that a country outside the agreement is building a GPU cluster, be less scared of a shooting conflict between nations than of the moratorium being violated; be willing to destroy a rogue datacenter by airstrike.

Frame nothing as a conflict between national interests, have it clear that anyone talking of arms races is a fool. That we all live or die as one, in this, is not a policy but a fact of nature. Make it explicit in international diplomacy that preventing AI extinction scenarios is considered a priority above preventing a full nuclear exchange, and that allied nuclear countries are willing to run some risk of nuclear exchange if that’s what it takes to reduce the risk of large AI training runs.

  • itappearsthat@hexbear.net
    link
    fedilink
    English
    arrow-up
    46
    ·
    7 months ago

    my man this world order cannot even take climate change seriously with all its evidence and real-world consequences people can see right before their eyes, and you want them to nuke anybody who makes a chat bot stop telling lies

  • BelieveRevolt [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    44
    ·
    7 months ago

    Yudkowsky is a decision theorist from the U.S. and leads research at the Machine Intelligence Research Institute.

    He founded that institute, how can someone be considered an expert just because they “lead research” at their own institute? They used to be called the Singularity Institute for Artificial Intelligence too, which just tells you how unserious they are.

    Who funds them anyway?

    https://intelligence.org/transparency/

    An anonymous Ethereum cryptocurrency investor in 2018 and 2021.

    Open Philanthropy, a joint initiative with the philanthropic foundation Good Ventures.

    Vitalik Buterin, the inventor and co-founder of Ethereum.

    The Thiel Foundation, a private foundation funded by Paypal co-founder and venture capitalist Peter Thiel.

    A different anonymous Ethereum cryptocurrency investor in 2017.

    Oh…

    • EnsignRedshirt [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      18
      ·
      7 months ago

      Yudkowsky is hilarious because he has zero education or professional experience. Like, he didn’t attend high school or college, has never had anything like a job, and has never attempted to produce anything. He could have been a normal nepo baby and gotten into tech investing or entertainment or just fucked off and lived quietly, but for some reason his deepest desire was to dedicate his life to fan-fiction blogging about AI in the style of academic writing. A truly unique individual who could only be produced by the stagnant cesspit that is the Silicon Valley ecosystem.

      • Nachorella@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        10
        ·
        7 months ago

        I remember seeing a remarkably stupid quote by him and looking into who the hell he was and the fact anyone listens to him is baffling. He just yammers on about stuff he knows nothing about and then apparently there’s enough oblivious people who believe him to keep the whole thing going in some perpetual shit eating machine type situation.

        • EnsignRedshirt [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          8
          ·
          7 months ago

          Baffling is the right word. I don’t really know where he fits in the ecosystem. If he’s a grifter, he could be leveraging his position much better. If he’s a true believer, I don’t get what purpose he serves to his funders. Shit eating machine, indeed.

  • barrbaric [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    15
    ·
    7 months ago

    Someone remind me, this guy has 0 actual education or expertise when it comes to programming, right? He just got famous for writing a harry potter fanfic?

    • Mardoniush [she/her]@hexbear.net
      link
      fedilink
      English
      arrow-up
      15
      ·
      edit-2
      7 months ago

      I mean…he can program somewhat. He’s been extremely online since he was single digits, which means he has USENET transhumanist brainworms with a heavy dose of gifted kid syndrome.

      And I mean, same. But I didn’t go off the deep end.

      I think if you want to understand Big Yud you have to understand his early work (which is exactly what he tells you not to do), both his early AI enthusiast work (Staring into the Singularity, Shock Levels) and his magnum opus, Levels of Organisation in General Intellegence.

      These works are out of date but explain why he thinks AI is so important.

      More importantly it shows why his final (frankly obvious to everyone else) realisation that “maybe a really smart thing might not only not map easily onto human internal states but also might not automatically find a super nice objective morality”. Drove him entirely off the deep end and into the arms and bank accounts of Thiel and his ilk.

      Finally they show why he’s a very smart boy who is skilled enough at nerd rhetoric to even fool himself. But not smart enough to doubt himself in future after he fucked up the foundations of his entire worldview

  • duderium [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    12
    ·
    7 months ago

    “This technology is incredibly dangerous and must be stopped!” — investors in said technology who are definitely not pumping and dumping