• David Gerard@awful.systemsOPM
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    22 hours ago

    so you can run the good version at home! this thread tells how to build a workstation for it.

    tl;dr 768GB RAM.

    with that, you can run the largest deepseek model, or even open a tab in chrome

    apparently it’s not very fast, but it does in fact do the stuff

    • self@awful.systems
      link
      fedilink
      English
      arrow-up
      3
      ·
      22 hours ago

      ah, I stand corrected! the figures I was looking at previously were for doing it at acceptable speeds in a data center.

      can you imagine the intensity of the RGB in the boy genius Prompt Engineer’s new $6000 custom top end gaming PC with server components? maybe they’ll have the LLM slowly plagiarize them a Python script that turns on more RGB when the GPU’s under load.