I always think stuff like this is super interesting, partly because I have no idea how development of this sort of thing works. It always brings a lot of (probably stupid) questions to my head.
String a few dozen of those together and that’s sorta how crypto mining rigs operate.
They cost a ton, but when you need dedotated wam, you need it bad. Plus they’re not for general use, they rarely even have connection ports on them (sad!)
I always think stuff like this is super interesting, partly because I have no idea how development of this sort of thing works. It always brings a lot of (probably stupid) questions to my head.
Looks like they recommend 2 or 3 80/48GB GPUs combined to run the model. Something like one of these server/professional GPUs https://www.tomshardware.com/news/nvidia-rtx-a6000-48gb-benchmarked
String a few dozen of those together and that’s sorta how crypto mining rigs operate.
They cost a ton, but when you need dedotated wam, you need it bad. Plus they’re not for general use, they rarely even have connection ports on them (sad!)