The specs on this are absolutely insane:
It has 528 GPU tensor cores, supports up to 480GB of CPU RAM and 96GB of GPU RAM, and boasts a GPU memory bandwidth of up to 4TB per second.
The specs on this are absolutely insane:
It has 528 GPU tensor cores, supports up to 480GB of CPU RAM and 96GB of GPU RAM, and boasts a GPU memory bandwidth of up to 4TB per second.
Here is hope that all the advancement trickles down to consumer hardware so we can selfhost better models. A future where only the tech giant got “own” the AI is no better than what we have now :/