Summary: Meta, led by CEO Mark Zuckerberg, is investing billions in Nvidia’s H100 graphics cards to build a massive compute infrastructure for AI research and projects. By end of 2024, Meta aims to have 350,000 of these GPUs, with total expenditures potentially reaching $9 billion. This move is part of Meta’s focus on developing artificial general intelligence (AGI), competing with firms like OpenAI and Google’s DeepMind. The company’s AI and computing investments are a key part of its 2024 budget, emphasizing AI as their largest investment area.
I really hope they fail hard and end up putting these devices on the consumer second hand market because the v100’s while now affordable and flooding the market are too out of date.
Meta is the source of most of the open source LLM AI scene. They’re contributing tons to the field and I wish them well at it.
Only other game in town really.
I’ve heard mistral released some good models