Elon Musk invests more than $2 to create the world's most powerful AI system to beat ChatGPT
When you have the financial means of Elon Musk and many projects in progress, it should come as no surprise that you also have at your disposal the best tools to start and run your projects. One of them is Colossus, a system for training AI language models. According to the entrepreneur, it is the most powerful system in the world for this business.
As confirmed a few days ago by a post in X, its system was completed in about 122 days and consists of about 100,000 Nvidia H100 graphics cards. The goal of this system is to train GROK, the language model that gives life to the xAI tool.
Although the system is a miracle with these numbers, Musk hopes to double his strength in just a few months. To do this, 50,000 will add another Nvidia H200 chipset, nearly doubling the AI acceleration performance of the H100 GPU.
The cost of launching this project has not been officially revealed, although it was certainly not cheap. The H100 chipset is priced between $20,000 and $90,000 per chip, but Musk seems to have gotten a good deal to get a package of 100,000 of these units in a single round.
Accounting for the cost price of these chips alone and their very low cost, Musk had spent, at least, about $2 billion to build "the world's most powerful AI training system," as he put it. All this without counting Nvidia's new 50.000 H200 chips and all the costs of infrastructure, data centers, equipment, etc.