This is not investment advice. The author has no position in any stocks mentioned. Wccftech.com has a Disclosure and Ethics Policy.
In a recent interview, Jensen Huang explained how xAI integrated NVIDIA equipment and got it up and running within its own data center in just 19 days, inspiring Elon Musk to ” He was called “Superman.” Now, Musk seems determined to conquer his competitors by continuing to pursue a shock-and-awe campaign that doubles the size of xAI’s supercluster.
For those who don’t know, xAI’s Colossus supercomputer cluster currently consists of 100,000 units of NVIDIA’s water-cooled H100 GPUs. Dubbed the world’s largest AI supercomputer, Colossus is currently training xAI’s Grok family of large-scale language models (LLMs).
In a dedicated press release, NVIDIA revealed that xAI is doubling the size of the Colossus supercluster.
“xAI plans to double the size of Colossus to include a total of 200,000 NVIDIA Hopper GPUs.”
Keep in mind that xAI and NVIDIA were able to bring Colossus online in just 122 days, whereas such a complex system would typically take “months to years” to operate. Additionally, xAI was able to begin training Grok LLM within 19 days of the first H100 GPU racks rolling onto the AI Gigafactory floor.
NVIDIA further states:
“Across all three layers of the network fabric, the system has experienced no application latency degradation or packet loss due to flow collisions, maintaining 95% data throughput enabled by Spectrum-X congestion control. .”
Meanwhile, as mentioned earlier, the NVIDIA CEO spoke very glowingly of Elon Musk in a recent interview (see here), calling him a “superhuman” and “unique individual” in his understanding of engineering and construction. It was even called.
“…Just to power it with water cooling and build a huge factory in a short period of time…I mean, that’s superhuman. Yeah, there is. And as far as I know, that’s the only thing that’s out there. You know. As such, Elon is unique in engineering, construction, large systems, and resource management.
Morgan Stanley should keep in mind that NVIDIA plans to sell approximately 1.5 million units of its Hopper GPUs in the fourth quarter of 2024. Then, as Blackwell’s sales volume begins to skyrocket, sales drop to 1 million units in the first quarter of 2025.
