XAI is using about 150 Megawatts to power its 100,000 H100 liquid cooled AI training center in a few months. Nvidia H100s have about 4 petaflops of compute power. This would be 400 exaflops of peak computing. The next step after that will be about 300,000 Nvidia B200s with a CX8 network in the summer …
