Research|Grok 4 Dominates Benchmarks Through the Power of Scaling Law, and the Potential ChatGPT Moment for Waymo

Two major stories have been making waves in the AI community over the past couple of days:

First, Elon Musk's XAI has unveiled Grok 4 just half a year after its previous release. Grok 4 epitomizes the "brute force elegance" of scaling laws, trained on an unprecedented cluster of over 200,000 H100 GPUs. According to Tony from XAI, the computational resources dedicated to Grok 4 have exponentially surpassed those of Grok 3. Particularly impressive are XAI’s parallel reasoning and multi-agent reasoning capabilities, vividly demonstrating the power of test-time inference scaling. The parallel reasoning system clearly showcases the immense bandwidth requirements for cluster-based inference, encompassing task decomposition for agents, concurrent processing, scheduling, and memory pooling, etc.