Ever wondered what’s behind all of the AI magic you’re using in your daily life in 2024? Well, here’s a new video from NVIDIA showcasing one of the technological marvels – the Eos.
Named after the Greek goddess who opens the gates of dawn every day, the Eos was last revealed on November 23 over at the Supercomputing 2023 Trade Show but has been deployed. Carrying a monstrous 576 units of NVIDIA DGX H100 systems equipped with NVIDIA Quantum-2 InfiniBand networking and software, the entire package can deliver 18.4 exaflops of FP8 AI performance.
With each DGX H100 carrying 8x H100 GPUs, the full number makes up a total of 4,608 to train all sorts of LLMs and recommender systems and even quantum simulations and more. Since scaling is the main concern for the development of AI factories, NVIDIA has made sure the current #9 supercomputer system can adapt to any level of training and inferencing according to the needs of businesses.
The sheer power provided by the hardware is complimented by the range of software support and a suite of tools like NVIDIA Base Command and NVIDIA AI Enterprise. The whole package resulted in an ultra-low-latency and high-throughput interconnectivity system with up to 400Gbps data transfer speed.
Watch the official video if you want a quick and more thorough explanation of Eos.
