Nvidia’s powerful H100 GPU will ship in October

silversurfer

Level 85
Thread author
Verified
Honorary Member
Top poster
Content Creator
Malware Hunter
Well-known
Aug 17, 2014
8,073
At today's GTC conference keynote, Nvidia announced that its H100 Tensor Core GPU is in full production and that tech partners such as Dell, Lenovo, Cisco, Atos, Fujitsu, GIGABYTE, Hewlett-Packard Enterprise, and Supermicro will begin shipping products built around the H100 next month.

The H100, part of the "Hopper" architecture, is the most powerful AI-focused GPU Nvidia has ever made, surpassing its previous high-end chip, the A100. The H100 includes 80 billion transistors and a special "Transformer Engine" to accelerate machine learning tasks. It also supports Nvidia NVLink, which links GPUs together to multiply performance.

According to the Nvidia press release, the H100 also reportedly delivers efficiency benefits, offering the same performance as the A100 with 3.5 times better energy efficiency, 3 times lower cost of ownership, using 5 times fewer server nodes.

Nvidia expects the H100 chip to be used in a variety of industrial, health care, supercomputer, and cloud applications ranging from large language models, drug discovery, recommender systems, conversational AI, and more.
 
Top