Microsoft Strung Together Tens of Thousands of Chips in a Pricey Supercomputer for OpenAI

[vtqhtr413]

Content source

https://hardware.slashdot.org/story/23/03/13/150257/microsoft-strung-together-tens-of-thousands-of-chips-in-a-pricey-supercomputer-for-openai?utm_source=rss1.0mainlinkanon&utm_medium=feed

When Microsoft invested $1 billion in OpenAI in 2019, it agreed to build a massive, cutting-edge supercomputer for the artificial intelligence research startup. The only problem: Microsoft didn't have anything like what OpenAI needed and wasn't totally sure it could build something that big in its Azure cloud service without it breaking. From a report: OpenAI was trying to train an increasingly large set of artificial intelligence programs called models, which were ingesting greater volumes of data and learning more and more parameters, the variables the AI system has sussed out through training and retraining. That meant OpenAI needed access to powerful cloud computing services for long periods of time. To meet that challenge, Microsoft had to find ways to string together tens of thousands of Nvidia's A100 graphics chips -- the workhorse for training AI models

Microsoft Strung Together Tens of Thousands of Chips in a Pricey Supercomputer for OpenAI - Slashdot

When Microsoft invested $1 billion in OpenAI in 2019, it agreed to build a massive, cutting-edge supercomputer for the artificial intelligence research startup. The only problem: Microsoft didn't have anything like what OpenAI needed and wasn't totally sure it could build something that big in...

hardware.slashdot.org

 

[ForgottenSeer 98186]

Microsoft invested $1 billion in OpenAI in 2019

Boy. That's a WOPER.

 

[vtqhtr413]

Boy. That's a WOPER.

They just put another $10 bn on it recently, they mean business

 

[MuzzMelbourne]

Pumping $10B into a Linux distro called Windows and dumping the MSDOS version would be a better/more secure investment...

 

[ForgottenSeer 98186]

They just put another $10 bn on it recently, they mean business

That is an expensive game of chess.