Thread: Facebook parent Meta says its new AI supercomputer will be world's fastest

Grisham

Ensuring Transparency
Jan 24 (Reuters) - Facebook parent Meta Platforms Inc (FB.O) said on Monday that its research team has built a new artificial intelligence supercomputer that it thinks will be the fastest in the world when completed in mid-2022.

Meta said in a blog post that its new AI Research SuperCluster (RSC) would help the company build better AI models that can learn from trillions of examples, work across hundreds of languages, and analyze text, images and video together to determine if content was harmful.

"This research will not only help keep people safe on our services today, but also in the future, as we build for the metaverse," the company said in a blog post.

The social media company changed its name in October to Meta to reflect its focus on the metaverse, which it thinks will be the successor to the mobile internet.

The metaverse, a broad term which has generated a lot of Silicon Valley buzz in recent months, refers to the idea of shared virtual environments which people can access through different devices and where they can work, play and socialize.

"The experiences we're building for the metaverse require enormous compute power (quintillions of operations/second!) and RSC will enable new AI models that can learn from trillions of examples, understand hundreds of languages, and more," Meta Chief Executive Officer Mark Zuckerberg wrote in a Facebook post on Monday.

Meta said it believed the RSC was currently among the fastest AI supercomputers running. A Meta spokesperson said the company had partnered with teams from Nvidia Corp (NVDA.O), Pure Storage Inc (PSTG.N) and Penguin Computing Inc to build the supercomputer.

 
By any chance did they name it Skynet?
no they named it john conner to remind people that their the guys who care! It makes my heart warm with something it resembles fear for some reason dunno why........
 


Meta, formerly Facebook, announced it has designed and built what it calls the AI Research SuperCluster (RSC), "the fastest AI supercomputers running today and will be the fastest AI supercomputer in the world when it's fully built out in mid-2022" delivering nearly 5 exaFLOPS, the company said in a blog announcing the system.

"Once we complete phase two of building out RSC, we believe it will be the fastest AI supercomputer in the world, performing at nearly 5 exaflops of mixed precision compute," Meta's Kevin Lee, technical program manager, and Shubho Sengupta, software engineer, in the announcement blog. "Through 2022, we'll work to increase the number of GPUs from 6,080 to 16,000, which will increase AI training performance by more than 2.5x. The InfiniBand fabric will expand to support 16,000 ports in a two-layer topology with no oversubscription. The storage system will have a target delivery bandwidth of 16 TB/s and exabyte-scale capacity to meet increased demand.

RSC will be built in partnership with Penguin Computing and Pure Storage. In its current incarnation, RSC is comprised of 760 NVIDIA DGX A100 systems as its compute nodes for a total of 6,080 GPUs, which communicate via an NVIDIA Quantum 200 Gb/s InfiniBand two-level Clos fabric that has no oversubscription. RSC's storage tier has 175 petabytes of Pure Storage FlashArray, 46 petabytes of cache storage in Penguin Computing Altus systems, and 10 petabytes of Pure Storage FlashBlade.

Meta said early benchmarks on RSC, compared with Meta's legacy production and research infrastructure (see below), "have shown that it runs computer vision workflows up to 20 times faster, runs the NVIDIA Collective Communication Library (NCCL) more than nine times faster, and trains large-scale NLP models three times faster. That means a model with tens of billions of parameters can finish training in three weeks compared with nine weeks before."

Meta-RSC-Phase-1-012422-768x432.jpg
 
  • Brain
Reactions: CloudNull




Meta-RSC-Phase-1-012422-768x432.jpg
It would seem supercomputers are the future for ai. Teslas prototype super computer is the 5th largest.

It will be amazing to see the framework of training ai become more standardized as the big players start to compete in this Industry.
 
  • Brain
Reactions: Grisham