Clicky

  • Login
  • Register
  • Submit Your Content
  • Contact Us
Wednesday, August 21, 2024
World Tribune
No Result
View All Result
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food
Submit
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food
No Result
View All Result
World Tribune
No Result
View All Result

NVIDIA announces its next generation of AI supercomputer chips

November 13, 2023
in Technology
Reading Time: 3 mins read
A A
NVIDIA announces its next generation of AI supercomputer chips
0
SHARES
ShareShareShareShareShare

NVIDIA has launched its next-generation of AI supercomputer chips that will likely play a large role in future breakthroughs in deep learning and large language models (LLMs) like OpenAI's GPT-4, the company announced. The technology represents a significant leap over the last generation and is poised to be used in data centers and supercomputers — working on tasks like weather and climate prediction, drug discovery, quantum computing and more. 

The key product is the HGX H200 GPU based on NVIDIA's "Hopper" architecture, a replacement for the popular H100 GPU. It's the company's first chip to use HBM3e memory that's faster and has more capacity, thus making it better suited for large language models. "With HBM3e, the NVIDIA H200 delivers 141GB of memory at 4.8 terabytes per second, nearly double the capacity and 2.4x more bandwidth compared with its predecessor, the NVIDIA A100," the company wrote. 

READ ALSO

Reanimal promises a ‘more terrifying journey’ than Little Nightmares

Indiana Jones and the Great Circle has a Nazi-slapping mechanic

In terms of benefits for AI, NVIDIA says the HGX H200 doubles inference speed on Llama 2, a 70 billion-parameter LLM, compared to the H100. It'll be available in 4- and 8-way configurations that are compatible with both the software and hardware in H100 systems. It'll work in every type of data center, (on-premises, cloud, hybrid-cloud and edge), and be deployed by Amazon Web Services, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure, among others. It's set to arrive in Q2 2024. 

NVIDIA announces its next generation of AI supercomputer chips
NVIDIA

NVIDIA's other key product is the GH200 Grace Hopper "superchip" that marries the HGX H200 GPU and Arm-based NVIDIA Grace CPU using the company's NVLink-C2C interlink. It's designed for supercomputers to allow "scientists and researchers to tackle the world’s most challenging problems by accelerating complex AI and HPC applications running terabytes of data," NVIDIA wrote. 

The GH200 will be used in "40+ AI supercomputers across global research centers, system makers and cloud providers," the company said, including from Dell, Eviden, Hewlett Packard Enterprise (HPE), Lenovo, QCT and Supermicro. Notable among those is HPE's Cray EX2500 supercomputers that will use quad GH200s, scaling up to tens of thousands of Grace Hopper Superchip nodes. 

NVIDIA announces its next generation of AI supercomputer chips
NVIDIA

Perhaps the biggest Grace Hopper supercomputer will be JUPITER, located at the Jülich facility in Germany, which will become the "world’s most powerful AI system" when it's installed in 2024. It uses a liquid-cooled architecture, "with a booster module comprising close to 24,000 NVIDIA GH200 Superchips interconnected with the NVIDIA Quantum-2 InfiniBand networking platform," according to NVIDIA. 

NVIDIA says JUPITER will help aid scientific breakthroughs in a number of areas, including climate and weather prediction, generating high-resolution climate and weather simulations with interactive visualization. It'll also be employed for drug discovery, quantum computing and industrial engineering. Many of these areas use custom NVIDIA software solutions that ease development but also make supercomputing groups reliant on NVIDIA hardware. 

The new technologies will be key for NVIDIA, which now makes most of its revenue from the AI and data center segments. Last quarter the company saw a record $10.32 billion in revenue in that area alone (out of $13.51 billion total revenue), up 171 percent from a year ago. It no doubt hopes the new GPU and superchip will help continue that trend. Just last week, NVIDIA broke its own AI training benchmark record using older H100 technology, so its new tech should help it extend that lead over rivals in a sector it already dominates. 

This article originally appeared on Engadget at https://www.engadget.com/nvidia-announces-its-next-generation-of-ai-supercomputer-chips-140004095.html?src=rss
Credit: Source link

ShareTweetSendSharePin
Previous Post

The world’s best and brightest are flocking to these countries

Next Post

Aaron Rodgers shakes head before failed Nathaniel Hackett play

Related Posts

Reanimal promises a ‘more terrifying journey’ than Little Nightmares
Technology

Reanimal promises a ‘more terrifying journey’ than Little Nightmares

August 21, 2024
Indiana Jones and the Great Circle has a Nazi-slapping mechanic
Technology

Indiana Jones and the Great Circle has a Nazi-slapping mechanic

August 21, 2024
What to expect at the iPhone 16 keynote
Technology

What to expect at the iPhone 16 keynote

August 20, 2024
Wukong breaks Steam’s concurrent single-player record within hours of launch
Technology

Wukong breaks Steam’s concurrent single-player record within hours of launch

August 20, 2024
Apple’s 13-inch iPad Air M2 drops to a record-low price
Technology

Apple’s 13-inch iPad Air M2 drops to a record-low price

August 20, 2024
Zoom can now handle one million simultaneous participants
Technology

Zoom can now handle one million simultaneous participants

August 20, 2024
Next Post
Aaron Rodgers shakes head before failed Nathaniel Hackett play

Aaron Rodgers shakes head before failed Nathaniel Hackett play

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

What's New Here!

NASA’s Perseverance rover found a rock on Mars that could indicate ancient life

NASA’s Perseverance rover found a rock on Mars that could indicate ancient life

July 26, 2024
Difficulty in crossing borders in Southeast Asia hinders AI innovation

Difficulty in crossing borders in Southeast Asia hinders AI innovation

August 7, 2024
US legend Michael Johnson ‘disappointed’ in Team USA’s flag bearer selection

US legend Michael Johnson ‘disappointed’ in Team USA’s flag bearer selection

July 27, 2024
Why Simone Biles was ‘bawling my eyes out’ after end to Olympics

Why Simone Biles was ‘bawling my eyes out’ after end to Olympics

August 6, 2024
Roblox banned from Turkey for ‘causing abuse of children’ following an Instagram blackout. A TikTok ban may be next

Roblox banned from Turkey for ‘causing abuse of children’ following an Instagram blackout. A TikTok ban may be next

August 8, 2024
This museum in Madrid lets the blind touch and experience the wonders of the world

This museum in Madrid lets the blind touch and experience the wonders of the world

August 8, 2024
Ninja’s DualZone air fryer is on sale for 0 right now

Ninja’s DualZone air fryer is on sale for $150 right now

August 14, 2024

About

World Tribune is an online news portal that shares the latest news on world, business, health, tech, sports, and related topics.

Follow us

Recent Posts

  • Volatility spike was a ‘huge overreaction,’ but more could be ahead, strategist says
  • The EU wants no corner of the digital sphere left untouched, warning X and AI could be next
  • Kevin James recreates viral video in electric Mets moment
  • Japan trade on deck, Wall Street rally pauses

Newslatter

Loading
  • Submit Your Content
  • Contact Us
  • Privacy Policy
  • Terms of Use
  • DMCA

© 2024 World Tribune - All Rights Reserved!

No Result
View All Result
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food

© 2024 World Tribune - All Rights Reserved!

Welcome Back!

Login to your account below

Forgotten Password? Sign Up

Create New Account!

Fill the forms below to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In