H200: NVIDIA releases high-end chip for training AI models

The company has announced its newest high-end chip, H200, designed to train & deploy the artificial intelligence (AI) powering rapid generative AI growth

NVIDIA has announced H200, the company’s newest high-end chip for training AI models.

Described by the company as ‘the world’s most powerful GPU for supercharging AI and HPC workloads,’ the H200 Tensor Core GPU will aim to supercharge generative AI and high-performance computing (HPC) workloads with game-changing performance and memory capabilities. 

This news comes in the midst of NVIDIA working increasingly to enhance industry developments with AI, which includes business partnerships to unlock greater enterprise potential. The company has also recently introduced a new range of AI chips for the Chinese market, following US export restrictions on certain AI and gaming chips.

Fuelling greater global generative AI adoption

The H200 will reportedly have larger and faster memory capabilities to help fuel the company’s acceleration of generative AI and large language models (LLMs) while advancing scientific computing for HPC workloads.

As reported by CNBC, the H200 includes 141GB of next-generation “HBM3” memory that will help it to generate text, images or predictions using AI models.

NVIDIA has experienced huge AI and generative AI breakthroughs in 2023, having revealed very rapid sales growth and expecting to become the world’s first trillion-dollar semiconductor stock. The company is also very well known for its ‘AI is a reinvention of computing’ mindset, which was confirmed by company founder and CEO, Jensen Huang.

The H200 announcement comes in the midst of a massive chip shortage that NVIDIA is working to capitalise on, as businesses are seeking to get their hands on new developments to train their AI models. The company’s new GPU is already an upgrade from the H100 - the chip that OpenAI used to train GPT-4.

Achieving enterprise-ready AI

NVIDIA AI Enterprise, together with NVIDIA H200, is aiming to simplify the building of an AI-ready platform, accelerating AI development and deployment of production-ready generative AI, computer vision and speech AI. 

The goal is that they will deliver enterprise-grade security, manageability, stability and support to gather actionable insights and value for businesses faster.

The company has also stated that the H200 is already compatible with the H100, which is convenient for AI companies as they will not have to change their existing server systems or software.

NVIDIA continues to introduce new generative AI platforms for a wide range of industries worldwide, including chips. Through these developments, the company is working to support businesses in adopting and customising AI to boost productivity.

The H200 is expected to be available from the second quarter of 2024.


For more insights into the world of AI - check out the latest edition of AI Magazine and be sure to follow us on LinkedIn & Twitter.

Other magazines that may be of interest - Technology Magazine | Cyber Magazine.

Please also check out our upcoming event - Net Zero LIVE on 6 and 7 March 2024.


BizClik is a global provider of B2B digital media platforms that cover Executive Communities for CEOs, CFOs, CMOs, Sustainability leaders, Procurement & Supply Chain leaders, Technology & AI leaders, Cyber leaders, FinTech & InsurTech leaders as well as covering industries such as Manufacturing, Mining, Energy, EV, Construction, Healthcare and Food.

BizClik – based in London, Dubai, and New York – offers services such as content creation, advertising & sponsorship solutions, webinars & events.


Featured Articles

Upskilling Global Workers in AI with EY’s Beatriz Sanz Saiz

We speak with Beatriz Sanz Saiz, EY Global Consulting Data and AI Leader, about how AI shapes the global workforce and how EY is harnessing ethical AI

Intuitive Machines: NASA's Odysseus bets on Private Company

Discover more about the small private company that landed the first US spacecraft on the moon in 50 years, with NASA continuing to test new technologies

Unveiling Gemma: Google Commits to Open-Model AI & LLMs

Tech giant Google, with Google DeepMind, launches Gemma, consisting of new new state-of-the-art open AI models built for an open community of developers

Sustainability LIVE: Net Zero a Key Event for AI Leaders

AI Strategy

US to Form AI Task Force to Confront AI Threats to Safety

AI Strategy

Wipro to Advance Enterprise Gen AI Adoption with IBM watsonx

AI Strategy