NVIDIA H200 Tensor Core GPU

Experience groundbreaking performance with the NVIDIA H200 Tensor Core GPU. Powered by the NVIDIA Hopper architecture, it features 141 GB of HBM3e memory at 4.8 TB/s, nearly doubling the H100's capacity. Perfect for generative AI, HPC workloads, and high-performance LLM inference, the H200 delivers unmatched efficiency.

Key Features

Unlock the next evolution of AI performance - The NVIDIA H200 Tensor Core GPU is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s), driving generative AI further than ever before with unmatched efficiency.
Accelerate large language models - An AI inference accelerator must deliver the highest throughput at the lowest TCO when deployed at scale for a massive user base. The H200 doubles inference performance compared to H100 GPUs when handling large language models such as Llama2 70B.
Supercharge high-performance computing - For memory-intensive HPC applications like simulations, scientific research, and artificial intelligence, the H200’s higher memory bandwidth ensures that data can be accessed and manipulated efficiently, leading to 110X faster time to results.

Specifications

Architecture	Hopper™
GPU memory	141GB HBM3e
Memory Bandwidth	4.8TB/s
Interconnect	NVIDIA NVLink®: 900GB/s; PCIe
	Gen5: 128GB/s
FP64	34 TFLOPS
FP64 Tensor Core	67 TFLOPS
FP32	67 TFLOPS
TF32 Tensor Core	989 TFLOPS with sparsity
BFLOAT16 Tensor Core	1,979 TFLOPS with sparsity
FP16 Tensor Core	1,513 TFLOPS with sparsity
FP8 Tensor Core	3,958 TFLOPS with sparsity
INT8 Tensor Core	3,958 TOPS with sparsity
Max Thermal Design Power (TDP)	Up to 700W (configurable)
Decoders	7 * NVDEC
	7 * JPEG
Multi-instance GPUs (MIGs)	Up to 7 MIGs @ 16.5GB each
Form Factor	SXM
Server Options	NVIDIA HGXTM H200 partner
	and NVIDIA- Certified SystemsTM with 4 or 8 GPUs
NVIDIA Enterprise	Add-on

For full product specifications and parts list - download the NVIDIA H200 Tensor Core GPU data sheet.

Request a Quote Today

To find out more about our extensive product range and how it will benefit your datacentre deployment, please don’t hesitate to get in touch below and we’ll get back to you quickly.

Get in touch

Privacy & Cookie Policy: By accessing this website you agree to accept cookies. Read the Privacy Policy.

NVIDIA H200 Tensor Core GPU

Supercharge AI and HPC workloads with the NVIDIA H200 Tensor Core GPU