NVIDIA H200 Tensor Core GPU

NVIDIA H200 Tensor Core GPU

Supercharge AI and HPC workloads with the NVIDIA H200 Tensor Core GPU

NVIDIA H200 Tensor Core GPU

Experience groundbreaking performance with the NVIDIA H200 Tensor Core GPU. Powered by the NVIDIA Hopper architecture, it features 141 GB of HBM3e memory at 4.8 TB/s, nearly doubling the H100's capacity. Perfect for generative AI, HPC workloads, and high-performance LLM inference, the H200 delivers unmatched efficiency.

Key Features

  • Unlock the next evolution of AI performance - The NVIDIA H200 Tensor Core GPU is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s), driving generative AI further than ever before with unmatched efficiency.
  • Accelerate large language models - An AI inference accelerator must deliver the highest throughput at the lowest TCO when deployed at scale for a massive user base. The H200 doubles inference performance compared to H100 GPUs when handling large language models such as Llama2 70B.
  • Supercharge high-performance computing - For memory-intensive HPC applications like simulations, scientific research, and artificial intelligence, the H200’s higher memory bandwidth ensures that data can be accessed and manipulated efficiently, leading to 110X faster time to results.
Ready to reserve now - Get in touch for more information

Specifications

Architecture Hopper™
GPU memory 141GB HBM3e
Memory Bandwidth 4.8TB/s
Interconnect NVIDIA NVLink®: 900GB/s; PCIe
Gen5: 128GB/s
FP64 34 TFLOPS
FP64 Tensor Core 67 TFLOPS
FP32 67 TFLOPS
TF32 Tensor Core 989 TFLOPS with sparsity
BFLOAT16 Tensor Core 1,979 TFLOPS with sparsity
FP16 Tensor Core 1,513 TFLOPS with sparsity
FP8 Tensor Core 3,958 TFLOPS with sparsity
INT8 Tensor Core 3,958 TOPS with sparsity
Max Thermal Design Power (TDP) Up to 700W (configurable)
Decoders 7 * NVDEC
7 * JPEG
Multi-instance GPUs (MIGs) Up to 7 MIGs @ 16.5GB each
Form Factor SXM
Server Options NVIDIA HGXTM H200 partner
and NVIDIA- Certified SystemsTM with 4 or 8 GPUs
NVIDIA Enterprise Add-on
For full product specifications and parts list - download the NVIDIA H200 Tensor Core GPU data sheet.