NVIDIA H200 Tensor Core GPU

Key Features

• Unlock the next evolution of AI performance - The NVIDIA H200 Tensor Core GPU is the first GPU to offer 141 gigabytes (GB) of HBM3e memory at 4.8 terabytes per second (TB/s), driving generative AI further than ever before with unmatched efficiency.
• Accelerate large language models - An AI inference accelerator must deliver the highest throughput at the lowest TCO when deployed at scale for a massive user base. The H200 doubles inference performance compared to H100 GPUs when handling large language models such as Llama2 70B.
• Supercharge high-performance computing - For memory-intensive HPC applications like simulations, scientific research, and artificial intelligence, the H200’s higher memory bandwidth ensures that data can be accessed and manipulated efficiently, leading to 110X faster time to results.