NVIDIA H100 Tensor Core 80GB

NVIDIA H100 Tensor Core 80GB

Unlock unprecedented power with the NVIDIA H100 Tensor Core GPU

NVIDIA H100 Tensor Core 80GB

NVIDIA's H100 Tensor Core 80GB (PCIe HBM2) GPU is the world's most powerful AI, HPC, and data analytics accelerator. It delivers 6X faster performance and evolutionists AI tasks with features like the Transformer Engine, empowering your data center to tackle complex challenges and unlock the potential of next-generation applications.

Key Features

  • Transformer engine for next-gen applications - The NVIDIA H100 Tensor Core GPU boasts a dedicated Transformer Engine. It accelerates the training of massive AI models, particularly those using the transformer architecture. This GPU achieves significantly faster training times for cutting-edge applications in natural language processing, computer vision, and much more.
  • Dominate AI workloads - Unleash the true potential of AI applications with the H100's 3X faster floating-point performance for double-precision workloads. It enables significantly faster training and processing of complex AI models, including large language models (LLMs).
  • Unlock scalability and efficiency - Leverage the power of 2nd Gen Multi-instance GPU (MIG) technology. This innovative feature allows you to partition NVIDIA's H100 Tensor Core GPU into seven independent instances, enabling efficient resource allocation for diverse workloads and maximising utilisation within your data center.

Specifications

Architecture Hopper™
GPU memory 80GB HBM2
Memory Bandwidth 2TB/s
Interconnect NVIDIA® NVLINK® 600GB/s PCIe
Gen5: 128GB/s
FP64 26 TFLOPS
FP64 Tensor Core 51 TFLOPS
FP32 51 TFLOPS
TF32 Tensor Core 756 TFLOPS with sparsity
BFLOAT16 Tensor Core 1,979 TFLOPS with sparsity
FP16 Tensor Core 1,513 TFLOPS with sparsity
FP8 Tensor Core 3,026 TFLOPS with sparsity
INT8 Tensor Core 3,026 TOPS with sparsity
Max Thermal Design Power (TDP) 300 - 350W (configurable)
Decoders 7 * NVDEC
7 * JPEG
Multi-instance GPUs (MIGs) Up to 7 MIGs @ 10GB each
Form Factor PCIe
Dual-slot
Air-cooled
Server Options Partner and NVIDIA-Certified Systems with 1-8 GPUs
NVIDIA Enterprise Included