AMD Instinct MI325X

AMD Instinct MI325X

Deliver leading generative AI performance with the AMD Instinct MI325X

AMD Instinct MI325X

The AMD Instinct MI325X accelerator is engineered for high-performance AI and high-performance computing (HPC) workloads. Equipped with 256GB of HBM3E memory and delivering up to 6 TB/s of memory bandwidth, it excels in handling large-scale AI models and data-intensive tasks.

Key Features

  • Scale AI without limits - The MI325X's 256GB HBM3E memory and 6 TB/s bandwidth enable seamless handling of expansive AI models, ensuring efficient processing of complex computations.
  • Accelerate deep learning tasks - With advanced AMD Matrix Core technology, the MI325X delivers high throughput, significantly speeding up deep learning training and inference processes.
  • Optimise data center efficiency - The MI325X's energy-efficient design reduces power consumption while maintaining top-tier performance, optimising data center operations for AI and HPC applications.

Specifications

Form Factor OAM module
Lithography 5nm FinFET
Active Interposer Dies (AIDs) 6nm FinFET
GPU Compute Units 304
Matrix Cores 1216
Stream Processors 19,456
Peak Engine Clock 2100 MHz
Memory Capacity Up to 256 GB HBM3
Memory Bandwidth 6 TB/s max. peak "theoretical"
Memory Interace 8192 bits
AMD Infinity Cache™ (last level) 256 MB
Memory Clock Up to 6.0 GT/s
Scale-up Infinity Fabric™ Links 7x 128 HB/s
I/O to host CPU 1 PCIe® Gen 5 x16 (128 GB/s)
Scale-out network bandwidth PCIe® Gen 5 x16 (128 GB/s)
RAS features Full-chip ECC memory, page retirement, page avoidance
Maximum TBP 1000W
For full product specifications and parts list - download the AMD Instinct MI325X data sheet.