AMD Instinct MI325X Full Specs

Summary

19,456 Shaders 2.1GHz

288GB HBM3e6.01TB/s

Peak·FP32·FP16 163.4 TFLOPS

Form Factor OAM Module

TDP 560W

Theoretical Performance

Clock Speed2100MHz UC·Base·Boost·OC

Peak OPS 5.23 POPSINT4 Tensor Sparse

Tensor FP8-16 2.62 PFLOPS FP8-16 Tensor Sparse 5.23 PFLOPS Tensor FP8-32 2.62 PFLOPS FP8-32 Tensor Sparse 5.23 PFLOPS

Tensor FP16-16 1.31 PFLOPS FP16-16 Tensor Sparse 2.62 PFLOPS Tensor FP16-32 1.31 PFLOPS FP16-32 Tensor Sparse 2.62 PFLOPS

Tensor BF16 1.31 PFLOPS BF16 Tensor Sparse 2.62 PFLOPS

Tensor TF32 653.7 TFLOPS

FP32 163.4 TFLOPS Tensor FP32 163.4 TFLOPS

FP64 81.72 TFLOPS Tensor FP64 163.4 TFLOPS

Tensor INT4 2.62 POPS

Tensor INT8 2.62 POPS

Texture Rate 2.55 TTexel/s

Core Config

Shaders 19,456 Shaders

TMUs 1,216 TMUs

Tensor Cores 1,216 T-Cores

CUs 304 CUs

Clocks

Base Clock 1GHz

Boost Clock 2.1GHz

Cache

L1 16KB/CU

L2 Cache 16MB shared

L3 Cache 256MB shared

Memory

288GB HBM3e

Memory Bus 8192-bit

Memory Speed 5.9GT/s

Memory Bandwidth 6.01TB/s

ECC Yes

Power & Thermals

TDP 560W

API Support

OpenCL 3

GFX 9.4

Encoder

Encoder 2x VCN 2.6

Codec AVC (H.264) HEVC (H.265)

Decoder

Decoder 2x VCN 2.6

Card

Form Factor OAM Module

PCIe PCIe 5.0 x16

Cooling Passive

Multi-GPU Multi-GPU Support Supported Multi-GPU Type Infinity Fabric

Chip

Manufacturer AMD

Chip Designer AMD

Architecture CDNA 3

Family Instinct

Branding

Codename Aqua Vanjaram

Chip Variant Aqua Vanjaram XTX

Market Segment Server

Release Date Jun 2, 2024

Fabrication

Foundry TSMC

Other Foundries TSMCActive Interposer

Fabrication Node N5 N6Active Interposer

Die Size 1480mm²

Transistor Count 146B

Transistor Density 98.65 MTr/mm²

Images