AMD Instinct MI300P Full Specs

Summary

9,728 Shaders 2.1GHz

64GB HBM32.66TB/s

Peak·FP32·FP16 81.72 TFLOPS

Form Factor OAM Module

TDP 300W

Theoretical Performance

Clock Speed2100MHz UC·Base·Boost·OC

Peak OPS 2.62 POPSINT4 Tensor Sparse

Tensor FP8-16 1.31 PFLOPS FP8-16 Tensor Sparse 2.62 PFLOPS Tensor FP8-32 1.31 PFLOPS FP8-32 Tensor Sparse 2.62 PFLOPS

Tensor FP16-16 653.7 TFLOPS FP16-16 Tensor Sparse 1.31 PFLOPS Tensor FP16-32 653.7 TFLOPS FP16-32 Tensor Sparse 1.31 PFLOPS

Tensor BF16 653.7 TFLOPS BF16 Tensor Sparse 1.31 PFLOPS

Tensor TF32 326.9 TFLOPS

FP32 81.72 TFLOPS Tensor FP32 81.72 TFLOPS

FP64 40.86 TFLOPS Tensor FP64 81.72 TFLOPS

Tensor INT4 1.31 POPS

Tensor INT8 1.31 POPS

Texture Rate 1.28 TTexel/s

Core Config

Shaders 9,728 Shaders

TMUs 608 TMUs

Tensor Cores 608 T-Cores

CUs 152 CUs

Clocks

Base Clock 1GHz

Boost Clock 2.1GHz

Cache

L2 Cache 16MB shared

L3 Cache 128MB shared

Memory

64GB HBM3

Memory Bus 4096-bit

Memory Speed 5.2GT/s

Memory Bandwidth 2.66TB/s

ECC Yes

Power & Thermals

TDP 300W

Encoder

Encoder Model 2x VCN 2.6

Codec AVC (H.264) HEVC (H.265)

Decoder

Decoder Model 2x VCN 2.6

Card

Form Factor OAM Module

Cooling Passive

Chip

Manufacturer AMD

Chip Designer AMD

Architecture CDNA 3

Family Instinct

Branding

Codename Aqua Vanjaram

Chip Variant Aqua Vanjaram XL

Market Segment Server

Release Date Dec 6, 2023

Fabrication

Foundry TSMC

Other Foundries TSMCActive Interposer

Fabrication Node N5 N6Active Interposer

Die Size 740mm²

Transistor Count 73 Billion

Transistor Density 98.65 MTr/mm²

Images