AMD Instinct MI350X Full Specs

Summary

16,384 Shaders 2.2GHz

288GB HBM3e8.19TB/s

Peak·FP32·FP16 144.2 TFLOPS

Form Factor OAM Module

TDP 1000W

Highlights

Peak OPS

Peak OPS FP32 FP16 Tensor MXFP4 Tensor MXFP6 Tensor MXFP8 Tensor FP8-32 FP8-32 Tensor Sparse Tensor FP16-32 FP16-32 Tensor Sparse Tensor FP32 FP64 Tensor FP64 Tensor BF16 BF16 Tensor Sparse Tensor INT8 Memory Bandwidth

Instinct MI350X9.23 PFLOPSMXFP4 Tensor

x1

Top Score3.35 PFLOPS FP4 Tensor Sparse

x0.36

Desktop1xGeForce RTX 5090

Theoretical Performance

Clock Speed2200MHz UC·Boost·OC

Peak OPS 9.23 PFLOPSMXFP4 Tensor

MXFP4 Tensor 9.23 PFLOPS

MXFP6 Tensor 9.23 PFLOPS

Tensor FP8-32 4.61 PFLOPS FP8-32 Tensor Sparse 9.23 PFLOPS MXFP8 Tensor 4.61 PFLOPS

FP16 144.2 TFLOPS Tensor FP16-32 2.31 PFLOPS FP16-32 Tensor Sparse 4.61 PFLOPS

Tensor BF16 2.31 PFLOPS BF16 Tensor Sparse 4.61 PFLOPS

FP32 144.2 TFLOPS Tensor FP32 144.2 TFLOPS

FP64 72.09 TFLOPS Tensor FP64 72.09 TFLOPS

Tensor INT8 4.61 POPS

Core Config

Shaders 16,384 Shaders

Tensor Cores 1,024 T-Cores

CUs 256 CUs

Clocks

Boost Clock 2.2GHz

Cache

L1 32KB/CU

L2 Cache 32MB shared

L3 Cache 256MB shared

Memory

288GB HBM3e

Memory Bus 8192-bit

Memory Speed 8GT/s

Memory Bandwidth 8.19TB/s

ECC Yes

Power & Thermals

TDP 1000W

API Support

OpenCL 3

GFX 9.5

Decoder

Decoder 4x VCN 5.0

Codec JPEG VP9 AVC (H.264) HEVC (H.265) AV1

Card

Form Factor OAM Module

PCIe PCIe 5.0 x16

Cooling Passive

Multi-GPU Multi-GPU Support Supported Multi-GPU Type Infinity Fabric

Chip

Manufacturer AMD

Chip Designer AMD

Architecture CDNA 4

Family Instinct

Branding

Codename CDNA Next

Market Segment Server

Release Date Jun 12, 2025

Fabrication

Foundry TSMC

Other Foundries TSMCIO

Fabrication Node N3P N6IO

Die Size 1448mm²

Transistor Count 139.2B 46BIO

Transistor Density 96.13 MTr/mm²

Images