AMD Instinct MI350P Full Specs

Summary

8,192 Shaders 2.2GHz

144GB HBM3e4TB/s

Peak·FP32·FP16 72.09 TFLOPS

Form Factor PCIe Card

TDP 600W

Power Connectors 1x 16-Pin 12V-2x6

Highlights

Peak OPS

Peak OPS FP32 FP16 Tensor MXFP4 Tensor MXFP6 Tensor MXFP8 Tensor FP8-32 FP8-32 Tensor Sparse Tensor FP16-32 FP16-32 Tensor Sparse Tensor FP32 FP64 Tensor FP64 Tensor BF16 BF16 Tensor Sparse Tensor INT8 Memory Bandwidth

Instinct MI350P4.61 PFLOPSMXFP4 Tensor

x1

Top Score3.35 PFLOPS FP4 Tensor SparseDesktop1xGeForce RTX 5090

x0.73

Theoretical Performance

Clock Speed2200MHz UC·Boost·OC

Peak OPS 4.61 PFLOPSMXFP4 Tensor

MXFP4 Tensor 4.61 PFLOPS

MXFP6 Tensor 4.61 PFLOPS

Tensor FP8-32 2.31 PFLOPS FP8-32 Tensor Sparse 4.61 PFLOPS MXFP8 Tensor 2.31 PFLOPS

FP16 72.09 TFLOPS Tensor FP16-32 1.15 PFLOPS FP16-32 Tensor Sparse 2.31 PFLOPS

Tensor BF16 1.15 PFLOPS BF16 Tensor Sparse 2.31 PFLOPS

FP32 72.09 TFLOPS Tensor FP32 72.09 TFLOPS

FP64 36.04 TFLOPS Tensor FP64 36.04 TFLOPS

Tensor INT8 2.31 POPS

Core Config

Shaders 8,192 Shaders

Tensor Cores 512 T-Cores

CUs 128 CUs

Clocks

Boost Clock 2.2GHz

Cache

L1 32KB/CU

L2 Cache 16MB shared

L3 Cache 128MB shared

Memory

144GB HBM3e

Memory Bus 4096-bit

Memory Speed 7.8GT/s

Memory Bandwidth 4TB/s

ECC Yes

Power & Thermals

TDP 600W

API Support

OpenCL 3

GFX 9.5

Decoder

Decoder 2x VCN 5.0

Codec JPEG VP9 AVC (H.264) HEVC (H.265) AV1

Card

Form Factor PCIe Card

PCIe PCIe 5.0 x16 2-Slots

Width 267mm (10.51")

Cooling Passive

Power Connectors 1x 16-Pin 12V-2x6

Multi-GPU Multi-GPU Support Supported Multi-GPU Type Infinity Fabric

Chip

Manufacturer AMD

Chip Designer AMD

Architecture CDNA 4

Family Instinct

Branding

Codename CDNA Next

Market Segment Server

Release Date Jul 23, 2026

Fabrication

Foundry TSMC

Other Foundries TSMCIO

Fabrication Node N3P N6IO

Die Size 724mm²

Transistor Count 69.6B 23BIO

Transistor Density 96.13 MTr/mm²

Images