AMD Instinct MI325X vs AMD Radeon Instinct MI8

AMD Instinct MI325X
AMD Radeon Instinct MI8
19456 Shaders
288GB HBM3e
2100MHz
4096 Shaders
4GB HBM
1000MHz
Peak AI Performance
5.23 POPS
INT4 Tensor Sparse
Peak AI Performance
8.19 TFLOPS
FP32
FP32
163.43 TFLOPS
FP32
8.19 TFLOPS
FP16
163.43 TFLOPS
-
-
Form Factor
OAM Module
-
Form Factor
PCIe Card
2.0-Slots
TDP
560W
TDP
175W
-
-
-
-
-
Power Connectors
-
1x 8-Pin
-
-
GB6 OpenCL N/A
0%
GB6 OpenCL N/A
0%
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
5.23 POPS
INT4 Tensor Sparse
Peak AI Performance
8.19 TFLOPS
FP32
-
-
-
-
-
-
FP8
-
2.61 PFLOPS Tensor (FP16 Accumulate)
5.23 PFLOPS Tensor (FP16 Accumulate) Sparse
2.61 PFLOPS Tensor (FP32 Accumulate)
5.23 PFLOPS Tensor (FP32 Accumulate) Sparse
-
-
-
-
-
-
FP16
163.43 TFLOPS
1.31 PFLOPS Tensor (FP16 Accumulate)
2.61 PFLOPS Tensor (FP16 Accumulate) Sparse
1.31 PFLOPS Tensor (FP32 Accumulate)
2.61 PFLOPS Tensor (FP32 Accumulate) Sparse
-
-
-
-
-
-
FP32
163.43 TFLOPS
163.43 TFLOPS Tensor
326.86 TFLOPS Tensor Sparse
FP32
8.19 TFLOPS
-
-
FP64
81.72 TFLOPS
163.43 TFLOPS Tensor
FP64
510 GFLOPS
-
BF16
-
1.31 PFLOPS Tensor
2.61 PFLOPS Tensor Sparse
-
-
-
-
TF32
653.72 TFLOPS Tensor
1.31 PFLOPS Tensor Sparse
-
-
-
INT4
2.61 POPS Tensor
5.23 POPS Tensor Sparse
-
-
-
INT8
-
2.61 POPS Tensor
5.23 POPS Tensor Sparse
-
-
-
-
-
-
-
-
-
-
-
-
Pixel Fillrate
-
Pixel Fillrate
64 GPixel/s
-
-
-
-
Texture Fillrate
2553.6 GTexel/s
Texture Fillrate
256 GTexel/s
Manufacturer
AMD
Manufacturer
AMD
Chip Designer
AMD
Chip Designer
AMD
Architecture
CDNA 3
Architecture
GCN 3
Family
Instinct
Family
Instinct
Codename
Aqua Vanjaram
Aqua Vanjaram XTX
Variant
Aqua Vanjaram XTX
Codename
Fiji
-
Variant
Fiji XT GL
Market Segment
Server
Market Segment
Server
Release Date
6/2/2024
Release Date
6/20/2017
Foundry
TSMC
TSMC Active Interposer Die
Foundry
TSMC
-
Fabrication Node
N5
N6 Active Interposer Die
Fabrication Node
28nm
-
Die Size
4x 370 mm²
-
Die Size
596 mm²
-
Transistor Count
4x 36.5 Billion
-
Transistor Count
8.9 Billion
-
Transistor Density
98.65M/mm²
-
Transistor Density
14.93M/mm²
-
Form
OAM Module
Form
PCIe Card
Shading Units
19456 Shaders
-
Shading Units
4096 Shaders
-
Texture Mapping Units
1216 TMUs
Texture Mapping Units
256 TMUs
Render Output Units
-
Render Output Units
64 ROPs
Tensor Cores
1216 T-Cores
-
-
-
-
-
-
-
-
-
-
Compute Units
304 CUs
Compute Units
64 CUs
-
-
-
-
-
-
-
-
-
-
1000MHz Base
2100MHz
-
-
1000MHz Base
1000MHz
-
-
-
-
L1
-
-
16KB/CU
-
L1
-
-
16KB/CU
-
L2
16MB Shared
L2
2MB Shared
L3
256MB Shared
-
-
-
-
288GB
HBM3e
ECC
4GB
HBM
ECC
Bus Width
8192Bit
Bus Width
4096Bit
Clock
2933MHz
Transfer Rate
5.9GT/s
Bandwidth
6006.8GB/s
Clock
500MHz
Transfer Rate
1GT/s
Bandwidth
512GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
560W
TDP
175W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
Max Resolution
Unknown
Max Resolution
4096x2160
Max Resolution Refresh Rate
-
Max Resolution Refresh Rate
60Hz
Variable Refresh Rate
-
-
-
Variable Refresh Rate
-
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
Multi Monitor Support
4
-
-
Content Protection
HDCP 1.4
Model
2x VCN 2.6
Model
VCE 3.0
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
No Decoders
Model
UVD 6.0
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
JPEG
VC-1
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
-
-
-
-
Direct X
12
Direct 3D
12_0
-
-
OpenCL
3.0
-
-
OpenGL
4.6
OpenCL
2.1
Vulkan
1.2
-
-
-
-
GFX
9.4
-
-
-
-
Shader Model
6.5
-
-
GFX
8
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Power Connectors
-
-
-
1x 8-Pin
-
-
-
-
-
PCIe Version
5.0
PCIe Lanes
16
Slots Required
2.0
PCIe Version
3.0
PCIe Lanes
16
Multi GPU Support
Supported
Type
Infinity Fabric
Multi GPU Support
Supported
Type
CrossFire XDMA
-
-
-
-
-
-
Height
111 mm (4.37 in)
Width
152 mm (5.98 in)
Depth
37 mm (1.46 in)
Change Comparison