AMD Instinct MI210 vs NVIDIA A2

AMD Instinct MI210
NVIDIA A2
6656 Shaders
64GB HBM2e
1700MHz
1280 Shaders
16GB GDDR6
1770MHz
Peak AI Performance
181.04 TOPS
INT4 Tensor
Peak AI Performance
145 TOPS
INT4 Tensor Sparse
FP32
22.63 TFLOPS
FP32
4.53 TFLOPS
FP16
45.26 TFLOPS
FP16
4.53 TFLOPS
Form Factor
PCIe Card
2.0-Slots
Form Factor
PCIe Card
1.0-Slots
TDP
300W
TDP
60W
Power Connectors
-
1x 8-Pin
-
-
-
-
-
-
-
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
181.04 TOPS
INT4 Tensor
Peak AI Performance
145 TOPS
INT4 Tensor Sparse
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
FP16
45.26 TFLOPS
181.04 TFLOPS Tensor (FP16 Accumulate)
-
181.04 TFLOPS Tensor (FP32 Accumulate)
-
FP16
4.53 TFLOPS
18.13 TFLOPS Tensor (FP16 Accumulate)
36.25 TFLOPS Tensor (FP16 Accumulate) Sparse
18.13 TFLOPS Tensor (FP32 Accumulate)
36.25 TFLOPS Tensor (FP32 Accumulate) Sparse
FP32
22.63 TFLOPS
45.26 TFLOPS Tensor
-
FP32
4.53 TFLOPS
-
-
FP64
22.63 TFLOPS
45.26 TFLOPS Tensor
FP64
70 GFLOPS
-
BF16
-
181.04 TFLOPS Tensor
-
BF16
4.53 TFLOPS
18.13 TFLOPS Tensor
36.25 TFLOPS Tensor Sparse
-
-
-
TF32
9.06 TFLOPS Tensor
18.12 TFLOPS Tensor Sparse
INT4
181.04 TOPS Tensor
-
INT4
72.5 TOPS Tensor
145 TOPS Tensor Sparse
INT8
-
181.04 TOPS Tensor
-
INT8
-
36.25 TOPS Tensor
72.5 TOPS Tensor Sparse
-
-
INT32
2.27 TOPS
-
-
Ray Tracing
8.9 TOPS
Pixel Fillrate
-
Pixel Fillrate
56.64 GPixel/s
-
-
-
-
Texture Fillrate
707.2 GTexel/s
Texture Fillrate
70.8 GTexel/s
Manufacturer
AMD
Manufacturer
NVIDIA
Chip Designer
AMD
Chip Designer
NVIDIA
Architecture
CDNA 2
Architecture
Ampere
Family
Instinct
Family
Server
Codename
Aldebaran
Aldebaran XL
Variant
Aldebaran XL
Codename
NV177
GA107
-
-
Market Segment
Server
Market Segment
Server
Release Date
3/22/2022
Release Date
11/10/2021
Foundry
TSMC
-
Foundry
Samsung
-
Fabrication Node
N6
-
Fabrication Node
8N
-
Die Size
724 mm²
-
Die Size
200 mm²
-
Transistor Count
28 Billion
-
Transistor Count
8.7 Billion
-
Transistor Density
38.67M/mm²
-
Transistor Density
43.50M/mm²
-
Form
PCIe Card
Form
PCIe Card
Shading Units
6656 Shaders
-
Shading Units
1280 Shaders
-
Texture Mapping Units
416 TMUs
Texture Mapping Units
40 TMUs
Render Output Units
-
Render Output Units
32 ROPs
Tensor Cores
416 T-Cores
Tensor Cores
40 T-Cores
-
-
Ray-Tracing Cores
10 RT-Cores
-
-
Streaming Multiprocessors
10 SMs
Compute Units
104 CUs
-
-
-
-
-
-
-
-
-
-
-
-
1000MHz Base
1700MHz
-
-
1440MHz Base
1770MHz
-
-
-
-
L1
-
-
16KB/CU
-
L1
64KB/SM Tex
128KB/SM
-
-
L2
8MB Shared
L2
2MB Shared
-
-
-
-
-
-
64GB
HBM2e
ECC
16GB
GDDR6
-
Bus Width
4096Bit
Bus Width
128Bit
Clock
1600MHz
Transfer Rate
3.2GT/s
Bandwidth
1638.4GB/s
Clock
782MHz
Transfer Rate
6.3GT/s
Bandwidth
100GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
300W
TDP
60W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
Max Resolution
Unknown
Max Resolution
Unknown
Max Resolution Refresh Rate
-
Max Resolution Refresh Rate
-
Variable Refresh Rate
-
-
-
Variable Refresh Rate
G-Sync
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
Multi Monitor Support
Unknown
-
-
-
-
Model
VCN 2.6
Model
NVENC 7
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
No Decoders
Model
NVDEC 5
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
AV1
-
-
-
-
-
-
Direct X
12
Direct 3D
12_2
-
-
OpenCL
3.0
-
-
OpenGL
4.6
OpenCL
3.0
Vulkan
1.2
-
-
-
-
GFX
9.4
-
-
-
-
Shader Model
6.6
CUDA
8.6
-
-
PureVideo HD
VP11
VDPAU
Feature Set K
-
-
-
-
-
-
-
-
Power Connectors
-
-
-
1x 8-Pin
-
-
-
-
-
-
-
-
-
-
-
Slots Required
2.0
PCIe Version
4.0
PCIe Lanes
16
Slots Required
1.0
PCIe Version
4.0
PCIe Lanes
8
Multi GPU Support
Supported
Type
Infinity Fabric
-
-
-
-
Height
111 mm (4.37 in)
Width
267 mm (10.51 in)
Depth
37 mm (1.46 in)
Height
69 mm (2.72 in)
Width
168 mm (6.61 in)
Depth
20 mm (0.79 in)
Change Comparison