NVIDIA GRID A100A vs AMD Radeon Instinct MI50

NVIDIA GRID A100A
AMD Radeon Instinct MI50
6912 Shaders
32GB HBM2e
900MHz
3840 Shaders
16GB HBM2
1725MHz
Peak AI Performance
1.59 POPS
INT4 Tensor Sparse
Peak AI Performance
26.5 TFLOPS
FP16
FP32
12.44 TFLOPS
FP32
13.25 TFLOPS
FP16
49.77 TFLOPS
FP16
26.5 TFLOPS
Form Factor
vGPU
-
Form Factor
PCIe Card
2.0-Slots
TDP
400W
TDP
300W
-
-
-
-
-
Power Connectors
-
2x 8-Pin
-
-
GB6 OpenCL N/A
0%
GB6 OpenCL N/A
0%
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
1.59 POPS
INT4 Tensor Sparse
Peak AI Performance
26.5 TFLOPS
FP16
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
FP16
49.77 TFLOPS
199.07 TFLOPS Tensor (FP16 Accumulate)
398.13 TFLOPS Tensor (FP16 Accumulate) Sparse
199.07 TFLOPS Tensor (FP32 Accumulate)
398.13 TFLOPS Tensor (FP32 Accumulate) Sparse
FP16
26.5 TFLOPS
-
-
-
-
FP32
12.44 TFLOPS
-
-
FP32
13.25 TFLOPS
-
-
FP64
6.22 TFLOPS
12.44 TFLOPS Tensor
FP64
6.62 TFLOPS
-
BF16
24.88 TFLOPS
199.07 TFLOPS Tensor
398.13 TFLOPS Tensor Sparse
-
-
-
-
TF32
99.53 TFLOPS Tensor
199.07 TFLOPS Tensor Sparse
-
-
-
INT4
796.26 TOPS Tensor
1.59 POPS Tensor Sparse
-
-
-
INT8
-
398.13 TOPS Tensor
796.26 TOPS Tensor Sparse
-
-
-
-
INT32
12.44 TOPS
-
-
-
-
-
-
Pixel Fillrate
172.8 GPixel/s
Pixel Fillrate
110.4 GPixel/s
-
-
-
-
Texture Fillrate
388.8 GTexel/s
Texture Fillrate
414 GTexel/s
Manufacturer
NVIDIA
Manufacturer
AMD
Chip Designer
NVIDIA
Chip Designer
AMD
Architecture
Ampere
Architecture
GCN 5
Family
GRID
Family
Instinct
Codename
NV170
GA100
-
-
Codename
Moonshot
Vega 20
Variant
Vega 20 XL GL
Market Segment
Server
Market Segment
Server
Release Date
5/14/2020
Release Date
11/18/2018
Foundry
TSMC
-
Foundry
TSMC
-
Fabrication Node
7N
-
Fabrication Node
N7
-
Die Size
826 mm²
-
Die Size
331 mm²
-
Transistor Count
54.2 Billion
-
Transistor Count
13.2 Billion
-
Transistor Density
65.62M/mm²
-
Transistor Density
39.97M/mm²
-
Form
vGPU
Form
PCIe Card
Shading Units
6912 Shaders
-
Shading Units
3840 Shaders
-
Texture Mapping Units
432 TMUs
Texture Mapping Units
240 TMUs
Render Output Units
192 ROPs
Render Output Units
64 ROPs
Tensor Cores
432 T-Cores
-
-
-
-
-
-
Streaming Multiprocessors
108 SMs
-
-
-
-
Compute Units
60 CUs
-
-
-
-
-
-
-
-
-
-
-
900MHz
-
-
1450MHz Base
1725MHz
-
-
-
-
L1
64KB/SM Tex
192KB/SM
-
-
L1
-
-
16KB/CU
-
L2
40MB Shared
L2
4MB Shared
-
-
-
-
-
-
32GB
HBM2e
-
16GB
HBM2
ECC
Bus Width
6144Bit
Bus Width
4096Bit
Clock
1215MHz
Transfer Rate
2.4GT/s
Bandwidth
1866.2GB/s
Clock
1000MHz
Transfer Rate
2GT/s
Bandwidth
1024GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
400W
TDP
300W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1x mini-DisplayPort 1.4
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Max Resolution
Unknown
Max Resolution
7680x4320
Max Resolution Refresh Rate
-
Max Resolution Refresh Rate
60Hz
Variable Refresh Rate
G-Sync
FreeSync
-
Variable Refresh Rate
-
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
Multi Monitor Support
3
-
-
Content Protection
HDCP 2.2
No Encoders
-
Model
VCE 4.1
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Model
5x NVDEC 4
Model
UVD 7.2
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
JPEG
VC-1
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
-
-
-
-
Direct X
12
Direct 3D
12_1
-
-
OpenCL
3.0
Vulkan
1.2
OpenGL
4.6
OpenCL
2.1
Vulkan
1.3
-
-
CUDA
8.0
-
-
PureVideo HD
VP10
VDPAU
Feature Set J
Shader Model
6.7
-
-
GFX
9
-
-
-
-
Not a Card
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Power Connectors
-
-
-
2x 8-Pin
-
-
-
-
-
PCIe Version
4.0
PCIe Lanes
16
Slots Required
2.0
PCIe Version
3.0
PCIe Lanes
16
-
-
-
-
Multi GPU Support
Supported
Type
CrossFire XDMA
-
-
-
-
-
-
Height
111 mm (4.37 in)
Width
267 mm (10.51 in)
Depth
37 mm (1.46 in)
Change Comparison