AMD Radeon Pro V520 vs NVIDIA GRID A100B

AMD Radeon Pro V520
NVIDIA GRID A100B
2304 Shaders
8GB HBM2
1600MHz
6912 Shaders
48GB HBM2e
900MHz
Peak AI Performance
7.37 TFLOPS
FP32
Peak AI Performance
1.59 POPS
INT4 Tensor Sparse
FP32
7.37 TFLOPS
FP32
12.44 TFLOPS
-
-
FP16
49.77 TFLOPS
Form Factor
PCIe Card
2.0-Slots
Form Factor
vGPU
-
TDP
225W
TDP
400W
Power Connectors
-
1x 8-Pin
-
-
-
-
-
-
-
GB6 OpenCL N/A
0%
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
7.37 TFLOPS
FP32
Peak AI Performance
1.59 POPS
INT4 Tensor Sparse
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
FP16
49.77 TFLOPS
199.07 TFLOPS Tensor (FP16 Accumulate)
398.13 TFLOPS Tensor (FP16 Accumulate) Sparse
199.07 TFLOPS Tensor (FP32 Accumulate)
398.13 TFLOPS Tensor (FP32 Accumulate) Sparse
FP32
7.37 TFLOPS
-
-
FP32
12.44 TFLOPS
-
-
FP64
460 GFLOPS
-
FP64
6.22 TFLOPS
12.44 TFLOPS Tensor
-
-
-
-
BF16
24.88 TFLOPS
199.07 TFLOPS Tensor
398.13 TFLOPS Tensor Sparse
-
-
-
TF32
99.53 TFLOPS Tensor
199.07 TFLOPS Tensor Sparse
-
-
-
INT4
796.26 TOPS Tensor
1.59 POPS Tensor Sparse
-
-
-
-
INT8
-
398.13 TOPS Tensor
796.26 TOPS Tensor Sparse
-
-
INT32
12.44 TOPS
-
-
-
-
Pixel Fillrate
102.4 GPixel/s
Pixel Fillrate
172.8 GPixel/s
-
-
-
-
Texture Fillrate
230.4 GTexel/s
Texture Fillrate
388.8 GTexel/s
Manufacturer
AMD
Manufacturer
NVIDIA
Chip Designer
AMD
Chip Designer
NVIDIA
Architecture
RDNA 1
Architecture
Ampere
Family
Radeon Pro V
Family
GRID
Codename
-
Navi 12
Variant
Navi 12 XL GL
Codename
NV170
GA100
-
-
Market Segment
Server
Market Segment
Server
Release Date
12/1/2020
Release Date
5/14/2020
Foundry
TSMC
-
Foundry
TSMC
-
Fabrication Node
N7
-
Fabrication Node
7N
-
Die Size
251 mm²
-
Die Size
826 mm²
-
Transistor Count
10.3 Billion
-
Transistor Count
54.2 Billion
-
Transistor Density
41.04M/mm²
-
Transistor Density
65.62M/mm²
-
Form
PCIe Card
Form
vGPU
Shading Units
2304 Shaders
-
Shading Units
6912 Shaders
-
Texture Mapping Units
144 TMUs
Texture Mapping Units
432 TMUs
Render Output Units
64 ROPs
Render Output Units
192 ROPs
-
-
Tensor Cores
432 T-Cores
-
-
-
-
-
-
Streaming Multiprocessors
108 SMs
Compute Units
36 CUs
-
-
-
-
-
-
-
-
-
-
-
-
1000MHz Base
1600MHz
-
-
-
900MHz
L0
32KB/WGP
-
-
L1
-
-
-
128KB/Array
L1
64KB/SM Tex
192KB/SM
-
-
L2
4MB Shared
L2
40MB Shared
-
-
-
-
-
-
8GB
HBM2
-
48GB
HBM2e
-
Bus Width
2048Bit
Bus Width
6144Bit
Clock
1000MHz
Transfer Rate
2GT/s
Bandwidth
512GB/s
Clock
1215MHz
Transfer Rate
2.4GT/s
Bandwidth
1866.2GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
225W
TDP
400W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
Max Resolution
7680x4320
Max Resolution
Unknown
Max Resolution Refresh Rate
120Hz
Max Resolution Refresh Rate
-
Variable Refresh Rate
-
FreeSync
-
Variable Refresh Rate
G-Sync
FreeSync
-
Display Stream Compression (DSC)
Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
4
Multi Monitor Support
Unknown
Content Protection
HDCP 2.3
-
-
Model
VCN 2.0
No Encoders
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Model
VCN 2.0
Model
5x NVDEC 4
Codec
MPEG-1
MPEG-2
MPEG-4
JPEG
VC-1
-
VP9
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Direct X
12
Direct 3D
12_1
-
-
-
-
OpenGL
4.6
OpenCL
2.1
Vulkan
1.2
-
-
OpenCL
3.0
Vulkan
1.2
Shader Model
6.5
-
-
GFX
10.1
-
-
-
-
-
-
CUDA
8.0
-
-
PureVideo HD
VP10
VDPAU
Feature Set J
-
-
-
-
Not a Card
-
-
-
Power Connectors
-
-
-
1x 8-Pin
-
-
-
-
-
-
-
-
-
-
-
Slots Required
2.0
PCIe Version
4.0
PCIe Lanes
16
-
-
PCIe Version
4.0
PCIe Lanes
16
Multi GPU Support
Supported
Type
CrossFire XDMA
-
-
-
-
Height
111 mm (4.37 in)
Width
267 mm (10.51 in)
Depth
37 mm (1.46 in)
-
-
-
-
-
-
Change Comparison