NVIDIA GRID A100A vs AMD Radeon Instinct MI25

NVIDIA GRID A100A
AMD Radeon Instinct MI25
6912 Shaders
32GB HBM2e
900MHz
4096 Shaders
16GB HBM2
1500MHz
Peak AI Performance
1.59 POPS
INT4 Tensor Sparse
Peak AI Performance
24.58 TFLOPS
FP16
FP32
12.44 TFLOPS
FP32
12.29 TFLOPS
FP16
49.77 TFLOPS
FP16
24.58 TFLOPS
Form Factor
vGPU
-
Form Factor
PCIe Card
2.0-Slots
TDP
400W
TDP
300W
-
-
-
-
-
Power Connectors
-
2x 8-Pin
-
-
GB6 OpenCL N/A
0%
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
1.59 POPS
INT4 Tensor Sparse
Peak AI Performance
24.58 TFLOPS
FP16
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
FP16
49.77 TFLOPS
199.07 TFLOPS Tensor (FP16 Accumulate)
398.13 TFLOPS Tensor (FP16 Accumulate) Sparse
199.07 TFLOPS Tensor (FP32 Accumulate)
398.13 TFLOPS Tensor (FP32 Accumulate) Sparse
FP16
24.58 TFLOPS
-
-
-
-
FP32
12.44 TFLOPS
-
-
FP32
12.29 TFLOPS
-
-
FP64
6.22 TFLOPS
12.44 TFLOPS Tensor
FP64
770 GFLOPS
-
BF16
24.88 TFLOPS
199.07 TFLOPS Tensor
398.13 TFLOPS Tensor Sparse
-
-
-
-
TF32
99.53 TFLOPS Tensor
199.07 TFLOPS Tensor Sparse
-
-
-
INT4
796.26 TOPS Tensor
1.59 POPS Tensor Sparse
-
-
-
INT8
-
398.13 TOPS Tensor
796.26 TOPS Tensor Sparse
-
-
-
-
INT32
12.44 TOPS
-
-
-
-
-
-
Pixel Fillrate
172.8 GPixel/s
Pixel Fillrate
96 GPixel/s
-
-
-
-
Texture Fillrate
388.8 GTexel/s
Texture Fillrate
384 GTexel/s
Manufacturer
NVIDIA
Manufacturer
AMD
Chip Designer
NVIDIA
Chip Designer
AMD
Architecture
Ampere
Architecture
GCN 5
Family
GRID
Family
Instinct
Codename
NV170
GA100
-
-
Codename
Greenland
Vega 10
Variant
Vega 10 XT GL
Market Segment
Server
Market Segment
Server
Release Date
5/14/2020
Release Date
6/20/2017
Foundry
TSMC
-
Foundry
GlobalFoundries
-
Fabrication Node
7N
-
Fabrication Node
14LPP
-
Die Size
826 mm²
-
Die Size
486 mm²
-
Transistor Count
54.2 Billion
-
Transistor Count
12.5 Billion
-
Transistor Density
65.62M/mm²
-
Transistor Density
25.72M/mm²
-
Form
vGPU
Form
PCIe Card
Shading Units
6912 Shaders
-
Shading Units
4096 Shaders
-
Texture Mapping Units
432 TMUs
Texture Mapping Units
256 TMUs
Render Output Units
192 ROPs
Render Output Units
64 ROPs
Tensor Cores
432 T-Cores
-
-
-
-
-
-
Streaming Multiprocessors
108 SMs
-
-
-
-
Compute Units
64 CUs
-
-
-
-
-
-
-
-
-
-
-
900MHz
-
-
1400MHz Base
1500MHz
-
-
-
-
L1
64KB/SM Tex
192KB/SM
-
-
L1
-
-
16KB/CU
-
L2
40MB Shared
L2
4MB Shared
-
-
-
-
-
-
32GB
HBM2e
-
16GB
HBM2
ECC
Bus Width
6144Bit
Bus Width
2048Bit
Clock
1215MHz
Transfer Rate
2.4GT/s
Bandwidth
1866.2GB/s
Clock
945MHz
Transfer Rate
1.9GT/s
Bandwidth
483.8GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
400W
TDP
300W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1x mini-DisplayPort 1.4
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Max Resolution
Unknown
Max Resolution
7680x4320
Max Resolution Refresh Rate
-
Max Resolution Refresh Rate
60Hz
Variable Refresh Rate
G-Sync
FreeSync
-
Variable Refresh Rate
-
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
Multi Monitor Support
3
-
-
Content Protection
HDCP 2.2
No Encoders
-
Model
VCE 4.0
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Model
5x NVDEC 4
Model
UVD 7.0
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
JPEG
VC-1
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
-
-
-
-
Direct X
12
Direct 3D
12_1
-
-
OpenCL
3.0
Vulkan
1.2
OpenGL
4.6
OpenCL
2.1
Vulkan
1.3
-
-
CUDA
8.0
-
-
PureVideo HD
VP10
VDPAU
Feature Set J
Shader Model
6.7
-
-
GFX
9
-
-
-
-
Not a Card
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Power Connectors
-
-
-
2x 8-Pin
-
-
-
-
-
PCIe Version
4.0
PCIe Lanes
16
Slots Required
2.0
PCIe Version
3.0
PCIe Lanes
16
-
-
-
-
Multi GPU Support
Supported
Type
CrossFire XDMA
-
-
-
-
-
-
Height
111 mm (4.37 in)
Width
267 mm (10.51 in)
Depth
37 mm (1.46 in)
Change Comparison