NVIDIA H100 vs AMD FirePro S7100X

NVIDIA H100
AMD FirePro S7100X
14592 Shaders
80GB HBM2e
1755MHz
2048 Shaders
8GB GDDR5
723MHz
Peak AI Performance
3.03 POPS
INT8 Tensor Sparse
Peak AI Performance
2.96 TFLOPS
FP32
FP32
51.22 TFLOPS
FP32
2.96 TFLOPS
FP16
102.44 TFLOPS
-
-
Form Factor
PCIe Card
2.0-Slots
Form Factor
MXM-A
-
TDP
350W
TDP
100W
Power Connectors
-
-
-
1x 16-Pin 12VHPWR
-
-
-
-
-
GB6 OpenCL N/A
0%
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
3.03 POPS
INT8 Tensor Sparse
Peak AI Performance
2.96 TFLOPS
FP32
-
-
-
-
-
-
FP8
-
1.51 PFLOPS Tensor (FP16 Accumulate)
3.03 PFLOPS Tensor (FP16 Accumulate) Sparse
1.51 PFLOPS Tensor (FP32 Accumulate)
3.03 PFLOPS Tensor (FP32 Accumulate) Sparse
-
-
-
-
-
-
FP16
102.44 TFLOPS
756.45 TFLOPS Tensor (FP16 Accumulate)
1.51 PFLOPS Tensor (FP16 Accumulate) Sparse
756.45 TFLOPS Tensor (FP32 Accumulate)
1.51 PFLOPS Tensor (FP32 Accumulate) Sparse
-
-
-
-
-
-
FP32
51.22 TFLOPS
-
-
FP32
2.96 TFLOPS
-
-
FP64
25.61 TFLOPS
47.28 TFLOPS Tensor
FP64
190 GFLOPS
-
BF16
102.44 TFLOPS
756.45 TFLOPS Tensor
1.51 PFLOPS Tensor Sparse
-
-
-
-
TF32
378.23 TFLOPS Tensor
756.45 TFLOPS Tensor Sparse
-
-
-
-
-
-
-
-
-
INT8
-
1.51 POPS Tensor
3.03 POPS Tensor Sparse
-
-
-
-
INT32
25.61 TOPS
-
-
-
-
-
-
Pixel Fillrate
42.12 GPixel/s
Pixel Fillrate
23.136 GPixel/s
-
-
-
-
Texture Fillrate
800.28 GTexel/s
Texture Fillrate
92.544 GTexel/s
Manufacturer
NVIDIA
Manufacturer
AMD
Chip Designer
NVIDIA
Chip Designer
AMD
Architecture
Hopper
Architecture
GCN 3
Family
Server
Family
FirePro S
Codename
NV180
GH100
-
-
Codename
Tonga
-
Variant
Amethyst XT GL
Market Segment
Server
Market Segment
Server
Release Date
3/22/2022
Release Date
5/25/2016
Foundry
TSMC
-
Foundry
TSMC
-
Fabrication Node
4N
-
Fabrication Node
28nm
-
Die Size
814 mm²
-
Die Size
359 mm²
-
Transistor Count
80 Billion
-
Transistor Count
5 Billion
-
Transistor Density
98.28M/mm²
-
Transistor Density
13.93M/mm²
-
Form
PCIe Card
Form
MXM-A
Shading Units
14592 Shaders
-
Shading Units
2048 Shaders
-
Texture Mapping Units
456 TMUs
Texture Mapping Units
128 TMUs
Render Output Units
24 ROPs
Render Output Units
32 ROPs
Tensor Cores
456 T-Cores
-
-
-
-
-
-
Streaming Multiprocessors
114 SMs
-
-
-
-
Compute Units
32 CUs
-
-
-
-
-
-
-
-
1620MHz Tensor
-
1065MHz Base
1755MHz
-
-
-
723MHz
-
-
-
-
L1
64KB/SM Tex
256KB/SM
-
-
L1
-
-
16KB/CU
-
L2
50MB Shared
L2
768KB Shared
-
-
-
-
-
-
80GB
HBM2e
-
8GB
GDDR5
-
Bus Width
5120Bit
Bus Width
256Bit
Clock
1593MHz
Transfer Rate
3.2GT/s
Bandwidth
2039GB/s
Clock
1050MHz
Transfer Rate
4.2GT/s
Bandwidth
134.4GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
350W
TDP
100W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
Max Resolution
Unknown
Max Resolution
4096x2160
Max Resolution Refresh Rate
-
Max Resolution Refresh Rate
60Hz
Variable Refresh Rate
G-Sync
FreeSync
-
Variable Refresh Rate
-
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
Multi Monitor Support
3
-
-
Content Protection
HDCP 1.4
No Encoders
-
Model
VCE 3.0
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Model
7x NVDEC 5
Model
UVD 5.0
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
AV1
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
-
-
-
AVC (H.264)
-
-
-
-
-
-
-
-
-
Direct X
12
Direct 3D
12_0
-
-
OpenCL
3.0
-
-
OpenGL
4.6
OpenCL
2.1
Vulkan
1.2
-
-
CUDA
9.0
-
-
PureVideo HD
VP11
VDPAU
Feature Set K
Shader Model
6.5
-
-
GFX
8
-
-
-
-
-
-
-
-
Not a Card
-
-
-
Power Connectors
-
-
-
-
-
-
1x 16-Pin 12VHPWR
-
-
-
-
-
-
-
-
Slots Required
2.0
PCIe Version
5.0
PCIe Lanes
16
-
-
PCIe Version
3.0
PCIe Lanes
16
Multi GPU Support
Supported
Type
NVLink
-
-
-
-
Height
111 mm (4.37 in)
Width
268 mm (10.55 in)
Depth
40 mm (1.57 in)
-
-
-
-
-
-
Change Comparison