H100 SXM Specs

H100 SXM
16896 Shaders
96GB HBM3
1980MHz
FP32
66.91 TFLOPS
FP16
133.82 TFLOPS
Form Factor
SXM5
-
TDP
700W
-
-
-
-
-
GB5 OpenCL - N/A
0%
GB5 CUDA - N/A
0%
GB5 Metal - N/A
0%
GB5 Vulkan - N/A
0%
OCT 2020.1 - N/A
0%
OCT Metal - N/A
0%
Manufacturer
NVIDIA
Chip Designer
NVIDIA
Architecture
Hopper
Family
Server
Codename
NV180
GH100
-
-
Market Segment
Server
Release Date
3/22/2022
Foundry
TSMC
-
Fabrication Node
4N
-
Die Size
814 mm²
-
Transistor Count
80 Billion
-
Transistor Density
98.28M/mm²
-
Form
SXM5
Shading Units
16896 Shaders
-
Texture Mapping Units
528 TMUs
Render Output Units
24 ROPs
Tensor Cores
528 T-Cores
-
-
Streaming Multiprocessors
132 SMs
-
-
-
-
-
-
1830MHz Tensor
-
1065MHz Base
1980MHz
-
-
FP8
-
3957.72 TFLOPS Tensor
FP16
133.82 TFLOPS
1978.86 TFLOPS Tensor
BF16
133.82 TFLOPS
1978.86 TFLOPS Tensor
FP32
66.91 TFLOPS
TF32
989.43 TFLOPS
FP64
33.45 TFLOPS
66.91 TFLOPS Tensor
INT8
3957.72 TOPS
-
-
-
Pixel Fillrate
47.52 GPixel/s
-
-
Texture Fillrate
1045.44 GTexel/s
-
-
L1
64KB/SM Tex
256KB/SM
-
-
L2
50MB Shared
-
-
-
96GB
HBM3
-
Bus Width
5120Bit
Clock
1313MHz
Transfer Rate
5.3GT/s
Bandwidth
3361.3GB/s
-
-
-
-
-
-
-
-
-
TDP
700W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
Max Resolution
Unknown
Max Resolution Refresh Rate
-
Variable Refresh Rate
G-Sync
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
-
-
No Encoders
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Decoders
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
OpenCL
3.0
-
-
-
-
CUDA
9.0
-
-
PureVideo HD
VP11
VDPAU
Feature Set K
Not a Card
-
-
-
-
-
-
-
-
-
-
-
-
-
PCIe Version
5.0
PCIe Lanes
16
Multi GPU Support
Supported
-
-
-
-
-
-
-
-
Change Results