GPUs

NVIDIA H100 SXM Full Specs

16,896 Shaders
1.98GHz
96GB HBM33.35TB/s
··
66.91 TFLOPS
Form Factor
SXM5
TDP
700W

Clock Speed
···
Peak OPS
3.96 POPSINT8 Tensor Sparse
Tensor FP8-16
1.98 PFLOPS
FP8-16 Tensor Sparse
3.96 PFLOPS
Tensor FP8-32
1.98 PFLOPS
FP8-32 Tensor Sparse
3.96 PFLOPS
Tensor FP16-16
989.4 TFLOPS
FP16-16 Tensor Sparse
1.98 PFLOPS
Tensor FP16-32
989.4 TFLOPS
FP16-32 Tensor Sparse
1.98 PFLOPS
BF16
133.8 TFLOPS
Tensor BF16
989.4 TFLOPS
BF16 Tensor Sparse
1.98 PFLOPS
Tensor TF32
494.7 TFLOPS
FP32
66.91 TFLOPS
FP64
33.45 TFLOPS
Tensor FP64
61.84 TFLOPS
Tensor INT8
1.98 POPS
Pixel Rate
47.5 GPixel/s
Texture Rate
1.04 TTexel/s

Shaders
16,896 Shaders
TMUs
528 TMUs
ROPs
24 ROPs
Tensor Cores
528 T-Cores
SMs
132 SMs

Base Clock
1.06GHz
Boost Clock
1.98GHz
Tensor Clock
1.83GHz

L2 Cache
51.2MB shared

96GB HBM3
Memory Bus
5120-bit
Memory Speed
5.2GT/s
Memory Bandwidth
3.35TB/s

TDP
700W

Decoder Model
7x NVDEC 5

Form Factor
SXM5
Cooling
Passive

Manufacturer
Chip Designer
Architecture
Family
Branding
H100 SXM branding
Codename
NV180
Market Segment
Server
Release Date
Mar 22, 2022

Foundry
TSMC
Fabrication Node
4N
Die Size
814mm²
Transistor Count
80 Billion
Transistor Density
98.28 MTr/mm²

No images available