GPUs

NVIDIA H100 Full Specs

14,592 Shaders
1.75GHz
80GB HBM2e2.04TB/s
··
51.22 TFLOPS
Form Factor
PCIe Card
TDP
350W
Power Connectors
1x 16-Pin 12VHPWR

Clock Speed
···
Peak OPS
3.03 POPSINT8 Tensor Sparse
Tensor FP8-16
1.51 PFLOPS
FP8-16 Tensor Sparse
3.03 PFLOPS
Tensor FP8-32
1.51 PFLOPS
FP8-32 Tensor Sparse
3.03 PFLOPS
Tensor FP16-16
756.4 TFLOPS
FP16-16 Tensor Sparse
1.51 PFLOPS
Tensor FP16-32
756.4 TFLOPS
FP16-32 Tensor Sparse
1.51 PFLOPS
BF16
102.4 TFLOPS
Tensor BF16
756.4 TFLOPS
BF16 Tensor Sparse
1.51 PFLOPS
Tensor TF32
378.2 TFLOPS
FP32
51.22 TFLOPS
FP64
25.61 TFLOPS
Tensor FP64
47.28 TFLOPS
Tensor INT8
1.51 POPS
Pixel Rate
42.1 GPixel/s
Texture Rate
800.3 GTexel/s

Shaders
14,592 Shaders
TMUs
456 TMUs
ROPs
24 ROPs
Tensor Cores
456 T-Cores
SMs
114 SMs

Base Clock
1.06GHz
Boost Clock
1.75GHz
Tensor Clock
1.62GHz

L2 Cache
51.2MB shared

80GB HBM2e
Memory Bus
5120-bit
Memory Speed
3.2GT/s
Memory Bandwidth
2.04TB/s

TDP
350W

Decoder Model
7x NVDEC 5

Form Factor
PCIe Card
PCIe
2-Slots
Height
111 mm (4.37")
Width
268 mm (10.55")
Depth
40 mm (1.57")
Cooling
Passive
Power Connectors
1x 16-Pin 12VHPWR

Manufacturer
Chip Designer
Architecture
Family
Branding
H100 branding
Codename
NV180
Market Segment
Server
Release Date
Mar 22, 2022

Foundry
TSMC
Fabrication Node
4N
Die Size
814mm²
Transistor Count
80 Billion
Transistor Density
98.28 MTr/mm²

No images available