GPUs

NVIDIA H200 SXM Full Specs

16,896 Shaders
1.98GHz
141GB HBM3e4.81TB/s
··
66.91 TFLOPS
Form Factor
SXM5
TDP
700W

Clock Speed
···
Peak OPS
3.96 POPSINT8 Tensor Sparse
Tensor FP8-16
1.98 PFLOPS
FP8-16 Tensor Sparse
3.96 PFLOPS
Tensor FP8-32
1.98 PFLOPS
FP8-32 Tensor Sparse
3.96 PFLOPS
Tensor FP16-16
989.4 TFLOPS
FP16-16 Tensor Sparse
1.98 PFLOPS
Tensor FP16-32
989.4 TFLOPS
FP16-32 Tensor Sparse
1.98 PFLOPS
BF16
133.8 TFLOPS
Tensor BF16
989.4 TFLOPS
BF16 Tensor Sparse
1.98 PFLOPS
Tensor TF32
494.7 TFLOPS
FP32
66.91 TFLOPS
FP64
33.45 TFLOPS
Tensor FP64
61.84 TFLOPS
Tensor INT8
1.98 POPS
Pixel Rate
47.5 GPixel/s
Texture Rate
1.04 TTexel/s

Shaders
16,896 Shaders
TMUs
528 TMUs
ROPs
24 ROPs
Tensor Cores
528 T-Cores
SMs
132 SMs

Base Clock
1.06GHz
Boost Clock
1.98GHz
Tensor Clock
1.83GHz

L2 Cache
51.2MB shared

141GB HBM3e
Memory Bus
6144-bit
Memory Speed
6.3GT/s
Memory Bandwidth
4.81TB/s

TDP
700W

Decoder Model
7x NVDEC 5

Form Factor
SXM5
Cooling
Passive

Manufacturer
Chip Designer
Architecture
Family
Branding
H200 SXM branding
Codename
NV180
Market Segment
Server
Release Date
Nov 13, 2023

Foundry
TSMC
Fabrication Node
4N
Die Size
814mm²
Transistor Count
80 Billion
Transistor Density
98.28 MTr/mm²

No images available