NVIDIA H200 SXM

H200 SXM

NVIDIA RTX 5880 Ada

RTX 5880 Ada

NVIDIA H200 SXM vs NVIDIA RTX 5880 Ada Full Specs

16,896 Shaders
1.98GHz
14,080 Shaders
2.55GHz
141GB HBM3e4.81TB/s
48GB GDDR6864GB/s
··
66.91 TFLOPS
··
71.81 TFLOPS
Form Factor
SXM5
Form Factor
PCIe Card
TDP
700W
TDP
285W
Power Connectors
-
Power Connectors
1x 16-Pin 12VHPWR

H200 SXMH200 SXM3.96 POPSINT8 Tensor Sparse
x1.72
RTX 5880 AdaRTX 5880 Ada2.3 POPSINT4 Tensor Sparse
x1

Clock Speed
···
Clock Speed
···
Peak OPS
3.96 POPSINT8 Tensor Sparse
Peak OPS
2.3 POPSINT4 Tensor Sparse
Tensor FP8-16
1.98 PFLOPS
FP8-16 Tensor Sparse
3.96 PFLOPS
Tensor FP8-32
1.98 PFLOPS
FP8-32 Tensor Sparse
3.96 PFLOPS
Tensor FP8-16
574.5 TFLOPS
FP8-16 Tensor Sparse
1.15 PFLOPS
Tensor FP8-32
287.2 TFLOPS
FP8-32 Tensor Sparse
574.5 TFLOPS
Tensor FP16-16
989.4 TFLOPS
FP16-16 Tensor Sparse
1.98 PFLOPS
Tensor FP16-32
989.4 TFLOPS
FP16-32 Tensor Sparse
1.98 PFLOPS
Tensor FP16-16
287.2 TFLOPS
FP16-16 Tensor Sparse
574.5 TFLOPS
Tensor FP16-32
143.6 TFLOPS
FP16-32 Tensor Sparse
287.2 TFLOPS
BF16
133.8 TFLOPS
Tensor BF16
989.4 TFLOPS
BF16 Tensor Sparse
1.98 PFLOPS
BF16
71.81 TFLOPS
Tensor BF16
143.6 TFLOPS
BF16 Tensor Sparse
287.2 TFLOPS
Tensor TF32
494.7 TFLOPS
Tensor TF32
71.81 TFLOPS
FP32
66.91 TFLOPS
FP32
71.81 TFLOPS
FP64
33.45 TFLOPS
Tensor FP64
61.84 TFLOPS
FP64
1.12 TFLOPS
Tensor FP64
-
Tensor INT4
-
Tensor INT4
1.15 POPS
Tensor INT8
1.98 POPS
Tensor INT8
574.5 TOPS
Ray
-
Ray
166 TOPS
Pixel Rate
47.5 GPixel/s
Pixel Rate
448.8 GPixel/s
Texture Rate
1.04 TTexel/s
Texture Rate
1.12 TTexel/s

Shaders
16,896 Shaders
Shaders
14,080 Shaders
TMUs
528 TMUs
TMUs
440 TMUs
ROPs
24 ROPs
ROPs
176 ROPs
Tensor Cores
528 T-Cores
Tensor Cores
440 T-Cores
RT Cores
-
RT Cores
110 RT-Cores
SMs
132 SMs
SMs
110 SMs

Base Clock
1.06GHz
Base Clock
1.16GHz
Boost Clock
1.98GHz
Boost Clock
2.55GHz
Tensor Clock
1.83GHz
Tensor Clock
-

L1
64KB/SM Tex
L1
64KB/SM Tex
L2 Cache
50MB shared
L2 Cache
72MB shared

141GB HBM3e
48GB GDDR6
Memory Bus
6144-bit
Memory Bus
384-bit
Memory Speed
6.3GT/s
Memory Speed
18GT/s
Memory Bandwidth
4.81TB/s
Memory Bandwidth
864GB/s
ECC
No
ECC
Yes

TDP
700W
TDP
285W

Max Resolution
-
Max Resolution
7680x4320
Refresh Rate Calculator
-
Refresh Rate Calculator
7680x4320
Resolution8K UHD
Refresh Rate
60Hz
Multi-Monitor
-
Multi-Monitor
4
Adaptive Sync
G-Sync
FreeSync
Adaptive Sync
G-Sync
FreeSync
DSC
Not Supported
DSC
Supported
HDCP
-
HDCP
HDCP 2.3

-
4x DisplayPort 1.4

Shader Model
-
Shader Model
6.6
-
DirectX
DirectX 12
Direct3D
12_3
OpenGL
-
OpenCL
3
Vulkan
-
OpenGL
4.6
OpenCL
3
Vulkan
1.3
CUDA
9
PureVideo HD
VP11
VDPAU
Feature Set K
CUDA
8.9
PureVideo HD
VP12
VDPAU
Feature Set L

-
Encoder
3x NVENC 8
Codec
-
Codec
AVC (H.264)
HEVC (H.265)
AV1

Decoder
7x NVDEC 5
Decoder
3x NVDEC 5
Codec
MPEG-1
MPEG-2
MPEG-4
VC-1
VP8
VP9
AVC (H.264)
HEVC (H.265)
AV1
Codec
MPEG-1
MPEG-2
MPEG-4
VC-1
VP8
VP9
AVC (H.264)
HEVC (H.265)
AV1

Form Factor
SXM5
Form Factor
PCIe Card
PCIe
PCIe 5.0 x16
-
PCIe
PCIe 4.0 x16
2-Slots
-
Height
112mm (4.41")
Width
267mm (10.51")
Depth
40mm (1.57")
Cooling
Passive
Cooling
Passive
Power Connectors
-
Power Connectors
1x 16-Pin 12VHPWR
Multi-GPU
Multi-GPU Support
Supported
Multi-GPU Type
NVLink
Multi-GPU
-

Manufacturer
Manufacturer
Chip Designer
Chip Designer
Architecture
Architecture
Family
Family
Branding
H200 SXM branding
Branding
RTX branding
Codename
NV180
Codename
NV182
Chip Variant
-
Chip Variant
AD102-200-A1
Market Segment
Server
Market Segment
Workstation
Release Date
Nov 13, 2023
Release Date
Jan 5, 2024

Foundry
TSMC
Foundry
TSMC
Fabrication Node
4N
Fabrication Node
4N
Die Size
814mm²
Die Size
608mm²
Transistor Count
80B
Transistor Count
76.3B
Transistor Density
98.28 MTr/mm²
Transistor Density
125.4 MTr/mm²