NVIDIA H200 SXM Full Specs

Summary

16,896 Shaders 1.98GHz

141GB HBM3e4.81TB/s

Peak·FP32·FP16 66.91 TFLOPS

Form Factor SXM5

TDP 700W

Highlights

Peak OPS

Peak OPS FP32 FP16 Tensor FP8-16 FP8-16 Tensor Sparse Tensor FP8-32 FP8-32 Tensor Sparse Tensor FP16-16 FP16-16 Tensor Sparse Tensor FP16-32 FP16-32 Tensor Sparse FP64 Tensor FP64 BF16 Tensor BF16 BF16 Tensor Sparse Tensor TF32 Tensor INT8 Memory Bandwidth

H200 SXM3.96 POPSINT8 Tensor Sparse

x1

Top Score3.35 PFLOPS FP4 Tensor SparseDesktop1xGeForce RTX 5090

x0.85

Theoretical Performance

Clock Speed1980MHz UC·Base·Boost·OC

Peak OPS 3.96 POPSINT8 Tensor Sparse

Tensor FP8-16 1.98 PFLOPS FP8-16 Tensor Sparse 3.96 PFLOPS Tensor FP8-32 1.98 PFLOPS FP8-32 Tensor Sparse 3.96 PFLOPS

Tensor FP16-16 989.4 TFLOPS FP16-16 Tensor Sparse 1.98 PFLOPS Tensor FP16-32 989.4 TFLOPS FP16-32 Tensor Sparse 1.98 PFLOPS

BF16 133.8 TFLOPS Tensor BF16 989.4 TFLOPS BF16 Tensor Sparse 1.98 PFLOPS

Tensor TF32 494.7 TFLOPS

FP32 66.91 TFLOPS

FP64 33.45 TFLOPS Tensor FP64 61.84 TFLOPS

Tensor INT8 1.98 POPS

Pixel Rate 47.5 GPixel/s

Texture Rate 1.04 TTexel/s

Core Config

Shaders 16,896 Shaders

TMUs 528 TMUs

ROPs 24 ROPs

Tensor Cores 528 T-Cores

SMs 132 SMs

Clocks

Base Clock 1.06GHz

Boost Clock 1.98GHz

Tensor Clock 1.83GHz

Cache

L1 64KB/SM Tex

L2 Cache 50MB shared

Memory

141GB HBM3e

Memory Bus 6144-bit

Memory Speed 6.3GT/s

Memory Bandwidth 4.81TB/s

ECC No

Power & Thermals

TDP 700W

Video Output

Adaptive Sync G-Sync FreeSync

DSC Not Supported

API Support

OpenCL 3

CUDA 9 PureVideo HD VP11 VDPAU Feature Set K

Decoder

Decoder 7x NVDEC 5

Codec MPEG-1 MPEG-2 MPEG-4 VC-1 VP8 VP9 AVC (H.264) HEVC (H.265) AV1

Card

Form Factor SXM5

PCIe PCIe 5.0 x16

Cooling Passive

Multi-GPU Multi-GPU Support Supported Multi-GPU Type NVLink

Chip

Manufacturer NVIDIA

Chip Designer NVIDIA

Architecture Hopper

Family Server

Branding

Codename NV180

Market Segment Server

Release Date Nov 13, 2023

Fabrication

Foundry TSMC

Fabrication Node 4N

Die Size 814mm²

Transistor Count 80B

Transistor Density 98.28 MTr/mm²

Images