NVIDIA GB200 vs NVIDIA H100 SXM Full Specs
37,888 Shaders 2.11GHz | 16,896 Shaders 1.98GHz |
384GB HBM3e16TB/s | 96GB HBM33.35TB/s |
·· 160 TFLOPS | ·· 66.91 TFLOPS |
Form Factor Superchip | Form Factor SXM5 |
TDP 2700W | TDP 700W |
Clock Speed ·· | Clock Speed ··· |
Peak OPS 40 PFLOPSFP4 Tensor Sparse | Peak OPS 3.96 POPSINT8 Tensor Sparse |
Tensor FP4 20 PFLOPSFP4 Tensor Sparse 40 PFLOPS | - |
Tensor FP8-16 10 PFLOPSFP8-16 Tensor Sparse 20 PFLOPSTensor FP8-32 10 PFLOPSFP8-32 Tensor Sparse 20 PFLOPS | Tensor FP8-16 1.98 PFLOPSFP8-16 Tensor Sparse 3.96 PFLOPSTensor FP8-32 1.98 PFLOPSFP8-32 Tensor Sparse 3.96 PFLOPS |
Tensor FP16-16 5 PFLOPSFP16-16 Tensor Sparse 10 PFLOPSTensor FP16-32 5 PFLOPSFP16-32 Tensor Sparse 10 PFLOPS | Tensor FP16-16 989.4 TFLOPSFP16-16 Tensor Sparse 1.98 PFLOPSTensor FP16-32 989.4 TFLOPSFP16-32 Tensor Sparse 1.98 PFLOPS |
BF16 320.1 TFLOPSTensor BF16 5 PFLOPSBF16 Tensor Sparse 10 PFLOPS | BF16 133.8 TFLOPSTensor BF16 989.4 TFLOPSBF16 Tensor Sparse 1.98 PFLOPS |
Tensor TF32 2.5 PFLOPS | Tensor TF32 494.7 TFLOPS |
FP32 160 TFLOPS | FP32 66.91 TFLOPS |
FP64 80.02 TFLOPSTensor FP64 78.13 TFLOPS | FP64 33.45 TFLOPSTensor FP64 61.84 TFLOPS |
Tensor INT8 10 POPS | Tensor INT8 1.98 POPS |
Pixel Rate 67.6 GPixel/s | Pixel Rate 47.5 GPixel/s |
Texture Rate 1.25 TTexel/s | Texture Rate 1.04 TTexel/s |
Shaders 37,888 Shaders | Shaders 16,896 Shaders |
TMUs 1,184 TMUs | TMUs 528 TMUs |
ROPs 64 ROPs | ROPs 24 ROPs |
Tensor Cores 1,184 T-Cores | Tensor Cores 528 T-Cores |
SMs 296 SMs | SMs 132 SMs |
Base Clock - | Base Clock 1.06GHz |
Boost Clock 2.11GHz | Boost Clock 1.98GHz |
Tensor Clock 2.06GHz | Tensor Clock 1.83GHz |
L2 Cache 64MB shared | L2 Cache 50MB shared |
384GB HBM3e | 96GB HBM3 |
Memory Bus 8192-bit | Memory Bus 5120-bit |
Memory Speed 7.8GT/s | Memory Speed 5.2GT/s |
Memory Bandwidth 16TB/s | Memory Bandwidth 3.35TB/s |
ECC No | ECC No |
TDP 2700W | TDP 700W |
Decoder Model 7x NVDEC 6 | Decoder Model 7x NVDEC 5 |
Codec MPEG-1 MPEG-2 MPEG-4 VC-1 VP8 VP9 AVC (H.264) HEVC (H.265) AV1 | Codec MPEG-1 MPEG-2 MPEG-4 VC-1 VP8 VP9 AVC (H.264) HEVC (H.265) AV1 |
Form Factor Superchip | Form Factor SXM5 |
Cooling Passive | Cooling Passive |
Foundry TSMC | Foundry TSMC |
Fabrication Node 4NP | Fabrication Node 4N |
Die Size 1620mm² | Die Size 814mm² |
Transistor Count 208 Billion | Transistor Count 80 Billion |
Transistor Density 128.4 MTr/mm² | Transistor Density 98.28 MTr/mm² |
