NVIDIA Server GPUs List

Select up to 3 items by clicking on the images to compare them in detail

Select Model Shaders TMUs ROPs Tensor Cores RT Cores Clock Peak AI Performance FP16 FP32 Memory Memory Type TDP Form Factor Release Date Manufacturer Family Architecture Codename Chip Die Shot
NVIDIA GB200 GB200 18944 592 32 592 - 2112MHz 40 PFLOPS FP4 Tensor Sparse 160 TFLOPS 80 TFLOPS 192GB HBM3e 2700W Superchip Mar 18, 2024 NVIDIA Server Blackwell NV190 GB100 NVIDIA GB100 Die
NVIDIA B200 B200 18944 592 32 592 - 1980MHz 18 PFLOPS FP4 Tensor Sparse 150 TFLOPS 75 TFLOPS 192GB HBM3e 1000W SXM6 Mar 18, 2024 NVIDIA Server Blackwell NV190 GB100 NVIDIA GB100 Die
NVIDIA B100 B100 18944 592 32 592 - 1600MHz 14 PFLOPS FP4 Tensor Sparse 121.2 TFLOPS 60.6 TFLOPS 192GB HBM3e 700W SXM6 Mar 18, 2024 NVIDIA Server Blackwell NV190 GB100 NVIDIA GB100 Die
NVIDIA H200 SXM H200 SXM 16896 528 24 528 - 1980MHz 4 PFLOPS FP8 Tensor FP32 Accumulate Sparse 133.8 TFLOPS 66.9 TFLOPS 141GB HBM3e 700W SXM5 Nov 13, 2023 NVIDIA Server Hopper NV180 GH100 NVIDIA GH100 Die
NVIDIA L4 L4 7680 240 80 240 60 2040MHz 1 POPS INT4 Tensor Sparse 31.3 TFLOPS 31.3 TFLOPS 24GB GDDR6 72W PCIe Card Mar 21, 2023 NVIDIA Server Ada Lovelace NV184 AD104 -
NVIDIA L40S L40S 18176 568 192 568 142 2520MHz 2.9 POPS INT4 Tensor Sparse 91.6 TFLOPS 91.6 TFLOPS 48GB GDDR6 300W PCIe Card Oct 13, 2022 NVIDIA Server Ada Lovelace NV182 AD102 NVIDIA AD102 Die
NVIDIA L40 L40 18176 568 192 568 142 2490MHz 2.9 POPS INT4 Tensor Sparse 90.5 TFLOPS 90.5 TFLOPS 48GB GDDR6 300W PCIe Card Oct 13, 2022 NVIDIA Server Ada Lovelace NV182 AD102 NVIDIA AD102 Die
NVIDIA H100 SXM 80GB H100 SXM 80GB 16896 528 24 528 - 1980MHz 4 PFLOPS FP8 Tensor FP32 Accumulate Sparse 133.8 TFLOPS 66.9 TFLOPS 80GB HBM3 700W SXM5 Mar 22, 2022 NVIDIA Server Hopper NV180 GH100 NVIDIA GH100 Die
NVIDIA H100 SXM H100 SXM 16896 528 24 528 - 1980MHz 4 PFLOPS FP8 Tensor FP32 Accumulate Sparse 133.8 TFLOPS 66.9 TFLOPS 96GB HBM3 700W SXM5 Mar 22, 2022 NVIDIA Server Hopper NV180 GH100 NVIDIA GH100 Die
NVIDIA H100 H100 14592 456 24 456 - 1755MHz 3 PFLOPS FP8 Tensor FP32 Accumulate Sparse 102.4 TFLOPS 51.2 TFLOPS 80GB HBM2e 350W PCIe Card Mar 22, 2022 NVIDIA Server Hopper NV180 GH100 NVIDIA GH100 Die
NVIDIA A2 A2 1280 40 32 40 10 1770MHz 145 TOPS INT4 Tensor Sparse 4.5 TFLOPS 4.5 TFLOPS 16GB GDDR6 60W PCIe Card Nov 10, 2021 NVIDIA Server Ampere NV177 GA107 -
NVIDIA A800 40GB A800 40GB 6912 432 160 432 - 1410MHz 2.5 POPS INT4 Tensor Sparse 78 TFLOPS 19.5 TFLOPS 40GB HBM2e 250W PCIe Card Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A800 A800 6912 432 160 432 - 1410MHz 2.5 POPS INT4 Tensor Sparse 78 TFLOPS 19.5 TFLOPS 80GB HBM2e 250W PCIe Card Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A100X A100X 6912 432 160 432 - 1440MHz 2.5 POPS INT4 Tensor Sparse 79.6 TFLOPS 19.9 TFLOPS 80GB HBM2e 300W PCIe Card Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A100 SXM 40GB A100 SXM 40GB 6912 432 160 432 - 1410MHz 2.5 POPS INT4 Tensor Sparse 78 TFLOPS 19.5 TFLOPS 40GB HBM2e 400W SXM4 Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A100 SXM A100 SXM 6912 432 160 432 - 1410MHz 2.5 POPS INT4 Tensor Sparse 78 TFLOPS 19.5 TFLOPS 80GB HBM2e 400W SXM4 Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A100 40GB A100 40GB 6912 432 160 432 - 1410MHz 2.5 POPS INT4 Tensor Sparse 78 TFLOPS 19.5 TFLOPS 40GB HBM2e 250W PCIe Card Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A100 A100 6912 432 160 432 - 1410MHz 2.5 POPS INT4 Tensor Sparse 78 TFLOPS 19.5 TFLOPS 80GB HBM2e 250W PCIe Card Jun 28, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A30 A30 3584 224 96 224 - 1440MHz 1.3 POPS INT4 Tensor Sparse 41.3 TFLOPS 10.3 TFLOPS 24GB HBM2 165W PCIe Card Apr 12, 2021 NVIDIA Server Ampere NV170 GA100 NVIDIA GA100 Die
NVIDIA A16 A16 1280 40 32 40 10 1695MHz 555.4 TOPS INT4 Tensor Sparse 4.3 TFLOPS 4.3 TFLOPS 16GB GDDR6 250W PCIe Card Apr 12, 2021 NVIDIA Server Ampere NV177 GA107 -
NVIDIA A10 A10 9216 288 96 288 72 1695MHz 999.8 TOPS INT4 Tensor Sparse 31.2 TFLOPS 31.2 TFLOPS 24GB GDDR6 150W PCIe Card Apr 12, 2021 NVIDIA Server Ampere NV172 GA102 NVIDIA GA102 Die
NVIDIA A40 A40 10752 336 112 336 84 1740MHz 1.2 POPS INT4 Tensor Sparse 37.4 TFLOPS 37.4 TFLOPS 48GB GDDR6 300W PCIe Card Oct 5, 2020 NVIDIA Server Ampere NV172 GA102 NVIDIA GA102 Die
NVIDIA T40 T40 4608 288 96 576 72 1560MHz 460.1 TOPS INT4 Tensor 28.8 TFLOPS 14.4 TFLOPS 24GB GDDR6 150W PCIe Card Sep 13, 2018 NVIDIA Server Turing NV162 TU102 NVIDIA TU102 Die
NVIDIA T4 T4 2560 160 64 320 40 1590MHz 260.5 TOPS INT4 Tensor 16.3 TFLOPS 8.1 TFLOPS 16GB GDDR6 70W PCIe Card Sep 13, 2018 NVIDIA Server Turing NV164 TU104 NVIDIA TU104 Die
NVIDIA T10 T10 3072 192 96 384 48 1395MHz 274.3 TOPS INT4 Tensor 17.1 TFLOPS 8.6 TFLOPS 16GB GDDR6 150W PCIe Card Sep 13, 2018 NVIDIA Server Turing NV162 TU102 NVIDIA TU102 Die
NVIDIA V100 SXM 16GB V100 SXM 16GB 5120 320 128 640 - 1530MHz 125.3 TFLOPS FP16 Tensor FP16 Accumulate 31.3 TFLOPS 15.7 TFLOPS 16GB HBM2 300W SXM2 Mar 27, 2018 NVIDIA Server Volta NV140 GV100 NVIDIA GV100 Die
NVIDIA V100 SXM V100 SXM 5120 320 128 640 - 1530MHz 125.3 TFLOPS FP16 Tensor FP16 Accumulate 31.3 TFLOPS 15.7 TFLOPS 32GB HBM2 300W SXM3 Mar 27, 2018 NVIDIA Server Volta NV140 GV100 NVIDIA GV100 Die
NVIDIA V100 FHHL V100 FHHL 5120 320 128 640 - 1290MHz 105.7 TFLOPS FP16 Tensor FP16 Accumulate 26.4 TFLOPS 13.2 TFLOPS 16GB HBM2 250W PCIe Card Mar 27, 2018 NVIDIA Server Volta NV140 GV100 NVIDIA GV100 Die
NVIDIA V100 16GB V100 16GB 5120 320 128 640 - 1380MHz 113.1 TFLOPS FP16 Tensor FP16 Accumulate 28.3 TFLOPS 14.1 TFLOPS 16GB HBM2 250W PCIe Card Mar 27, 2018 NVIDIA Server Volta NV140 GV100 NVIDIA GV100 Die
NVIDIA V100 V100 5120 320 128 640 - 1380MHz 113.1 TFLOPS FP16 Tensor FP16 Accumulate 28.3 TFLOPS 14.1 TFLOPS 32GB HBM2 250W PCIe Card Mar 27, 2018 NVIDIA Server Volta NV140 GV100 NVIDIA GV100 Die