Server GPUs - HMC

Family:

Server

Family:

Server

NVIDIA

GB200

Shaders

18,944

Boost

2.11GHz

Memory

192GB

TDP

2700W

FP32

160 TFLOPS(2x 80.02 TFLOPS)—

Peak

40 PFLOPSFP4 Tensor Sparse—

—

NVIDIA

B200

Shaders

18,944

Boost

1.98GHz

Memory

192GB

TDP

1000W

FP32

75.02 TFLOPS—

Peak

18 PFLOPSFP4 Tensor Sparse—

—

NVIDIA

B100

Shaders

18,944

Boost

1.6GHz

Memory

192GB

TDP

700W

FP32

60.62 TFLOPS—

Peak

14.01 PFLOPSFP4 Tensor Sparse—

—

NVIDIA

H200 SXM

Shaders

16,896

Boost

1.98GHz

Memory

141GB

TDP

700W

FP32

66.91 TFLOPS—

Peak

3.96 POPSINT8 Tensor Sparse—

—

NVIDIA

L4

Shaders

7,680

Boost

2.04GHz

Memory

24GB

TDP

72W

FP32

31.33 TFLOPS—

Peak

1 POPSINT4 Tensor Sparse—

—

NVIDIA

L40S

Shaders

18,176

Boost

2.52GHz

Memory

48GB

TDP

300W

FP32

91.61 TFLOPS—

Peak

2.93 POPSINT4 Tensor Sparse—

—

NVIDIA

L40

Shaders

18,176

Boost

2.49GHz

Memory

48GB

TDP

300W

FP32

90.52 TFLOPS—

Peak

2.9 POPSINT4 Tensor Sparse—

—

NVIDIA

H100 SXM

Shaders

16,896

Boost

1.98GHz

Memory

96GB

TDP

700W

FP32

66.91 TFLOPS—

Peak

3.96 POPSINT8 Tensor Sparse—

—

NVIDIA

H100 SXM 80GB

Shaders

16,896

Boost

1.98GHz

Memory

80GB

TDP

700W

FP32

66.91 TFLOPS—

Peak

3.96 POPSINT8 Tensor Sparse—

—

NVIDIA

H100

Shaders

14,592

Boost

1.75GHz

Memory

80GB

TDP

350W

FP32

51.22 TFLOPS—

Peak

3.03 POPSINT8 Tensor Sparse—

—

NVIDIA

A2

Shaders

1,280

Boost

1.77GHz

Memory

16GB

TDP

60W

FP32

4.53 TFLOPS—

Peak

145 TOPSINT4 Tensor Sparse—

—

NVIDIA

A100 SXM

Shaders

6,912

Boost

1.41GHz

Memory

80GB

TDP

400W

FP32

19.49 TFLOPS—

Peak

2.5 POPSINT4 Tensor Sparse—

—

NVIDIA

A100 SXM 40GB

Shaders

6,912

Boost

1.41GHz

Memory

40GB

TDP

400W

FP32

19.49 TFLOPS—

Peak

2.5 POPSINT4 Tensor Sparse—

—

NVIDIA

A800

Shaders

6,912

Boost

1.41GHz

Memory

80GB

TDP

250W

FP32

19.49 TFLOPS—

Peak

2.5 POPSINT4 Tensor Sparse—

—

NVIDIA

A800 40GB

Shaders

6,912

Boost

1.41GHz

Memory

40GB

TDP

250W

FP32

19.49 TFLOPS—

Peak

2.5 POPSINT4 Tensor Sparse—

—

NVIDIA

A100

Shaders

6,912

Boost

1.41GHz

Memory

80GB

TDP

250W

FP32

19.49 TFLOPS—

Peak

2.5 POPSINT4 Tensor Sparse—

—

NVIDIA

A100 40GB

Shaders

6,912

Boost

1.41GHz

Memory

40GB

TDP

250W

FP32

19.49 TFLOPS—

Peak

2.5 POPSINT4 Tensor Sparse—

—

NVIDIA

A100X

Shaders

6,912

Boost

1.44GHz

Memory

80GB

TDP

300W

FP32

19.91 TFLOPS—

Peak

2.55 POPSINT4 Tensor Sparse—

—

NVIDIA

A30

Shaders

3,584

Boost

1.44GHz

Memory

24GB

TDP

165W

FP32

10.32 TFLOPS—

Peak

1.32 POPSINT4 Tensor Sparse—

—

NVIDIA

A16

Shaders

1,280

Boost

1.7GHz

Memory

16GB

TDP

250W

FP32

17.36 TFLOPS(4x 4.34 TFLOPS)—

Peak

555.4 TOPSINT4 Tensor Sparse—

—

NVIDIA

A10

Shaders

9,216

Boost

1.7GHz

Memory

24GB

TDP

150W

FP32

31.24 TFLOPS—

Peak

999.8 TOPSINT4 Tensor Sparse—

—

NVIDIA

A40

Shaders

10,752

Boost

1.74GHz

Memory

48GB

TDP

300W

FP32

37.42 TFLOPS—

Peak

1.2 POPSINT4 Tensor Sparse—

—

NVIDIA

T40

Shaders

4,608

Boost

1.56GHz

Memory

24GB

TDP

150W

FP32

14.38 TFLOPS—

Peak

460.1 TOPSINT4 Tensor—

—

NVIDIA

T10

Shaders

3,072

Boost

1.4GHz

Memory

16GB

TDP

150W

FP32

8.57 TFLOPS—

Peak

274.3 TOPSINT4 Tensor—

—

NVIDIA

T4

Shaders

2,560

Boost

1.59GHz

Memory

16GB

TDP

70W

FP32

8.14 TFLOPS—

Peak

260.5 TOPSINT4 Tensor—

—

30 items

of

2