NVIDIA A100X Full Specs - HMC

6,912 Shaders

1.44GHz

80GB HBM2e2.04TB/s

··

19.91 TFLOPS

Form Factor

PCIe Card

TDP

300W

Power Connectors

1x 8-Pin EPS

A100X

A100X2.55 POPSINT4 Tensor Sparse

x1

3.35 PFLOPS FP4 Tensor SparseGeForce RTX 5090

x1.32

Clock Speed

···

Peak OPS

2.55 POPSINT4 Tensor Sparse

Tensor FP16-16

318.5 TFLOPS

FP16-16 Tensor Sparse

637 TFLOPS

Tensor FP16-32

318.5 TFLOPS

FP16-32 Tensor Sparse

637 TFLOPS

BF16

39.81 TFLOPS

Tensor BF16

318.5 TFLOPS

BF16 Tensor Sparse

637 TFLOPS

Tensor TF32

159.3 TFLOPS

FP32

19.91 TFLOPS

FP64

9.95 TFLOPS

Tensor FP64

19.91 TFLOPS

Tensor INT4

1.27 POPS

Tensor INT8

637 TOPS

Pixel Rate

230.4 GPixel/s

Texture Rate

622.1 GTexel/s

Shaders

6,912 Shaders

TMUs

432 TMUs

ROPs

160 ROPs

Tensor Cores

432 T-Cores

SMs

108 SMs

Base Clock

795MHz

Boost Clock

1.44GHz

L1

64KB/SM Tex

L2 Cache

40MB shared

80GB HBM2e

Memory Bus

5120-bit

Memory Speed

3.2GT/s

Memory Bandwidth

2.04TB/s

ECC

No

TDP

300W

Adaptive Sync

G-Sync

FreeSync

DSC

Not Supported

OpenCL

3

Vulkan

1.2

CUDA

8

PureVideo HD

VP10

VDPAU

Feature Set J

Decoder

5x NVDEC 4

Codec

MPEG-1

MPEG-2

MPEG-4

VC-1

VP8

VP9

AVC (H.264)

HEVC (H.265)

Form Factor

PCIe Card

PCIe

PCIe 4.0 x16

2-Slots

Height

111mm (4.37")

Width

267mm (10.51")

Depth

40mm (1.57")

Cooling

Passive

Power Connectors

1x 8-Pin EPS

Multi-GPU

Multi-GPU Support

Supported

Multi-GPU Type

NVLink

Manufacturer

Chip Designer

Architecture

Family

Branding

Codename

NV170

Market Segment

Server

Release Date

Jun 28, 2021

Foundry

TSMC

Fabrication Node

7N

Die Size

826mm²

Transistor Count

54.2B

Transistor Density

65.62 MTr/mm²