GPUs

NVIDIA A16 vs NVIDIA A2 Full Specs

5,120 Shaders
1.7GHz
1,280 Shaders
1.77GHz
64GB GDDR6463.4GB/s
16GB GDDR6100.1GB/s
··
17.36 TFLOPS
··
4.53 TFLOPS
Form Factor
PCIe Card
Form Factor
PCIe Card
TDP
250W
TDP
60W
Power Connectors
1x 8-Pin EPS
Power Connectors
-

A16A16555.4 TOPSINT4 Tensor Sparse (4x 138.9 TOPS)
x3.83
A2A2145 TOPSINT4 Tensor Sparse
x1

Clock Speed
···
Clock Speed
···
Peak OPS
555.4 TOPSINT4 Tensor Sparse
Peak OPS
145 TOPSINT4 Tensor Sparse
Tensor FP16-16
69.43 TFLOPS
FP16-16 Tensor Sparse
138.9 TFLOPS
Tensor FP16-32
34.71 TFLOPS
FP16-32 Tensor Sparse
69.43 TFLOPS
Tensor FP16-16
18.12 TFLOPS
FP16-16 Tensor Sparse
36.25 TFLOPS
Tensor FP16-32
9.06 TFLOPS
FP16-32 Tensor Sparse
18.12 TFLOPS
BF16
17.36 TFLOPS
Tensor BF16
34.71 TFLOPS
BF16 Tensor Sparse
69.43 TFLOPS
BF16
4.53 TFLOPS
Tensor BF16
9.06 TFLOPS
BF16 Tensor Sparse
18.12 TFLOPS
Tensor TF32
17.36 TFLOPS
Tensor TF32
4.53 TFLOPS
FP32
17.36 TFLOPS
FP32
4.53 TFLOPS
FP64
271.2 GFLOPS
FP64
70.8 GFLOPS
Tensor INT4
277.7 TOPS
Tensor INT4
72.5 TOPS
Tensor INT8
138.9 TOPS
Tensor INT8
36.25 TOPS
Ray
26.18 TOPS
Ray
6.83 TOPS
Pixel Rate
54.2 GPixel/s
Pixel Rate
56.6 GPixel/s
Texture Rate
67.8 GTexel/s
Texture Rate
70.8 GTexel/s

Shaders
5,120 Shaders
Shaders
1,280 Shaders
TMUs
160 TMUs
TMUs
40 TMUs
ROPs
128 ROPs
ROPs
32 ROPs
Tensor Cores
160 T-Cores
Tensor Cores
40 T-Cores
RT Cores
40 RT-Cores
RT Cores
10 RT-Cores
SMs
40 SMs
SMs
10 SMs

Base Clock
885MHz
Base Clock
1.44GHz
Boost Clock
1.7GHz
Boost Clock
1.77GHz

L2 Cache
2MB shared
L2 Cache
2MB shared

64GB GDDR6
16GB GDDR6
Memory Bus
128-bit
Memory Bus
128-bit
Memory Speed
7.2GT/s
Memory Speed
6.3GT/s
Memory Bandwidth
463.4GB/s
Memory Bandwidth
100.1GB/s

TDP
250W
TDP
60W

Encoder Model
NVENC 7
Encoder Model
NVENC 7

Decoder Model
NVDEC 5
Decoder Model
NVDEC 5

Form Factor
PCIe Card
Form Factor
PCIe Card
PCIe
2-Slots
PCIe
1-Slots
Height
112 mm (4.41")
Width
267 mm (10.51")
Depth
40 mm (1.57")
Height
69 mm (2.72")
Width
168 mm (6.61")
Depth
20 mm (0.79")
Cooling
Passive
Cooling
Passive
Power Connectors
1x 8-Pin EPS
Power Connectors
-

Manufacturer
Manufacturer
Chip Designer
Chip Designer
Architecture
Architecture
Family
Family
Branding
A16 branding
Branding
A2 branding
Codename
NV177
Codename
NV177
Chip Variant
GA107-140-A1
Chip Variant
GA107-140-A1
Market Segment
Server
Market Segment
Server
Release Date
Apr 12, 2021
Release Date
Nov 10, 2021

Foundry
Samsung
Foundry
Samsung
Fabrication Node
8N
Fabrication Node
8N
Die Size
200mm²
Die Size
200mm²
Transistor Count
8.7 Billion
Transistor Count
8.7 Billion
Transistor Density
43.5 MTr/mm²
Transistor Density
43.5 MTr/mm²

No images available
No images available