GPUs

NVIDIA A40 vs NVIDIA T40 Full Specs

10,752 Shaders
1.74GHz
4,608 Shaders
1.56GHz
48GB GDDR6347.9GB/s
24GB GDDR6624GB/s
··
37.42 TFLOPS
··
14.38 TFLOPS
Form Factor
PCIe Card
Form Factor
PCIe Card
TDP
300W
TDP
150W
Power Connectors
-
1x 8-Pin EPS
-
Power Connectors
1x 8-Pin
-
1x 6-Pin

Clock Speed
···
Clock Speed
···
Peak OPS
1.2 POPSINT4 Tensor Sparse
Peak OPS
460.1 TOPSINT4 Tensor
Tensor FP16-16
149.7 TFLOPS
FP16-16 Tensor Sparse
299.3 TFLOPS
Tensor FP16-32
74.83 TFLOPS
FP16-32 Tensor Sparse
149.7 TFLOPS
Tensor FP16-16
115 TFLOPS
FP16-16 Tensor Sparse
-
Tensor FP16-32
57.51 TFLOPS
FP16-32 Tensor Sparse
-
BF16
37.42 TFLOPS
Tensor BF16
74.83 TFLOPS
BF16 Tensor Sparse
149.7 TFLOPS
BF16
-
Tensor BF16
57.51 TFLOPS
BF16 Tensor Sparse
-
Tensor TF32
37.42 TFLOPS
Tensor TF32
57.51 TFLOPS
FP32
37.42 TFLOPS
FP32
14.38 TFLOPS
FP64
584.6 GFLOPS
FP64
449.3 GFLOPS
Tensor INT4
598.7 TOPS
Tensor INT4
460.1 TOPS
Tensor INT8
299.3 TOPS
Tensor INT8
230 TOPS
Ray
56.43 TOPS
Ray
43.37 TOPS
Pixel Rate
194.9 GPixel/s
Pixel Rate
149.8 GPixel/s
Texture Rate
584.6 GTexel/s
Texture Rate
449.3 GTexel/s

Shaders
10,752 Shaders
Shaders
4,608 Shaders
TMUs
336 TMUs
TMUs
288 TMUs
ROPs
112 ROPs
ROPs
96 ROPs
Tensor Cores
336 T-Cores
Tensor Cores
576 T-Cores
RT Cores
84 RT-Cores
RT Cores
72 RT-Cores
SMs
84 SMs
SMs
72 SMs

Base Clock
1.3GHz
Base Clock
1.3GHz
Boost Clock
1.74GHz
Boost Clock
1.56GHz

L2 Cache
6MB shared
L2 Cache
6MB shared

48GB GDDR6
24GB GDDR6
Memory Bus
384-bit
Memory Bus
384-bit
Memory Speed
7.2GT/s
Memory Speed
13GT/s
Memory Bandwidth
347.9GB/s
Memory Bandwidth
624GB/s
ECC
No
ECC
No

TDP
300W
TDP
150W

Multi-Monitor
3
Multi-Monitor
-
HDCP
HDCP 2.3
HDCP
-

3x DisplayPort 1.3
-

Encoder Model
NVENC 7
Encoder Model
NVENC 7
Codec
AVC (H.264)
HEVC (H.265)
Codec
AVC (H.264)
HEVC (H.265)

Decoder Model
NVDEC 5
Decoder Model
NVDEC 4
Codec
MPEG-1
MPEG-2
MPEG-4
VC-1
VP8
VP9
AVC (H.264)
HEVC (H.265)
AV1
Codec
MPEG-1
MPEG-2
MPEG-4
VC-1
VP8
VP9
AVC (H.264)
HEVC (H.265)
-

Form Factor
PCIe Card
Form Factor
PCIe Card
PCIe
2-Slots
PCIe
1-Slots
Height
112 mm (4.41")
Width
267 mm (10.51")
Depth
40 mm (1.57")
Height
111 mm (4.37")
Width
267 mm (10.51")
Depth
20 mm (0.79")
Cooling
Passive
Cooling
Passive
Power Connectors
1x 8-Pin EPS
Power Connectors
1x 8-Pin, 1x 6-Pin

Manufacturer
Manufacturer
Chip Designer
Chip Designer
Architecture
Architecture
Family
Family
Branding
A40 branding
Branding
T40 branding
Codename
NV172
Codename
NV162
Chip Variant
GA102-200-KD-A1
Chip Variant
TU102-300A-K1-A1
Market Segment
Server
Market Segment
Server
Release Date
Oct 5, 2020
Release Date
Sep 13, 2018

Foundry
Samsung
Foundry
TSMC
Fabrication Node
8N
Fabrication Node
12FFN
Die Size
628mm²
Die Size
754mm²
Transistor Count
28.3 Billion
Transistor Count
18.6 Billion
Transistor Density
45.04 MTr/mm²
Transistor Density
24.67 MTr/mm²