NVIDIA A40 Specs

NVIDIA A40
10752 Shaders
48GB GDDR6
1740MHz
Peak Performance
1197.34 TOPS
INT4 Tensor Sparse
FP32
37.42 TFLOPS
FP16
37.42 TFLOPS
Form Factor
PCIe Card
2.0-Slots
TDP
300W
Power Connectors
-
-
-
-
GB6 Metal N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
Manufacturer
NVIDIA
Chip Designer
NVIDIA
Architecture
Ampere
Family
Server
Codename
NV172
GA102
Variant
GA102-895-A1
Market Segment
Server
Release Date
10/5/2020
Foundry
Samsung
-
Fabrication Node
8N
-
Die Size
628 mm²
-
Transistor Count
28.3 Billion
-
Transistor Density
45.04M/mm²
-
Form
PCIe Card
Shading Units
10752 Shaders
-
Texture Mapping Units
336 TMUs
Render Output Units
112 ROPs
Tensor Cores
336 T-Cores
Ray-Tracing Cores
84 RT-Cores
Streaming Multiprocessors
84 SMs
-
-
-
-
-
-
-
-
1305MHz Base
1740MHz
Peak Performance
1197.34 TOPS
INT4 Tensor Sparse
-
-
-
-
-
-
-
-
-
FP16
37.42 TFLOPS
149.67 TFLOPS Tensor (FP16 Accumulate)
299.34 TFLOPS Tensor (FP16 Accumulate) Sparse
149.67 TFLOPS Tensor (FP32 Accumulate)
299.34 TFLOPS Tensor (FP32 Accumulate) Sparse
FP32
37.42 TFLOPS
-
-
FP64
0.59 TFLOPS
-
BF16
37.42 TFLOPS
149.67 TFLOPS Tensor
299.34 TFLOPS Tensor Sparse
TF32
74.83 TFLOPS Tensor
149.67 TFLOPS Tensor Sparse
INT4
598.67 TOPS Tensor
1197.34 TOPS Tensor Sparse
INT8
-
299.34 TOPS Tensor
598.67 TOPS Tensor Sparse
INT32
18.71 TOPS
Ray Tracing
73.1 TOPS
Pixel Fillrate
194.88 GPixel/s
-
-
Texture Fillrate
584.64 GTexel/s
-
-
L1
64KB/SM Tex
128KB/SM
-
-
L2
6MB Shared
-
-
-
48GB
GDDR6
-
Bus Width
384Bit
Clock
906MHz
Transfer Rate
7.2GT/s
Bandwidth
347.9GB/s
-
-
-
-
-
-
-
-
-
TDP
300W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
3x DisplayPort 1.3
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Max Resolution
7680x4320
Max Resolution Refresh Rate
60Hz
Variable Refresh Rate
G-Sync
FreeSync
-
Display Stream Compression (DSC)
Supported
Multi Monitor Support
3
Content Protection
HDCP 2.3
Model
NVENC 7
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Model
NVDEC 5
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
AV1
-
-
Direct X
12
Direct 3D
12_2
OpenGL
4.6
OpenCL
3.0
Vulkan
1.2
Shader Model
6.6
CUDA
8.6
-
-
PureVideo HD
VP11
VDPAU
Feature Set K
-
-
-
-
Power Connectors
-
-
-
-
1x 8-Pin EPS
-
-
Slots Required
2.0
PCIe Version
4.0
PCIe Lanes
16
Multi GPU Support
Supported
Type
NVLink
Height
112 mm (4.41 in)
Width
267 mm (10.51 in)
Depth
40 mm (1.57 in)
Change Comparison