NVIDIA A30 vs NVIDIA A40

NVIDIA A30
NVIDIA A40
3584 Shaders
24GB HBM2
1440MHz
10752 Shaders
48GB GDDR6
1740MHz
Peak AI Performance
1.32 POPS
INT4 Tensor Sparse
Peak AI Performance
1.2 POPS
INT4 Tensor Sparse
FP32
10.32 TFLOPS
FP32
37.42 TFLOPS
FP16
41.29 TFLOPS
FP16
37.42 TFLOPS
Form Factor
PCIe Card
2.0-Slots
Form Factor
PCIe Card
2.0-Slots
TDP
165W
TDP
300W
-
-
-
-
-
Power Connectors
-
-
-
-
GB6 Metal N/A
0%
GB6 Metal N/A
0%
GB6 Vulkan N/A
0%
GB5 OpenCL N/A
0%
GB5 OpenCL N/A
0%
GB5 CUDA N/A
0%
GB5 CUDA N/A
0%
GB5 Metal N/A
0%
GB5 Metal N/A
0%
GB5 Vulkan N/A
0%
GB5 Vulkan N/A
0%
OCT 2020.1 N/A
0%
OCT 2020.1 N/A
0%
OCT Metal N/A
0%
OCT Metal N/A
0%
Peak AI Performance
1.32 POPS
INT4 Tensor Sparse
Peak AI Performance
1.2 POPS
INT4 Tensor Sparse
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
FP16
41.29 TFLOPS
165.15 TFLOPS Tensor (FP16 Accumulate)
330.3 TFLOPS Tensor (FP16 Accumulate) Sparse
165.15 TFLOPS Tensor (FP32 Accumulate)
330.3 TFLOPS Tensor (FP32 Accumulate) Sparse
FP16
37.42 TFLOPS
149.67 TFLOPS Tensor (FP16 Accumulate)
299.34 TFLOPS Tensor (FP16 Accumulate) Sparse
149.67 TFLOPS Tensor (FP32 Accumulate)
299.34 TFLOPS Tensor (FP32 Accumulate) Sparse
FP32
10.32 TFLOPS
-
-
FP32
37.42 TFLOPS
-
-
FP64
5.16 TFLOPS
10.32 TFLOPS Tensor
FP64
590 GFLOPS
-
BF16
20.64 TFLOPS
165.15 TFLOPS Tensor
330.3 TFLOPS Tensor Sparse
BF16
37.42 TFLOPS
149.67 TFLOPS Tensor
299.34 TFLOPS Tensor Sparse
TF32
82.58 TFLOPS Tensor
165.15 TFLOPS Tensor Sparse
TF32
74.83 TFLOPS Tensor
149.67 TFLOPS Tensor Sparse
INT4
660.6 TOPS Tensor
1.32 POPS Tensor Sparse
INT4
598.67 TOPS Tensor
1.2 POPS Tensor Sparse
INT8
-
330.3 TOPS Tensor
660.6 TOPS Tensor Sparse
INT8
-
299.34 TOPS Tensor
598.67 TOPS Tensor Sparse
INT32
10.32 TOPS
INT32
18.71 TOPS
-
-
Ray Tracing
73.1 TOPS
Pixel Fillrate
138.24 GPixel/s
Pixel Fillrate
194.88 GPixel/s
-
-
-
-
Texture Fillrate
322.56 GTexel/s
Texture Fillrate
584.64 GTexel/s
Manufacturer
NVIDIA
Manufacturer
NVIDIA
Chip Designer
NVIDIA
Chip Designer
NVIDIA
Architecture
Ampere
Architecture
Ampere
Family
Server
Family
Server
Codename
NV170
GA100
-
-
Codename
NV172
GA102
Variant
GA102-895-A1
Market Segment
Server
Market Segment
Server
Release Date
4/12/2021
Release Date
10/5/2020
Foundry
TSMC
-
Foundry
Samsung
-
Fabrication Node
7N
-
Fabrication Node
8N
-
Die Size
826 mm²
-
Die Size
628 mm²
-
Transistor Count
54.2 Billion
-
Transistor Count
28.3 Billion
-
Transistor Density
65.62M/mm²
-
Transistor Density
45.04M/mm²
-
Form
PCIe Card
Form
PCIe Card
Shading Units
3584 Shaders
-
Shading Units
10752 Shaders
-
Texture Mapping Units
224 TMUs
Texture Mapping Units
336 TMUs
Render Output Units
96 ROPs
Render Output Units
112 ROPs
Tensor Cores
224 T-Cores
Tensor Cores
336 T-Cores
-
-
Ray-Tracing Cores
84 RT-Cores
Streaming Multiprocessors
56 SMs
Streaming Multiprocessors
84 SMs
-
-
-
-
-
-
-
-
-
-
-
-
-
-
930MHz Base
1440MHz
-
-
1305MHz Base
1740MHz
-
-
-
-
L1
64KB/SM Tex
192KB/SM
-
-
L1
64KB/SM Tex
128KB/SM
-
-
L2
24MB Shared
L2
6MB Shared
-
-
-
-
-
-
24GB
HBM2
-
48GB
GDDR6
-
Bus Width
3072Bit
Bus Width
384Bit
Clock
1215MHz
Transfer Rate
2.4GT/s
Bandwidth
933.1GB/s
Clock
906MHz
Transfer Rate
7.2GT/s
Bandwidth
347.9GB/s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
TDP
165W
TDP
300W
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
No Ports
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
3x DisplayPort 1.3
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Max Resolution
Unknown
Max Resolution
7680x4320
Max Resolution Refresh Rate
-
Max Resolution Refresh Rate
60Hz
Variable Refresh Rate
G-Sync
FreeSync
-
Variable Refresh Rate
G-Sync
FreeSync
-
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Supported
Multi Monitor Support
Unknown
Multi Monitor Support
3
-
-
Content Protection
HDCP 2.3
No Encoders
-
Model
NVENC 7
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Codec
-
-
-
-
-
-
-
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Model
5x NVDEC 4
Model
NVDEC 5
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
-
-
-
Codec
MPEG-1
MPEG-2
MPEG-4
-
VC-1
VP8
VP9
-
AVC (H.264)
HEVC (H.265)
-
AV1
-
-
-
-
-
-
Direct X
12
Direct 3D
12_2
-
-
OpenCL
3.0
Vulkan
1.2
OpenGL
4.6
OpenCL
3.0
Vulkan
1.2
-
-
CUDA
8.0
-
-
PureVideo HD
VP10
VDPAU
Feature Set J
Shader Model
6.6
CUDA
8.6
-
-
PureVideo HD
VP11
VDPAU
Feature Set K
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Power Connectors
-
-
-
-
1x 8-Pin EPS
-
-
Slots Required
2.0
PCIe Version
4.0
PCIe Lanes
16
Slots Required
2.0
PCIe Version
4.0
PCIe Lanes
16
Multi GPU Support
Supported
Type
NVLink
Multi GPU Support
Supported
Type
NVLink
Height
111 mm (4.37 in)
Width
267 mm (10.51 in)
Depth
40 mm (1.57 in)
Height
112 mm (4.41 in)
Width
267 mm (10.51 in)
Depth
40 mm (1.57 in)
Change Comparison