Intel Gaudi 2 vs NVIDIA A100X Full Specs

Summary

6,144 Shaders 550MHz	6,912 Shaders 1.44GHz
96GB HBM2e2.45TB/s	80GB HBM2e2.04TB/s
Peak·FP32·FP16 -	Peak·FP32·FP16 19.91 TFLOPS
Form Factor OAM Module	Form Factor PCIe Card
TDP 600W	TDP 300W
Power Connectors -	Power Connectors 1x 8-Pin EPS

Highlights

Peak OPS

Peak OPS FP32 FP16 Tensor FP8-32 Tensor FP16-16 FP16-16 Tensor Sparse Tensor FP16-32 FP16-32 Tensor Sparse FP64 Tensor FP64 BF16 Tensor BF16 BF16 Tensor Sparse Tensor TF32 Tensor INT8 Tensor INT4 Memory Bandwidth TDP

Gaudi 2865.1 TFLOPSFP8-32 Tensor

x1

A100X2.55 POPSINT4 Tensor Sparse

x2.95

Show Top Score

Theoretical Performance

Clock Speed550MHz UC·Boost·OC	Clock Speed1440MHz UC·Base·Boost·OC
Peak OPS 865.1 TFLOPSFP8-32 Tensor	Peak OPS 2.55 POPSINT4 Tensor Sparse
Tensor FP8-32 865.1 TFLOPS	-
-	Tensor FP16-16 318.5 TFLOPS FP16-16 Tensor Sparse 637 TFLOPS Tensor FP16-32 318.5 TFLOPS FP16-32 Tensor Sparse 637 TFLOPS
BF16 - Tensor BF16 432.5 TFLOPS BF16 Tensor Sparse -	BF16 39.81 TFLOPS Tensor BF16 318.5 TFLOPS BF16 Tensor Sparse 637 TFLOPS
Tensor TF32 -	Tensor TF32 159.3 TFLOPS
-	FP32 19.91 TFLOPS
-	FP64 9.95 TFLOPS Tensor FP64 19.91 TFLOPS
Tensor INT4 -	Tensor INT4 1.27 POPS
-	Tensor INT8 637 TOPS
Pixel Rate -	Pixel Rate 230.4 GPixel/s
Texture Rate -	Texture Rate 622.1 GTexel/s

Core Config

Shaders 6,144 Shaders	Shaders 6,912 Shaders
TMUs -	TMUs 432 TMUs
ROPs -	ROPs 160 ROPs
Tensor Cores 24 T-Cores	Tensor Cores 432 T-Cores
CUs 2 CUs	SMs 108 SMs

Clocks

Base Clock -	Base Clock 795MHz
Boost Clock 550MHz	Boost Clock 1.44GHz

Cache

L2 Cache -

L2 Cache 41MB shared

Memory

96GB HBM2e	80GB HBM2e
Memory Bus 6144-bit	Memory Bus 5120-bit
Memory Speed 3.2GT/s	Memory Speed 3.2GT/s
Memory Bandwidth 2.45TB/s	Memory Bandwidth 2.04TB/s
ECC Yes	ECC -
ESRAM 48MBSize 6400GB/sBandwidth	ESRAM -

Power & Thermals

TDP 600W

TDP 300W

Decoder

Decoder Model 8x Gaudi

Decoder Model 5x NVDEC 4

Card

Form Factor OAM Module	Form Factor PCIe Card
PCIe -	PCIe 2-Slots
-	Height 111 mm (4.37") Width 267 mm (10.51") Depth 40 mm (1.57")
Cooling Passive	Cooling Passive
Power Connectors -	Power Connectors 1x 8-Pin EPS

Chip

Manufacturer Intel	Manufacturer NVIDIA
Chip Designer Intel	Chip Designer NVIDIA
Architecture Gaudi 2	Architecture Ampere
Family Gaudi	Family Server
Branding	Branding
Codename Gaudi 2	Codename NV170
Chip Variant HL-2080	Chip Variant -
Market Segment Server	Market Segment Server
Release Date May 1, 2022	Release Date Jun 28, 2021

Fabrication

Foundry TSMC	Foundry TSMC
Fabrication Node N7	Fabrication Node 7N
Die Size -	Die Size 826mm²
Transistor Count -	Transistor Count 54.2 Billion
Transistor Density -	Transistor Density 65.62 MTr/mm²

Images

No images available

No images available

Competitors

IntelGaudi 2 vs GPU IntelGaudi 3 IntelGaudi 2 vs GPU AMDInstinct MI300P IntelGaudi 2 vs GPU AMDInstinct MI300X Show 5 more

NVIDIAA100X vs GPU AMDInstinct MI300P NVIDIAA100X vs GPU NVIDIARTX PRO 6000 Blackwell Max-Q NVIDIAA100X vs GPU NVIDIAGeForce RTX 5070 Show 12 more