Intel Gaudi 2 vs NVIDIA A800 Full Specs

Summary

6,144 Shaders 550MHz	6,912 Shaders 1.41GHz
96GB HBM2e2.45TB/s	80GB HBM2e1.94TB/s
Peak·FP32·FP16 -	Peak·FP32·FP16 19.49 TFLOPS
Form Factor OAM Module	Form Factor PCIe Card
TDP 600W	TDP 250W
Power Connectors -	Power Connectors 1x 8-Pin EPS

Highlights

Peak OPS

Peak OPS FP32 FP16 Tensor FP8-32 Tensor FP16-16 FP16-16 Tensor Sparse Tensor FP16-32 FP16-32 Tensor Sparse FP64 Tensor FP64 BF16 Tensor BF16 BF16 Tensor Sparse Tensor TF32 Tensor INT8 Tensor INT4 Memory Bandwidth TDP

Gaudi 2865.1 TFLOPSFP8-32 Tensor

x1

A8002.5 POPSINT4 Tensor Sparse

x2.88

Show Top Score

Theoretical Performance

Clock Speed550MHz UC·Boost·OC	Clock Speed1410MHz UC·Base·Boost·OC
Peak OPS 865.1 TFLOPSFP8-32 Tensor	Peak OPS 2.5 POPSINT4 Tensor Sparse
Tensor FP8-32 865.1 TFLOPS	-
-	Tensor FP16-16 311.9 TFLOPS FP16-16 Tensor Sparse 623.7 TFLOPS Tensor FP16-32 311.9 TFLOPS FP16-32 Tensor Sparse 623.7 TFLOPS
BF16 - Tensor BF16 432.5 TFLOPS BF16 Tensor Sparse -	BF16 38.98 TFLOPS Tensor BF16 311.9 TFLOPS BF16 Tensor Sparse 623.7 TFLOPS
Tensor TF32 -	Tensor TF32 155.9 TFLOPS
-	FP32 19.49 TFLOPS
-	FP64 9.75 TFLOPS Tensor FP64 19.49 TFLOPS
Tensor INT4 -	Tensor INT4 1.25 POPS
-	Tensor INT8 623.7 TOPS
Pixel Rate -	Pixel Rate 225.6 GPixel/s
Texture Rate -	Texture Rate 609.1 GTexel/s

Core Config

Shaders 6,144 Shaders	Shaders 6,912 Shaders
TMUs -	TMUs 432 TMUs
ROPs -	ROPs 160 ROPs
Tensor Cores 24 T-Cores	Tensor Cores 432 T-Cores
CUs 2 CUs	SMs 108 SMs

Clocks

Base Clock -	Base Clock 765MHz
Boost Clock 550MHz	Boost Clock 1.41GHz

Cache

L2 Cache -

L2 Cache 41MB shared

Memory

96GB HBM2e	80GB HBM2e
Memory Bus 6144-bit	Memory Bus 5120-bit
Memory Speed 3.2GT/s	Memory Speed 3GT/s
Memory Bandwidth 2.45TB/s	Memory Bandwidth 1.94TB/s
ECC Yes	ECC -
ESRAM 48MBSize 6400GB/sBandwidth	ESRAM -

Power & Thermals

TDP 600W

TDP 250W

Decoder

Decoder Model 8x Gaudi

Decoder Model 5x NVDEC 4

Card

Form Factor OAM Module	Form Factor PCIe Card
PCIe -	PCIe 2-Slots
-	Height 111 mm (4.37") Width 267 mm (10.51") Depth 40 mm (1.57")
Cooling Passive	Cooling Passive
Power Connectors -	Power Connectors 1x 8-Pin EPS

Chip

Manufacturer Intel	Manufacturer NVIDIA
Chip Designer Intel	Chip Designer NVIDIA
Architecture Gaudi 2	Architecture Ampere
Family Gaudi	Family Server
Branding	Branding
Codename Gaudi 2	Codename NV170
Chip Variant HL-2080	Chip Variant -
Market Segment Server	Market Segment Server
Release Date May 1, 2022	Release Date Jun 28, 2021

Fabrication

Foundry TSMC	Foundry TSMC
Fabrication Node N7	Fabrication Node 7N
Die Size -	Die Size 826mm²
Transistor Count -	Transistor Count 54.2 Billion
Transistor Density -	Transistor Density 65.62 MTr/mm²

Images

No images available

No images available

Competitors

IntelGaudi 2 vs GPU IntelGaudi 3 IntelGaudi 2 vs GPU AMDInstinct MI300P IntelGaudi 2 vs GPU AMDInstinct MI300X Show 5 more

NVIDIAA800 vs GPU AMDInstinct MI300P NVIDIAA800 vs GPU NVIDIARTX PRO 6000 Blackwell Max-Q NVIDIAA800 vs GPU NVIDIAGeForce RTX 5070 Show 12 more