GPUs

Intel Gaudi 3 vs NVIDIA Tesla S2070 Full Specs

16,384 Shaders
438MHz
1,792 Shaders
575MHz
128GB HBM2e3.7TB/s
24GB GDDR5576GB/s
··
-
··
4.12 TFLOPS
Form Factor
OAM Module
Form Factor
1U
TDP
900W
TDP
900W

Gaudi 3Gaudi 31.84 PFLOPSFP8-32 Tensor
x445.73
Tesla S2070Tesla S20704.12 TFLOPSFP32 (4x 1.03 TFLOPS)
x1

Clock Speed
··
Clock Speed
··
Peak OPS
1.84 PFLOPSFP8-32 Tensor
Peak OPS
4.12 TFLOPSFP32
Tensor FP8-32
1.84 PFLOPS
-
Tensor FP16-32
459.3 TFLOPS
-
Tensor BF16
1.84 PFLOPS
-
Tensor TF32
459.3 TFLOPS
Tensor TF32
-
FP32
-
Tensor FP32
229.6 TFLOPS
FP32
4.12 TFLOPS
Tensor FP32
-
-
FP64
515.2 GFLOPS
Pixel Rate
-
Pixel Rate
55.2 GPixel/s
Texture Rate
-
Texture Rate
64.4 GTexel/s

Shaders
16,384 Shaders
Shaders
1,792 Shaders
TMUs
-
TMUs
224 TMUs
ROPs
-
ROPs
192 ROPs
Tensor Cores
64 T-Cores
Tensor Cores
-
CUs
8 CUs
SMs
56 SMs

Boost Clock
438MHz
Boost Clock
575MHz
Shader Clock
-
Shader Clock
1.15GHz

L2 Cache
-
L2 Cache
768KB shared

128GB HBM2e
24GB GDDR5
Memory Bus
8192-bit
Memory Bus
384-bit
Memory Speed
3.6GT/s
Memory Speed
3GT/s
Memory Bandwidth
3.7TB/s
Memory Bandwidth
576GB/s
ECC
Yes
ECC
No
ESRAM
96MBSize
12800GB/sBandwidth
ESRAM
-

TDP
900W
TDP
900W

Decoder Model
14x Gaudi
Decoder Model
VP4

Form Factor
OAM Module
Form Factor
1U
Cooling
Passive
Cooling
Passive

Manufacturer
Manufacturer
Chip Designer
Chip Designer
Architecture
Architecture
Family
Family
Branding
Gaudi branding
Branding
Tesla 2007 branding
Codename
Gaudi 3
Codename
NVC0
Chip Variant
-
Chip Variant
GF100-030-A3
Market Segment
Server
Market Segment
Server
Release Date
Apr 9, 2024
Release Date
Jul 25, 2011

Foundry
TSMC
Foundry
TSMC
Fabrication Node
N5
Fabrication Node
40nm
Die Size
-
Die Size
529mm²
Transistor Count
-
Transistor Count
3 Billion
Transistor Density
-
Transistor Density
5.67 MTr/mm²

No images available
No images available