NVIDIA V100 FHHL vs NVIDIA GRID RTX T10-8

NVIDIA V100 FHHL
NVIDIA GRID RTX T10-8
5120 Shaders
16GB HBM2
1290MHz
4608 Shaders
8GB GDDR6
1065MHz
Peak AI Performance
105.68 TFLOPS
FP16 Tensor (FP16 Accumulate)
Peak AI Performance
314.08 TOPS
INT8 Tensor
FP32
13.21 TFLOPS
FP32
9.82 TFLOPS
FP16
26.42 TFLOPS
FP16
19.63 TFLOPS
Form Factor
PCIe Card
1.0-Slots
Form Factor
PCIe Card
2.0-Slots
TDP
250W
TDP
260W
Power Connectors
-
1x 8-Pin
Power Connectors
1x 6-Pin
1x 8-Pin

Peak AI Performance

  • 66% slower vs GRID RTX T10-8
  • 2.97x faster vs V100 FHHL
V100 FHHL - 105.68 TFLOPS FP16 Tensor (FP16 Accumulate)
x1
GRID RTX T10-8 - 314.08 TOPS INT8 Tensor
x2.97

FP32

  • 35% faster vs GRID RTX T10-8
  • 26% slower vs V100 FHHL
V100 FHHL - 13.21 TFLOPS FP32
x1.35
GRID RTX T10-8 - 9.82 TFLOPS FP32
x1

FP16

  • 35% faster vs GRID RTX T10-8
  • 26% slower vs V100 FHHL
V100 FHHL - 26.42 TFLOPS FP16
x1.35
GRID RTX T10-8 - 19.63 TFLOPS FP16
x1
  • 23% faster vs GRID RTX T10-8
  • 19% slower vs V100 FHHL
V100 FHHL - 829.4GB/s
x1.23
GRID RTX T10-8 - 672GB/s
x1
  • 4% lower vs GRID RTX T10-8
  • 4% higher vs V100 FHHL
V100 FHHL - 250W
x1
GRID RTX T10-8 - 260W
x1.04
Manufacturer
NVIDIA
Manufacturer
NVIDIA
Chip Designer
NVIDIA
Chip Designer
NVIDIA
Architecture
Volta
Architecture
Turing
Family
Server
Family
GRID
Codename
NV140
GV100
Codename
NV162
TU102
Market Segment
Server
Market Segment
Server
Release Date
3/27/2018
Release Date
1/1/2020
Foundry
TSMC
Foundry
TSMC
Fabrication Node
12FFN
Fabrication Node
12FFN
Die Size
815 mm²
Die Size
754 mm²
Transistor Count
21.1 Billion
Transistor Count
18.6 Billion
Transistor Density
25.89M/mm²
Transistor Density
24.67M/mm²
Form
PCIe Card
Form
PCIe Card
Shading Units
5120 Shaders
Shading Units
4608 Shaders
Texture Mapping Units
320 TMUs
Texture Mapping Units
288 TMUs
Render Output Units
128 ROPs
Render Output Units
96 ROPs
Tensor Cores
640 T-Cores
Tensor Cores
576 T-Cores
-
-
Ray-Tracing Cores
72 RT-Cores
Streaming Multiprocessors
80 SMs
Streaming Multiprocessors
72 SMs
Graphics Processing Clusters
6 GPCs
-
-
937MHz Base
1290MHz
-
1065MHz
Peak AI Performance
105.68 TFLOPS
FP16 Tensor (FP16 Accumulate)
Peak AI Performance
314.08 TOPS
INT8 Tensor
FP16
26.42 TFLOPS
105.68 TFLOPS Tensor (FP16 Accumulate)
-
FP16
19.63 TFLOPS
-
78.52 TFLOPS Tensor (FP32 Accumulate)
FP32
13.21 TFLOPS
-
FP32
9.82 TFLOPS
78.52 TFLOPS Tensor
FP64
6.61 TFLOPS
-
FP64
310 GFLOPS
78.52 TFLOPS Tensor
-
-
BF16
157.04 TFLOPS Tensor
INT8
52.84 TOPS
-
INT8
-
314.08 TOPS Tensor
INT32
13.21 TOPS
-
-
-
-
Ray Tracing
38.3 TOPS
Pixel Fillrate
165.12 GPixel/s
Pixel Fillrate
102.24 GPixel/s
Texture Fillrate
412.8 GTexel/s
Texture Fillrate
306.72 GTexel/s
L1
-
128KB/SM
L1
32KB/SM Tex
64KB/SM
L2
6MB Shared
L2
6MB Shared
16GB
HBM2
8GB
GDDR6
Bus Width
4096Bit
Bus Width
384Bit
Clock
810MHz
Transfer Rate
1.6GT/s
Bandwidth
829.4GB/s
Clock
1750MHz
Transfer Rate
14GT/s
Bandwidth
672GB/s
TDP
250W
TDP
260W
Max Resolution
Unknown
Max Resolution
Unknown
Variable Refresh Rate
G-Sync
FreeSync
Variable Refresh Rate
G-Sync
FreeSync
Display Stream Compression (DSC)
Not Supported
Display Stream Compression (DSC)
Not Supported
Multi Monitor Support
Unknown
Multi Monitor Support
Unknown
Model
3x NVENC 5
Model
NVENC 7
Codec
AVC (H.264)
HEVC (H.265)
Codec
AVC (H.264)
HEVC (H.265)
Model
NVDEC 3
Model
NVDEC 4
Codec
MPEG-1
MPEG-2
MPEG-4
VC-1
-
VP9
AVC (H.264)
HEVC (H.265)
Codec
MPEG-1
MPEG-2
MPEG-4
VC-1
VP8
VP9
AVC (H.264)
HEVC (H.265)
Direct X
12
Direct 3D
12_1
Direct X
12
Direct 3D
12_2
OpenGL
4.6
OpenCL
3.0
-
-
OpenGL
4.6
OpenCL
3.0
Vulkan
1.2
Shader Model
6.7
CUDA
7.0
PureVideo HD
VP9
VDPAU
Feature Set I
Shader Model
6.6
CUDA
7.5
PureVideo HD
VP10
VDPAU
Feature Set J
Power Connectors
-
1x 8-Pin
Power Connectors
1x 6-Pin
1x 8-Pin
Slots Required
1.0
PCIe Version
3.0
PCIe Lanes
16
Slots Required
2.0
PCIe Version
3.0
PCIe Lanes
16
Multi GPU Support
Supported
Type
NVLink
-
-
-
-
Height
111 mm (4.37 in)
Width
168 mm (6.61 in)
Depth
20 mm (0.79 in)
Height
111 mm (4.37 in)
Width
267 mm (10.51 in)
Depth
40 mm (1.57 in)
Change Comparison