Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 7 Next »

Property

gpu

GPUs

4x NVIDIA A100 TENSOR CORE GPU

Chip

GA100

Transistors

54 Billion

Manufacturing

7 nm

Chip Size

826 mm²

FP32-ALUs

6.912

INT32-ALUs

6.912

SMs

108

Tensor Cores

432

INT4-Performance

1.248 TOPS / 2.496 TOPS*

INT8-Performance

624 TOPS / 1.248 TOPS*

FP16-Performance

312 TFLOPS / 624 TFLOPS*

Bfloat16-Performance

312 TFLOPS / 624 TFLOPS*

FP32-Performance

19,5 TFLOPS

TF32-TensorCore-Performance

156 TFLOPS / 312 TFLOPS*

FP64-Performance

9,7 TFLOPS

FP64-TensorCore-Performance

19,5 TFLOPS

GPU Memory

40 GB

GPU Memory Type

HBM2

Memory Interface

5.120 Bit

Memory

1.555 GB/s

Max Thermal
Design Power (TDP)

400 W

*With sparsity

 Detailed topology produced by lstopo/hwloc-ls command

  • No labels