NVIDIA GPUs

Specifications

Model

NVIDIA A40

Architecture

Ampere

GPU

GA102

Manufacturing

Samsung 8 nm

Transistors

28,300 million

Die Size

628 mm²

Tensor Cores

336

RT Cores

84

ROPs

112

Base Clock

1.305 MHz

Boost Clock

1.740 MHz

Memory Clock

1.812 MHz

Memory Type

GDDR6

Memory Size

48 GB

Memory Bus

384 Bit

Bandwidth

695.8 GB/s

TDP

300 W

Power Connectors 

8-Pin EPS

Further information can be found here: https://www.nvidia.com/content/PDF/nvidia-ampere-ga-102-gpu-architecture-whitepaper-v2.pdf

 

 

Topology:

There are 2 GPUs per node connected via PCIe 3.0. Each GPU is connected to one CPU NUMA-node. One is connected via PCI 16:00.0 and the other one via PCI af:00.0.