Specifications

Model	NVIDIA A40
Architecture	Ampere
GPU	GA102
Manufacturing	Samsung 8 nm
Transistors	28,300 million
Die Size	628 mm²
Tensor Cores	336
RT Cores	84
ROPs	112
Base Clock	1.305 MHz
Boost Clock	1.740 MHz
Memory Clock	1.812 MHz
Memory Type	GDDR6
Memory Size	48 GB
Memory Bus	384 Bit
Bandwidth	695.8 GB/s
TDP	300 W
Power Connectors	8-Pin EPS

Further information can be found here: https://www.nvidia.com/content/PDF/nvidia-ampere-ga-102-gpu-architecture-whitepaper-v2.pdf

Topology:

There are 2 GPUs per node connected via PCIe 3.0. Each GPU is connected to one CPU NUMA-node. One is connected via PCI 16:00.0 and the other one via PCI af:00.0.

PC2-Documentation

NVIDIA GPUs

Specifications

Further information can be found here: https://www.nvidia.com/content/PDF/nvidia-ampere-ga-102-gpu-architecture-whitepaper-v2.pdf

Topology:

Related content