NVIDIA GPUs
Specifications
Model | NVIDIA A40 |
Architecture | Ampere |
GPU | GA102 |
Manufacturing | Samsung 8 nm |
Transistors | 28,300 million |
Die Size | 628 mm² |
Tensor Cores | 336 |
RT Cores | 84 |
ROPs | 112 |
Base Clock | 1.305 MHz |
Boost Clock | 1.740 MHz |
Memory Clock | 1.812 MHz |
Memory Type | GDDR6 |
Memory Size | 48 GB |
Memory Bus | 384 Bit |
Bandwidth | 695.8 GB/s |
TDP | 300 W |
Power Connectors | 8-Pin EPS |
Further information can be found here: https://www.nvidia.com/content/PDF/nvidia-ampere-ga-102-gpu-architecture-whitepaper-v2.pdf
Topology:
There are 2 GPUs per node connected via PCIe 3.0. Each GPU is connected to one CPU NUMA-node. One is connected via PCI 16:00.0 and the other one via PCI af:00.0.