All terms
Hardware & Systems
Network Topology
The pattern of how machines and accelerators are wired together in a cluster.
Definition
Network topology is the arrangement of connections linking machines and accelerators in a cluster, describing which devices can talk to which and how directly. Common patterns include fat-tree, ring, and torus layouts. In large-scale AI training, the topology strongly affects how fast the model's working data moves between GPUs, so it is designed carefully to avoid communication bottlenecks during distributed training.