Efficient Direct-Connect Topologies for Collective Communications

Understand

We consider the problem of distilling efficient network topologies for collective communications.

• We provide an algorithmic framework for constructing direct-connect topologies optimized for the latency vs.
• bandwidth trade-off associated with the workload.
• Our approach synthesizes many different topologies and schedules for a given cluster size and degree and then identifies the appropriate topology and schedule for a given workload.