RoCE
A way to run RDMA, the fast memory-to-memory transfer used in AI clusters, over ordinary Ethernet networks.
Also: RDMA over Converged Ethernet
RDMA over Converged Ethernet carries the same direct memory transfers as InfiniBand, but over Ethernet. Its second version, RoCEv2, wraps the traffic in standard internet packets so it can cross routed networks. Because Ethernet loses packets when it is congested, RoCE clusters need careful tuning of flow and congestion control. Meta, Microsoft and many neoclouds run large AI clusters on RoCE, attracted by Ethernet's wide choice of suppliers and familiar tools.