Unverified70% confidenceFactTime unknown
GPU interconnect bandwidth within data centers is typically on the order of 100–400 Gbps (via InfiniBand HDR/NDR or NVSwitch), while wide-area network bandwidth between data centers may be only 1–10 Gbps.
2
Sources
70%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedGPUs transmit gradient data via InfiniBand or RoCE protocols, with bandwidth reaching 400 Gbps per card or higher.80% similarUnverifiedSwapping KV cache in and out depends on the interconnect bandwidth between host memory and GPU VRAM; taking PCIe 4.0 x16 as an example, the one-way effective bandwidth is on the order of about 25 GB/s, while the HBM bandwidth of a single data center GPU can reach 2–3 TB/s, a difference of about two orders of magnitude.76% similarUnverifiedGPU video memory (VRAM) bandwidth is typically on the order of 500–1,000 GB/s, whereas DDR5 system memory bandwidth is only approximately 50–80 GB/s, a difference of more than 10x.76% similarUnverifiedIn thousand-GPU-scale clusters, InfiniBand networks provide 400 Gbps of cross-node bandwidth.76% similarVerifiedIn the H100 NVLink architecture, 8 GPUs within a single server can be fully interconnected via NVSwitch, achieving a total bandwidth of 900 GB/s, an order-of-magnitude improvement over PCIe 5.0's 64 GB/s.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/22916API
curl https://kongchang.com/api/v1/knowledge/claims/22916MCP
get_claim(id=22916)