Unverified50% confidenceFactExact time
Rack-scale systems keep cross-card communication at low latency through unified high-speed interconnects (such as NVLink) and shared memory pools, thereby supporting real-time inference of large models.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTensor parallelism splits the weight matrix of the same layer and places it across multiple machines, requiring one All-Reduce communication per layer computed, is extremely sensitive to bandwidth and latency, and is usually only practical under high-speed interconnects such as NVLink.77% similarUnverifiedCompared to PCIe, NVLink provides higher bidirectional bandwidth and lower latency.73% similarUnverifiedNVMe is a communication protocol designed specifically for flash storage that communicates directly with the CPU via the PCIe bus, with latency as low as the microsecond level.73% similarUnverifiedParallel topology should match the hardware communication structure, constraining high-frequency communication within groups rather than having all GPUs participate in global synchronization.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1039041API
curl https://kongchang.com/api/v1/knowledge/claims/1039041MCP
get_claim(id=1039041)