Unverified50% confidenceFactExact time
The 8-GPU configuration of the HGX H200 interconnects 8 H200 GPUs with high bandwidth via NVLink and NVSwitch, with a total VRAM of up to 1.1 TB (HBM3e).
1
Sources
50%
Confidence
Long-term
Relevance
9/25/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedIn the H100 NVLink architecture, 8 GPUs within a single server can be fully interconnected via NVSwitch, achieving a total bandwidth of 900 GB/s, an order-of-magnitude improvement over PCIe 5.0's 64 GB/s.79% similarUnverifiedNVIDIA's H100 is equipped with 80 GB HBM3, delivers memory bandwidth of 3.35 TB/s, and NVLink 4.0 provides 900 GB/s bidirectional bandwidth.75% similarUnverifiedGPU HBM bandwidth is typically on the order of 2–3 TB/s (3.35 TB/s for H100), while the effective bandwidth of Host DRAM connected via PCIe 5.0 is only about 64 GB/s—a difference of nearly 50x.74% similarVerifiedThe HBM memory bandwidth of the NVIDIA H100 is approximately 3.35 TB/s, and its utilization rate in autoregressive generation tasks is often below 10%.74% similarUnverified被管制的NVIDIA芯片配备80GB HBM2e内存，内存带宽达2TB/s，NVLink互联带宽达600GB/s74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/951085API
curl https://kongchang.com/api/v1/knowledge/claims/951085MCP
get_claim(id=951085)