Unverified50% confidenceFactExact time
Common Crawl contains approximately 250 billion pages, with a data volume of about 1PB.
1
Sources
50%
Confidence
Long-term
Relevance
10/17/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe Q2D-Web dataset contains a corpus of 190 million (190M) web documents.71% similarUnverified整个互联网可抓取的公开网页数据（Common Crawl）约400TB71% similarUnverifiedThe FineWeb public dataset contains approximately 44 TB of text data, equivalent to approximately 15 trillion tokens.71% similarUnverifiedCommon Crawl is a nonprofit project that has been operating since 2008 and, as of 2024, has accumulated archives of more than 250 billion web pages stored in WARC format on AWS S3.70% similarUnverifiedCommon Crawl项目存储了超过2500亿网页的完整HTML快照，压缩后数据量达PB级别，是许多AI模型的主要训练数据来源之一70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1050998API
curl https://kongchang.com/api/v1/knowledge/claims/1050998MCP
get_claim(id=1050998)