Unverified60% confidenceFactExact time
A crawler program sends HTTP requests to a server via code, and the server returns raw content; however, since the crawler lacks a browser's rendering capability, what it receives is the raw HTML source code of the webpage
2
Sources
60%
Confidence
Long-term
Relevance
7/8/2026
First Seen
Sources
Python Web Scraping for Beginners: How It Works, Core Workflow, and Legal Red Lines Explained
bilibiliPyCharm安装激活教程7/4/2026
Related Claims
UnverifiedTraditional HTTP request-based crawlers (such as Python's requests library) can only retrieve raw HTML returned by the server and cannot execute JavaScript, thus failing to see dynamically loaded content.78% similarUnverifiedWhat a crawler retrieves is only unrendered HTML source code, because crawlers lack the rendering capabilities of a browser.77% similarUnverifiedWhat is captured with requests or curl is only the raw HTML returned by the server, and the JavaScript in the page is not executed, so information such as addresses and phone numbers on modern merchant sites that rely on front-end frameworks cannot be captured by static matching.75% similarUnverifiedAI search crawlers generally do not execute JavaScript or execute only very limited scripts, so what they see is the initial HTML returned by the server; the body text of client-side rendered (CSR) pages may be empty in the crawler's eyes.72% similarUnverifiedAI爬虫（如GPTBot、ClaudeBot、Common Crawl）采用轻量级HTTP请求+HTML解析方式，不为每个页面启动完整浏览器执行JavaScript71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/263849API
curl https://kongchang.com/api/v1/knowledge/claims/263849MCP
get_claim(id=263849)