[KongchangAI]
Conceptnoindex 指令

noindex

An HTML meta tag or HTTP response header directive that instructs search engines not to index a page; it is often used together with robots.txt but requires the page to be crawled in order to take effect.

Timeline (last 90 days)

Oct 17

noindex is a page-level directive provided by search engines that, via the `<meta name="robots" content="noindex">` tag or the HTTP response header `X-Robots-Tag`, tells crawlers they may crawl the page but must not include it in the index.

Unverified50%
Oct 17

noindex differs from robots.txt's Disallow: the former allows crawling but refuses indexing, while the latter blocks crawling.

Unverified50%
Oct 16

The noindex directive is intended to prevent indexing, but a crawler usually has to fetch the resource first in order to read that directive.

Unverified50%

All Facts (3)

Source Articles