sitemap.xml
An XML-format file located in a website's root directory that lists the URLs of all pages on the site for search engine crawlers to discover and index. It is a foundational element of traditional SEO infrastructure.
Core Facts
A sitemap is a list of URLs for search engines, usually provided in XML format; it solves page discovery but does not describe the purpose or priority of the links.
robots.txt is a plain text file placed in the root directory of a website that follows the Robots Exclusion Standard and is used to declare to crawlers which paths are allowed to be accessed.
llms.txt has a different positioning from robots.txt (which controls crawler access permissions) and sitemap.xml (which lists URLs); its goal is to let models quickly understand a site's structure and core content.
Timeline (last 90 days)
Do not directly copy and paste sitemap.xml as llms.txt; the two have different design goals: the former is designed for crawlers but is not suitable for models to quickly understand the site.
llms.txt has a different positioning from robots.txt (which controls crawler access permissions) and sitemap.xml (which lists URLs); its goal is to let models quickly understand a site's structure and core content.
A sitemap is a list of URLs for search engines, usually provided in XML format; it solves page discovery but does not describe the purpose or priority of the links.
robots.txt is a plain text file placed in the root directory of a website that follows the Robots Exclusion Standard and is used to declare to crawlers which paths are allowed to be accessed.
robots.txt 和 sitemap.xml 作为网站向机器暴露元信息的早期实践，可被视为 WebMCP 的精神前身
All Facts (5)
A sitemap is a list of URLs for search engines, usually provided in XML format; it solves page discovery but does not describe the purpose or priority of the links.
65%Verifiedrobots.txt is a plain text file placed in the root directory of a website that follows the Robots Exclusion Standard and is used to declare to crawlers which paths are allowed to be accessed.
65%Partially Verifiedllms.txt has a different positioning from robots.txt (which controls crawler access permissions) and sitemap.xml (which lists URLs); its goal is to let models quickly understand a site's structure and core content.
65%UnverifiedDo not directly copy and paste sitemap.xml as llms.txt; the two have different design goals: the former is designed for crawlers but is not suitable for models to quickly understand the site.
50%Unverifiedrobots.txt 和 sitemap.xml 作为网站向机器暴露元信息的早期实践，可被视为 WebMCP 的精神前身
50%