Verify if websites are AI-ready with the llms.txt standard
llms.txt is a proposed standard that helps AI assistants and LLMs understand website content. Similar to robots.txt for search engines, it provides structured information about a site. Learn more at llmstxt.org
llms.txt is a proposed standard that helps AI assistants understand website content. It's a markdown file placed at the root of your website (/llms.txt) that provides structured, LLM-friendly information about your site, similar to how robots.txt helps search engines.
As AI assistants become primary discovery tools, llms.txt ensures they can accurately represent your content to users. It helps LLMs provide better answers by offering curated, expert-level information in a format optimized for their limited context windows.
Create a markdown file named llms.txt in your website's root directory. Start with an H1 heading (your site name), add a blockquote summary, then use H2 sections to organize links to detailed content. Keep it concise and clear, avoiding jargon. Visit llmstxt.org for the complete specification.
llms.txt is a concise file with your site overview and links to detailed resources. llms-full.txt contains expanded content by combining llms.txt with all linked markdown files - it's what LLMs actually process. Our checker verifies both to ensure proper implementation.
Common issues: the file must be at your domain root (example.com/llms.txt, not /docs/llms.txt), it must be publicly accessible (check server permissions), and it should use .txt extension. Also verify there are no robots.txt rules blocking access to the file.
Yes! Enter any domain to check if it has implemented the llms.txt standard. This is useful for verifying your own implementation, checking competitors, or discovering well-structured AI-ready websites to use as examples.
llms.txt is currently a proposed standard, not an official specification. However, it's gaining adoption across the web development community as a practical solution for making websites more AI-friendly. The standard is actively being refined based on real-world usage.