llms.txt: The robots.txt for AI Crawlers

Just as robots.txt guides search crawlers, llms.txt helps LLMs find your most important content efficiently.

What is llms.txt?

A plain-text file at your domain root listing key pages, their descriptions, and optional guidance for AI systems consuming your content.

Why it matters

AI crawlers have limited context windows. llms.txt points them to citation-ready pages — FAQs, product sheets, comparison guides — instead of navigation clutter.

How to implement

1. Create /llms.txt at your site root
2. List your most important URLs with descriptions
3. Include your brand summary and contact page
4. Reference it in your Organization schema

See our own llms.txt as an example. Pair with schema markup for maximum effect.