What is an LLMs.txt?
📌 TL;DR
llms.txt and llms-full.txt are optional files you can place on your website to help Large Language Models (LLMs) like ChatGPT, Claude, Gemini, and Perplexity understand your content better.
They’re not required, but they give you more control over:
-
What content gets read by AI tools
-
What content should be ignored
-
How your content is summarized or used in AI answers
🧠 Why These Files Exist?
Search engines have had robots.txt for years to tell crawlers what to index.
Now, with AI tools reading websites to answer user questions, we need a similar system for LLMs.
That’s where:
- llms.txt = A summary or map of your most important content
- llms-full.txt = A full version of your core content in Markdown format
…come in.
These files help LLMs:
-
Find what matters (e.g., your docs, FAQs, pricing page)
-
Skip what doesn’t (e.g., cookie banners, headers, footers)
-
Possibly answer better when users ask questions about your site
📁 Where to Put Them
You should place these two files in your website’s root folder:
https://yourdomain.com/llms.txt
https://yourdomain.com/llms-full.txt
📝 What Goes in llms.txt?
It’s a simple Markdown file with:
-
A title
-
A short summary (in a quote)
-
Section headers (
##) -
Lists of important links
✅ Example llms.txt
# MyProduct Docs
> Official documentation and help for using MyProduct.
## Getting Started
- [Quick Start Guide](https://myproduct.com/docs/quick-start)
- [Installation](https://myproduct.com/docs/install)
## API Reference
- [API Overview](https://myproduct.com/docs/api)
- [Authentication](https://myproduct.com/docs/auth)
## Optional
- [Legacy Docs](https://myproduct.com/docs/legacy)
🟡 Tip: You can include an "Optional" section at the bottom — LLMs may skip these if space is limited.
📚 What Goes in llms-full.txt?
This is an optional file that includes everything you want an AI to read—all your key documentation in one file, written in Markdown.
You can think of it as:
-
A “one-stop shop” for AI tools
-
A way to reduce the need for LLMs to crawl 20+ pages