Sitewalk / Guides / Issue guides / llms.txt
llms.txt: how to check yours, and the 5 problems to fix
llms.txt is a small Markdown file at yoursite.com/llms.txt. It gives AI tools a short guide to your site: what it is, and which pages to read first.
It is a proposal, not a web standard. Nobody can promise which AI tools read it. It costs little to add and it is easy to get wrong, so here is how to check yours.
Does your site have a working llms.txt?
Open https://yoursite.com/llms.txt in a browser.
You should see plain text that starts with a # title line.
If you want the exact answer, run this in a terminal:
curl -I https://yoursite.com/llms.txt
Look for 200 and a content type of text/plain or text/markdown. A text/html type means your server is sending a web page, not the file.
The 5 problems
| What you see | The problem |
|---|---|
| A 404 | No llms.txt. There is no file to read. |
| A web page, often your 404 page or your app | llms.txt returns a web page. The address answers 200, but with HTML. |
| A blank page | llms.txt is empty. |
Text with no # title, or no links | Format problem. |
| A file whose links lead to error pages | Links to broken pages. |
How to fix each one
No llms.txt, empty, or wrong format. Create a plain text file named llms.txt in your site root. This is the format:
# Your site name > One or two lines on what the site is and who it is for. ## Start here - [Pricing](https://yoursite.com/pricing): what each plan includes - [Docs](https://yoursite.com/docs): how to set it up ## Optional - [Blog](https://yoursite.com/blog): longer guides
Only the title line is required. The "Optional" section is for pages an AI tool can skip when it is short of space. Keep the file short and list your best pages, not every page.
Returns a web page. Your server is answering the address with HTML. Upload a real file, or make the address return a proper 404 if you do not want one. The usual cause is a catch-all rule that sends unknown addresses to your 404 page or your app. Add an exception for /llms.txt.
Links to broken pages. Open each link in the file. Fix the address or remove the line.
On WordPress. Yoast SEO and Rank Math both have an llms.txt feature. Turn it on in the plugin and preview the file before you publish it. Check that the pages it picks are the ones you want read first.
Check that it worked
Open /llms.txt again, and run the curl check. Then run an audit and compare.
What Sitewalk found on real sites
We counted the latest audit of each site that Sitewalk audited since the llms.txt checks went live on 4 Nov 2026. Of 54 sites:
- 27 (50%) had no llms.txt.
- 4 had a format problem.
- 3 returned a web page instead of the file.
- 0 had an empty file, and 0 had broken links in it.
It is a small group of early users, so read it as a first look, not a survey.
Check your whole site in one sentence
Sitewalk checks llms.txt along with AI crawler rules and 200+ other technical SEO checks. In ChatGPT, say:
Audit yoursite.com for technical SEO problems
Checked on 16 Nov 2026.