Sitewalk / Guides / Issue guides / llms.txt

llms.txt: how to check yours, and the 5 problems to fix

llms.txt is a small Markdown file at yoursite.com/llms.txt. It gives AI tools a short guide to your site: what it is, and which pages to read first.

It is a proposal, not a web standard. Nobody can promise which AI tools read it. It costs little to add and it is easy to get wrong, so here is how to check yours.

Does your site have a working llms.txt?

Open https://yoursite.com/llms.txt in a browser.

You should see plain text that starts with a # title line.

If you want the exact answer, run this in a terminal:

curl -I https://yoursite.com/llms.txt

Look for 200 and a content type of text/plain or text/markdown. A text/html type means your server is sending a web page, not the file.

The 5 problems

What you seeThe problem
A 404No llms.txt. There is no file to read.
A web page, often your 404 page or your appllms.txt returns a web page. The address answers 200, but with HTML.
A blank pagellms.txt is empty.
Text with no # title, or no linksFormat problem.
A file whose links lead to error pagesLinks to broken pages.

How to fix each one

No llms.txt, empty, or wrong format. Create a plain text file named llms.txt in your site root. This is the format:

# Your site name

> One or two lines on what the site is and who it is for.

## Start here

- [Pricing](https://yoursite.com/pricing): what each plan includes
- [Docs](https://yoursite.com/docs): how to set it up

## Optional

- [Blog](https://yoursite.com/blog): longer guides

Only the title line is required. The "Optional" section is for pages an AI tool can skip when it is short of space. Keep the file short and list your best pages, not every page.

Returns a web page. Your server is answering the address with HTML. Upload a real file, or make the address return a proper 404 if you do not want one. The usual cause is a catch-all rule that sends unknown addresses to your 404 page or your app. Add an exception for /llms.txt.

Links to broken pages. Open each link in the file. Fix the address or remove the line.

On WordPress. Yoast SEO and Rank Math both have an llms.txt feature. Turn it on in the plugin and preview the file before you publish it. Check that the pages it picks are the ones you want read first.

Check that it worked

Open /llms.txt again, and run the curl check. Then run an audit and compare.

What Sitewalk found on real sites

We counted the latest audit of each site that Sitewalk audited since the llms.txt checks went live on 4 Nov 2026. Of 54 sites:

It is a small group of early users, so read it as a first look, not a survey.

Check your whole site in one sentence

Sitewalk checks llms.txt along with AI crawler rules and 200+ other technical SEO checks. In ChatGPT, say:

Audit yoursite.com for technical SEO problems

Get started

Checked on 16 Nov 2026.

More guides

All issue guides ยท All guides