A website crawler you run from ChatGPT
A website crawler visits the pages of a site the way a search engine bot does and reports what it finds: broken links, redirect chains, missing titles, indexing problems and more. Sitewalk is a crawler you start from ChatGPT. Ask for an audit, and it returns more than 200 checks in 18 groups, worst first, each with a plain fix.
What it does
- Crawls as SitewalkBot: reads robots.txt first and waits at least 1.5 seconds between requests (1 second on Pro for a site you verify).
- Reads each page's HTML as the server sends it, and flags pages that look empty without scripts.
- Returns a health score out of 100, the problems ranked, example addresses, a PDF and CSV, and a link you can send on.
- Keeps watching: ask it to re-audit a site you have audited every month, and it emails you only when something changes.
Limits
- Pages
- 50 an audit without a confirmed email, 500 with one. Pro: up to 3,500 on a site you verify
- Audits
- 5 a month free. Pro: 50 a month, 20,000 pages pooled
- Time
- A small site usually takes a few minutes, a 500-page audit 20 to 60 minutes
- Not covered
- Backlinks, keyword rankings and Search Console data
Questions
What is a website crawler?
A program that follows the links on a site and records each page, the way a search engine bot does.
Is there a free website crawler?
Sitewalk is free for 5 audits a month. Screaming Frog's free version crawls up to 500 URLs.
Will it slow my site down?
It makes one request at a time, at least 1.5 seconds between requests (1 second on Pro for a site you verify), and uses ports 80 and 443 only.
Can I block it?
Yes. Add "User-agent: SitewalkBot" and "Disallow: /" to your robots.txt. Details are on the SitewalkBot page.
Can I crawl a site without installing software?
Yes. Open Sitewalk in ChatGPT and ask for an audit.
Compare: Screaming Frog alternative · Semrush Site Audit alternative · Ahrefs Site Audit alternative · SE Ranking Website Audit alternative · Free Screaming Frog alternatives · Sitewalk for ChatGPT · all tools side by side
Sources: Sitewalk facts from this site; Screaming Frog free limit from screamingfrog.co.uk/seo-spider/pricing/, read 12 November 2026.