Find every URL a website has shipped
even the ones their sitemap.xml hides.
What you get
Structured, exportable, AI-ready.
Every public URL
Recursive resolution through robots.txt + nested sitemap indexes.
Lastmod + priority
Every URL preserves the publishing metadata the site declares.
Hidden sitemaps
15+ fallback paths probed: wp-sitemap, sitemap_index, .gz files, more.
Direct deep linking
Click any URL to run SEO, Clone or single-page Fetch in one click.
Export-ready
Backend exposes JSON via /api/sitemap for scripts and pipelines.
No signup
Public utility — no account needed for the discovery step.
Common questions
What is a sitemap, and why scrape it?+
A sitemap is the list of URLs a site officially exposes for search engines. Scraping it gives you the complete map of a competitor’s content — every blog post, product page, doc — without having to crawl the whole site.
Will this find URLs that aren’t in the official sitemap?+
We probe robots.txt and 15+ fallback paths, follow nested sitemap indexes up to 4 levels deep, and decompress .gz. We catch URLs many basic sitemap tools miss, but URLs the site never publishes anywhere remain invisible.
Can I export the URL list?+
Yes. After listing, each URL has a one-click Fetch button to pull its full content into the workspace; the whole list is also available via the API as JSON.