Sitemap URL Extractor
Pull every URL from a site's XML sitemap (including nested indexes).
- $0.005 per page
- 200 free credits
- Maintained by Hyperscrape
For AI agents & developers
AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide
https://hyperscrape.com/api/scrape/sitemap-extractor?url=https%3A%2F%2Fexample.com%2Fsitemap.xmlAbout
Fetches an XML sitemap — or a sitemap index that points at many child
sitemaps — and returns every URL it lists, along with last-modified date,
change frequency and priority when present. Automatically discovers the sitemap
from /robots.txt if you give it a bare domain.
Input
url*string | A sitemap.xml URL, or a domain to auto-discover it from robots.txt. |
maxUrlsinteger | Stop after collecting this many URLs.(default: 1000) |
{
"url": "https://www.apify.com/sitemap.xml",
"maxUrls": 500
}Output fields
loclastmodchangefreqprioritysitemaphostnamepathpathDepthsectionfileExtensionhasQueryimageCountimagessitemapDepthAuthenticated API (optional)
Only for account features — saved datasets, schedules, higher limits. API reference
curl -X POST \
https://hyperscrape.com/api/v1/scrapers/sitemap-extractor/runs?waitForFinish=120 \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{"url":"https://www.apify.com/sitemap.xml","maxUrls":500}'Related scrapers
Google Search Results (SERP)
hyperscrape/google-search-scraper
Scrape organic Google results — title, URL, snippet, sitelinks, PAA and related searches.
On-Page SEO Analyzer
hyperscrape/seo-page-analyzer
Audit any page's title, meta, headings, links and structured data.
Bing Search Scraper
hyperscrape/bing-search-scraper
Scrape Bing organic results: position, title, URL, snippet, deep links and pagination.