FAQ Extractor

Pull every question & answer pair from any page — schema.org FAQPage plus smart heuristics.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/faq-extractor-scraper?urls=https%3A%2F%2Fexample.com%2Ffaq

About

Extracts FAQ question/answer pairs from web pages using two complementary strategies, in priority order:

JSON-LD structured data — parses FAQPage / Question / acceptedAnswer schema.org markup (the same data Google uses for FAQ rich results).
Heuristic mining — when there's no structured data it looks for <dt>/<dd> definition lists, <details>/<summary> accordions, and headings ending in "?" followed by their answer paragraphs.

Each Q&A becomes its own item (question, answer, source, position, url), and every page also gets one type: "summary" item with the total count, per-source breakdown and page title — handy for auditing which pages have FAQ markup.

Use it for: building support chatbots and FAQ knowledge bases, auditing FAQ rich-result markup across a site, or mining competitors' common questions for SEO content planning.

Input

`urls`* array	Pages to mine for FAQ question/answer pairs.
`includeSummary` boolean	Push one summary item per page with counts and sources.(default: true)
`heuristics` boolean	Also mine dt/dd lists, details/summary accordions and ?-headings (not just JSON-LD).(default: true)

{
  "urls": [
    "https://www.firefox.com/en-US/more/faq/",
    "https://docs.python.org/3/faq/general.html"
  ]
}

Output fields

typeurlquestionanswersourcepositionquestionCountjsonLdCountheuristicCountpageTitle

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/faq-extractor-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"urls":["https://www.firefox.com/en-US/more/faq/","https://docs.python.org/3/faq/general.html"]}'

Related scrapers

Google Search Results (SERP)

hyperscrape/google-search-scraper

Scrape organic Google results — title, URL, snippet, sitelinks, PAA and related searches.

HyperscrapeSEO & Marketing

On-Page SEO Analyzer

hyperscrape/seo-page-analyzer

Audit any page's title, meta, headings, links and structured data.

HyperscrapeSEO & Marketing

Sitemap URL Extractor

hyperscrape/sitemap-extractor

Pull every URL from a site's XML sitemap (including nested indexes).

HyperscrapeSEO & Marketing