Front-Page Headlines Scraper

Top-stories headlines from BBC, Guardian, NPR, NYT, Al Jazeera & more in one run.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/frontpage-headlines-scraper?outlets=bbc

About

Pulls the current front-page / top-stories headlines from a curated set of major news outlets via their official RSS feeds — structured XML, key-free and reliable. Pick any mix of:

bbc, guardian, npr, nyt, aljazeera, cbs, abc, sky, fox, politico, france24, dw

…and/or add custom feed URLs for any other publication. (Reuters and AP discontinued their public RSS feeds, so they aren't in the curated list — most of their wire stories surface via the outlets above.)

Each headline item includes the outlet, headline, article URL, ISO publish date, plain-text summary, categories/tags, author when provided, GUID, image when the feed carries one, and its position on the feed. Perfect for daily news digests, front-page comparison across outlets, and media-monitoring dashboards — schedule it hourly to build a headline archive.

Input

`outlets` array	Curated outlets to pull: bbc, guardian, npr, nyt, aljazeera, cbs, abc, sky, fox, politico, france24, dw. Empty = all.
`customFeeds` array	Extra RSS/Atom feed URLs to include alongside the curated outlets.
`maxPerOutlet` integer	How many headlines to collect per outlet/feed.(default: 20)

{
  "outlets": [
    "bbc",
    "guardian",
    "npr"
  ],
  "maxPerOutlet": 10
}

Output fields

outletfeedUrlpositiontitleurlpublishedAtsummarycategoriesauthorimageguid

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/frontpage-headlines-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"outlets":["bbc","guardian","npr"],"maxPerOutlet":10}'

Related scrapers

News & Article Extractor

hyperscrape/article-extractor

Extract clean article text, author, date, tags and images from any URL.

HyperscrapeNews & Media

Google News Scraper

hyperscrape/google-news-scraper

Track news for any query, topic section or location via Google News.

HyperscrapeNews & Media

RSS & Atom Feed Reader

hyperscrape/rss-feed-reader

Turn RSS 2.0, Atom and RDF feeds into rich, structured JSON items.

HyperscrapeNews & Media