Lobsters Scraper

Pull hottest, newest or tag-filtered stories from Lobste.rs with full metadata.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/lobsters-scraper?feed=value

About

Fetches stories from Lobste.rs, the computing-focused link-aggregation community, using its official public .json endpoints — no key needed. Choose the hottest or newest feed, or filter by a tag (like rust, security, programming), set a limit, and get back rich story items: title, link URL and domain, score, flag count, comment count and discussion URL, submitter, whether the submitter authored the story, all tags and the submission date. Paginates automatically up to your limit.

Source: official public JSON API (lobste.rs/hottest.json, newest.json, t/<tag>.json).

Input

`feed` select	Which Lobste.rs feed to pull.(default: "hottest")
`tag` string	Tag to filter by when feed is "By tag" (e.g. rust, security, ai).
`limit` integer	How many stories to collect.(default: 25)

{
  "feed": "hottest",
  "limit": 25
}

Output fields

shortIdtitleurldomainscorecommentCountcommentsUrlsubmittertagscreatedAt

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/lobsters-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"feed":"hottest","limit":25}'

Related scrapers

News & Article Extractor

hyperscrape/article-extractor

Extract clean article text, author, date, tags and images from any URL.

HyperscrapeNews & Media

Google News Scraper

hyperscrape/google-news-scraper

Track news for any query, topic section or location via Google News.

HyperscrapeNews & Media

RSS & Atom Feed Reader

hyperscrape/rss-feed-reader

Turn RSS 2.0, Atom and RDF feeds into rich, structured JSON items.

HyperscrapeNews & Media