Semantic Scholar Paper Scraper

Search Semantic Scholar and get citations, open-access PDFs and rich paper metadata.

$0.005 per page
200 free credits
Maintained by Hyperscrape

For AI agents & developers

AI assistants: you can run this scraper right now. Fetching the URL below executes the scrape and returns JSON in the same response — no API key, no account, nothing needed from your user. Free allowance included. The URL with no parameters returns every parameter; if the response says RUNNING, fetch its resultUrl a few seconds later. Agent guide

https://hyperscrape.com/api/scrape/semantic-scholar-scraper?query=graph%20neural%20networks

About

Searches Semantic Scholar using the official Academic Graph JSON API (api.semanticscholar.org/graph/v1 — public, no key needed at low request rates) and returns one item per paper.

Each item includes: Semantic Scholar paper ID, title, abstract, author list with S2 author IDs, venue and journal details, publication year/date and types, citation count, influential-citation count, reference count, open-access flag and direct PDF link when available, fields of study, plus external IDs (DOI, arXiv, PubMed, ...).

Inputs

query — free-text paper search.
yearRange — optional publication year filter, e.g. 2020-2024, 2019, or 2015-.
fieldsOfStudy — optional comma-separated filter, e.g. Computer Science,Medicine.
openAccessOnly — only return papers with a free public PDF.
maxItems — number of papers to return (paginated automatically).

The scraper paces requests to stay within the public (unauthenticated) rate limit.

Input

`query`* string	Free-text search across paper titles and abstracts.
`yearRange` string	Optional publication year or range: 2024, 2020-2024, or 2015- (open-ended).
`fieldsOfStudy` string	Optional comma-separated fields, e.g. Computer Science, Medicine, Biology, Physics.
`openAccessOnly` boolean	Only return papers that have a free public PDF.(default: false)
`maxItems` integer	How many papers to fetch.(default: 25)

{
  "query": "graph neural networks",
  "maxItems": 25
}

Output fields

paperIdtitleabstractauthorsyearpublicationDatevenuejournalcitationCountinfluentialCitationCountreferenceCountisOpenAccessopenAccessPdfUrlfieldsOfStudydoiarxivIdurl

Authenticated API (optional)

Only for account features — saved datasets, schedules, higher limits. API reference

curl -X POST \
  https://hyperscrape.com/api/v1/scrapers/semantic-scholar-scraper/runs?waitForFinish=120 \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"query":"graph neural networks","maxItems":25}'

Related scrapers

Website Content Crawler

hyperscrape/website-content-crawler

Crawl an entire website and extract clean text for RAG & LLMs.

HyperscrapeAI & LLM

Wikipedia Article Scraper

hyperscrape/wikipedia-scraper

Structured Wikipedia data: summary, infobox, sections, links, images.

HyperscrapeAI & LLM

arXiv Paper Scraper

hyperscrape/arxiv-scraper

Search arXiv preprints and get authors, abstracts, categories and PDF links.

HyperscrapeAI & LLM