Hyperscrape Store

Hundreds of ready-to-run tools for web scraping and automation. Every one is real, maintained code — configure the inputs and go.

AI & LLM

hyperscrape/website-content-crawler

Crawl an entire website and extract clean text for RAG & LLMs.

hyperscrape/wikipedia-scraper

Structured Wikipedia data: summary, infobox, sections, links, images.

hyperscrape/arxiv-scraper

Search arXiv preprints and get authors, abstracts, categories and PDF links.

hyperscrape/crossref-scraper

Search 150M+ Crossref records: DOI metadata, citation counts, references and licenses.

hyperscrape/openalex-scraper

Search 250M+ scholarly works on OpenAlex: citations, concepts, open-access status.

hyperscrape/pubmed-scraper

Search PubMed biomedical literature and get rich article metadata as JSON.

hyperscrape/semantic-scholar-scraper

Search Semantic Scholar and get citations, open-access PDFs and rich paper metadata.

hyperscrape/url-to-markdown-scraper

Convert any web page into clean, faithful CommonMark Markdown with YAML front-matter.

hyperscrape/docs-crawler-scraper

Crawl a documentation section into per-page Markdown chunks, ready for RAG.

hyperscrape/llms-txt-generator

Crawl a site's key pages and generate a ready-to-publish llms.txt file.

hyperscrape/readability-batch-scraper

Batch-convert URL lists into minimal, uniform, LLM-ready text records.