Skip to content
#

scraping

Star

Web scraping is the process of programmatically retrieving web pages and extracting structured data from them for analysis, storage, or reuse. It powers price monitoring, search indexing, market research, and training-data collection.

Scraping ranges from plain HTTP requests and HTML parsing to full browser automation for JavaScript-rendered and anti-bot-protected pages. The ecosystem includes request libraries, HTML parsers, headless browsers, and cloud extraction platforms.

Here are 621 public repositories matching this topic...

Language: TypeScript
Filter by language
All 8,821 Python 4,266 JavaScript 882 Jupyter Notebook 814 TypeScript 621 HTML 324 Go 240 Java 140 PHP 131 C# 102 Rust 89
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
crawlee

apify / crawlee

Star 25.9k

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

nodejs javascript npm crawler scraper automation typescript web-crawler headless scraping crawling web-scraping web-crawling headless-chrome apify puppeteer playwright
  • Updated Sep 25, 2026
  • TypeScript
Followers
351 followers
Website
github.com/topics/web-scraping

Related topics

browser-automation headless-browser playwright puppeteer selenium