scraping

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

OSINT cheat sheet, list OSINT tools, wiki, dataset, article, book , red team OSINT for hackers and OSINT tips and OSINT branch. This repository will grow every time will research, there is a research, science and technology, tutorial. Please use it wisely.

An API to scrape American court websites for metadata.

Jekyll-based static site for The Programming Historian

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.

COVID-19 Coronavirus data scraped from government and curated data sources.

Scape top GitHub repositories and users based on keywords

Data extraction of Google's COVID-19 Mobility Reports

Intelligent Web Data Extractor

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Download Chegg homework-help questions to self-sufficient HTML files

Repo Python

⚽ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

🦩 A NextJS data parser, to scrape peacefully

Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.

🔎 um bot de Web Scraping para mostrar vagas do LinkedIn

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.