List of libraries, tools and APIs for web scraping and data processing.

crawler spider scraping crawling web-scraping captcha-recaptcha webscraping crawling-framework scraping-framework captcha-bypass scraping-tool crawling-tool scraping-python crawling-python

• Updated Nov 11, 2026
• JavaScript

The All in One Framework to Build Undefeatable Scrapers

anti-bot web-crawling bot-detection python-scraper anti-detect undetected scraping-framework undetectable python-web-scraper scraping-tool cloudflare-bypass scraping-python python-web-scraping anti-detection cloudflare-scrape bypass-cloudflare web-scraping-python undetected-chromedriver antidetect-browser anti-detect-browser

• Updated Nov 2, 2026
• TypeScript

Web data extraction tool implemented as chrome extension

javascript scraping webscraping scraping-tool

• Updated Apr 2, 2026
• JavaScript

Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.

crawler scraper web-crawler scraping web-scraper web-scraping data-extraction webscraping web-crawling data-scraping website-scraper web-data-extraction email-extractor page-scraper scraping-tool scrape-data scrape-products serp-scraper serp-scraping phone-number-extractor

• Updated Mar 17, 2026
• JavaScript

MCP server enabling agents to debug HTTP requests better (using powhttp)

tls debugging http proxy mcp scraping mitm mitmproxy charles-proxy scraping-tool antibot-detection debugging-proxy mcp-server

• Updated Sep 13, 2026
• Go

Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!

python instagram crawler scraper scraping instagram-feed instagram-scraper scrap instagram-photos scraping-websites instagram-downloader scraping-tool scraping-python crawling-python

• Updated Jun 23, 2022
• Python

Simple library which helps you to retrieve the source of various video streaming sites.

nodejs scraper extractor scraping npm-package scrapers source-extraction scraping-tool

• Updated Aug 28, 2019
• TypeScript

Spin up Tor containers and then proxy HTTP requests via these Tor instances

kotlin docker proxy scraping proxy-server tor proxies scrapy proxypool proxy-list scraping-websites privoxy data-scraping proxy-checker free-proxies scraping-tool proxy-scraper proxies-https-traffic proxies-generator scraping-data

• Updated Apr 12, 2021
• Kotlin

📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).

crawler scraper wget-utility research-tool open-source-project android-tool python-scraper google-play-store-scraper android-research xiaomi-apps android-application-downloader scraping-tool crawling-tool xiaomi-store-scraper gplaycli android-scraper android-apps-crawler google-play-application-downloader app-downloader android-market-scraper

• Updated Jan 30, 2025
• Python

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

python scraper web-crawler scraping scraping-websites web-crawling datamining zoominfo-client web-crawler-python leadgen leadgeneration scraping-api scraping-tool scraping-data web-harvesting

• Updated Apr 26, 2021
• Python

一个自适应Web Scraping框架，能处理从单个请求到大规模爬取的一切需求。 它的解析器能够从网站变化中学习，并在页面更新时自动重新定位您的元素。它的Fetcher能够开箱即用地绕过Cloudflare Turnstile等反机器人系统。它的Spider框架让您可以扩展到并发、多Session爬取，支持暂停/恢复和自动Proxy轮换——只需几行Python代码。一个库，零妥协。

scraper scraping scraping-tool scraping-python

• Updated Feb 28, 2026
• Python

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

crawler scraper web-crawler headless scraping crawling selenium web-scraper web-scraping beautifulsoup webscraping web-crawling python-crawler node-crawler crawling-framework scraping-framework scraping-tool crawling-tool scraping-python crawling-python

• Updated Sep 7, 2026
• TypeScript

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

python crawler data-mining scraper scraping crawling python-script python3 scrape scraped-data scraper-engine producthunt scraping-websites datamining producthunt-users producthunt-api crawling-sites scraping-tool scraping-python scraping-bot

• Updated May 25, 2022
• Python

A curated guide to the best web scraping tools in 2025, comparing leading web scraping software and APIs to help you choose the right solution for reliable and scalable data extraction.

web-scraping google-scraper google-search public-api serp-api scraping-tool proxy-scraper google-search-api scraping-tools web-scraping-python serp-scraper serp-scraping google-search-scraper web-scraping-tools web-scraping-api serp-scraper-api google-scraper-api serp-api-python web-scraping-python-projects

• Updated Apr 14, 2026

A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.

javascript ruby python java rust golang php data r perl scraping crawling proxies http-requests web-scraping data-collection webscraping guides frameworks scraping-tool

• Updated Apr 6, 2025

An declarative and easy to use web crawler and scraper in C#

crawler scraper csharp dotnet dotnetcore webscraper webcrawler webcrawling scraping-tool crawling-tool webcrawler-csharp cococrawler

• Updated Sep 11, 2024
• C#

Evaluate JavaScript on a URL through headless Chrome browser.

command-line cli-utilities evaluator web-browser eval web-crawling browser-automation headless-browsers data-scraping website-scraper web-data-extraction datascraping webscrapping web-scrapping data-scraper devtools-protocol pupeteer headless-browser scraping-tool playwright-alternative

• Updated Jun 18, 2021
• JavaScript

An API wrapper for Scrappey.com written in Python

web-scraping data-extraction scraping-framework scraping-tool web-scraping-solution scraping-library scraping-service web-data-extration

• Updated Jun 10, 2026
• Python

Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt

python scraper web-crawler scraping scraping-websites web-crawling datamining web-crawler-python price-scraper scraping-api scraping-tool price-scraping scraping-web scraping-data alibaba-scraper

• Updated May 21, 2024
• Python

GPT4 Assisted Web Scraping Library

scraper scraping-websites scraping-tool scraping-web gpt4

• Updated Dec 23, 2023
• JavaScript