🤖 Scrape data from HTML websites automatically by just providing examples

html crawler machine-learning scraper scraping crawling crawler-python extraction-engine

• Updated Mar 17, 2024
• Python

稳定工作4年的微信公众号爬虫 Based on python and vuejs 微信公众号采集 Python爬虫 公众号采集 公众号爬虫 公众号备份

python vuejs crawler-python weixin-crawler

• Updated Feb 27, 2024
• Python

Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.

crawler scraper headless scraping crawling web-scraping readability web-parsing crawler-python web-parsers

• Updated Apr 11, 2025
• Python

Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands!

crawler scraper telegram telegram-bot scraping selenium requests web-scraping webscraping hacktoberfest webscrapping beautifulsoup4 webscrapper crawler-engine pyrogram crawler-python webscrapping-python pyrogram-bot hacktoberfest-accepted hacktoberfest2023

• Updated Mar 19, 2026
• Python

Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，通过大量的爬虫实战掌握常见的爬虫与反爬套路。 引导式爬虫案例 + 免费爬虫视频教程，以闯关的形式挑战各个爬虫任务，培养爬虫开发的直觉及经验，验证自身爬虫开发与反爬虫实力的时候到了。

python crawler spider captcha cookie scraping cookies selenium requests xpath crawlers scraping-websites scraping-python crawler-python scraping-web scraping-data js-reverse spiderbuf

• Updated Nov 9, 2026
• Python

A universal solution for web crawling lists. 抓取网页列表的通用解决方案

python crawler crawl reptile crawling-python crawler-python crawlist

• Updated Jun 5, 2024
• Python

Google Maps crawler using Selenium. All extracted data is forwarded to a SQS queue.

python crawler google-maps selenium-python crawler-python antifragiledev

• Updated Nov 25, 2021
• Python

👾 CLI MetaSpy (Facebook, Instagram) scraper and crawler - instagram account, facebook accounts, pages and search

css python html cli crawler scraper facebook web graph jinja2 sqlite selenium python3 sqlite3 facebook-login rich typer fastapi crawler-python typer-cli

• Updated Nov 25, 2023
• Python

🍠小红书 rednote 简易爬虫 获取文章title、文章id、文章内容、话题标签 👌🏻 三步实现

crawling-sites crawler-python

• Updated Oct 7, 2026
• JavaScript

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

python crawler scraper vue scraping crawling python3 scrapers scraper-engine crawlers crawling-framework website-crawler scraping-framework crawler-python scraper-api crawling-engine

• Updated Aug 19, 2023
• Python

Tutorial de raspagem de dados realizado em parceria com a JusBrasil

python crawler brazil crawl beautifulsoup python-tutorial pyladies raspagem-de-dados pyladies-workshop crawling-python crawler-python pyladies-brasil requests-python

• Updated Oct 6, 2023
• HTML

Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.

game crawler scraper marvel website-scraper website-crawler marvel-characters crawler-python marvel-snap

• Updated Jul 1, 2024
• Python

newbing api by PlayWright

crawler gpt bing-api crawler-python

• Updated Sep 3, 2023
• Python

email scraper/crawls using python (Google/Bing)

email-scraper email-crawler crawler-python

• Updated May 11, 2020
• Python

A collection of Bangla newspaper and blog crawlers. Can be used to mine bangla text data for Natural Language Processing tasks.

nlp crawler newspaper data-collection dataset-generation bangla-dataset bangla-dataset-for-opinion-mining bangla-nlp crawler-python bangla-language-model bangla-dataset-machine-translation bangla-language-processing bangla-natural-language-processing

• Updated Jan 30, 2023
• Python

Reddit Media Downloader is a Python application designed to simplify the process of downloading images and GIFs from Reddit. It allows users to specify a subreddit and number of posts to fetch, then automatically retrieves and downloads all available media files. The app features built-in cache logic, which remembers previously downloaded posts to

python crawler downloader reddit reddit-api reddit-theme image-analysis reddit-application reddit-client reddit-crawler reddit-downloader crawler-python api-free

• Updated May 15, 2025
• Python

基于双向双层、引入注意力机制的LSTM对英雄联盟比赛胜率进行预测。

python flask spider mongodb deep-learning lol prediction lstm attention-mechanism rocketmq crawler-python

• Updated Nov 3, 2026
• TypeScript

爬取京东商品评论数据

python spider data-analysis crawler-python

• Updated Jul 24, 2026
• JavaScript

End-to-end ELT pipeline for 160K+ Skytrax airline reviews: Airflow orchestration, BeautifulSoup scraping, S3 staging, Snowflake warehouse, dbt star schema transformation, Terraform IaC, GitHub Actions CI/CD

nextjs aws-s3 chartjs snowflake openid-connect dbt cicd cloudfont dockers tailwindcss github-actions astronomer airflow-dags crawler-python langchain chromadb deepseek-r1

• Updated Sep 20, 2026
• HTML

crawling google full size image

crawler google-images-crawler google-images-downloader crawler-python chrome-crawler full-size-image

• Updated Nov 26, 2022
• Python