A collection of awesome web crawler,spider in different languages

crawler scraper awesome spider web-crawler web-scraper node-crawler

• Updated Jun 16, 2024

🕷️ A node crawler for github trending.

crawler github-trending node-crawler

• Updated Jun 9, 2026
• JavaScript

🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

crawler scraper web-crawler headless scraping crawling selenium web-scraper web-scraping beautifulsoup webscraping web-crawling python-crawler node-crawler crawling-framework scraping-framework scraping-tool crawling-tool scraping-python crawling-python

• Updated Sep 7, 2026
• TypeScript

Node-Crawler is a highly customizable, Node-based web application for creating web crawlers and further processing and transforming the retrieved data.

tools engine nextjs webcrawler node-crawler node-based reactflow

• Updated Sep 30, 2023
• TypeScript

manga-lib is a nodejs library that allows you to easily scrape manga content from various websites.

manga manga-scraper node-crawler nodejs-crawler manga-crawler manga-scrapper manga-library nettruyen toonily asurascans blogtruyen

• Updated Jan 22, 2024
• TypeScript

🏏 Small CLI app to show Live Score of Cricket matches in Terminal

cli command-line-app terminal cricket command-line-tool node-crawler commanderjs

• Updated Dec 7, 2022
• JavaScript

nodejs 爬虫，包括不限于微博，instagram，图片和视频

node-crawler

• Updated Jul 10, 2021
• JavaScript

Crawler para pegar horários dos ônibus da grande vitória

javascript api crawler node bus transport node-crawler onibus transcol sanremo ceturb vitoria

• Updated Jul 26, 2018
• JavaScript

🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

crawler scraper web-crawler headless scraping crawling selenium web-scraper web-scraping beautifulsoup webscraping web-crawling python-crawler node-crawler crawling-framework scraping-framework scraping-tool crawling-tool scraping-python crawling-python

• Updated Jul 16, 2023
• Python

node crawler

node-crawler

• Updated Aug 26, 2017
• JavaScript

Promise support for node-crawler (Web Crawler/Spider for NodeJS + server-side jQuery)

nodejs crawler spider node-crawler promise-node-crawler

• Updated Jun 1, 2020
• JavaScript

简单爬虫引擎 (苦力怕)

crawler node-crawler

• Updated Apr 4, 2018
• JavaScript

基于node的爬虫系统，定时爬取实时热点 ，新闻，存入mongodb

node typescript node-crawler node-schedule

• Updated Jan 12, 2023
• TypeScript

🚀 SCRAPE 1000'S OF PRODUCTS FROM DENTALKART 🤖

crawler scraper web-crawler scraping crawling selenium web-scraper web-scraping beautifulsoup webscraping web-crawling node-crawler crawling-framework scraping-framework scraping-python crawling-python dentalkart-scraper dentalkart-product-scraper dentalkart-scraping dentalkart

• Updated Jan 24, 2024
• Python

Nodejs Crawler which scrapes a website on live domain and crawls to find all URL of the domain

nodejs url crawler node-crawler

• Updated Dec 5, 2023
• JavaScript

Most powerful, popular and production crawling/scraping package for PHP

php crawler amp coroutine node-crawler

• Updated Aug 15, 2023
• PHP

A minimal Node crawler to find emails used inside a website content, this crawler follows links in the website and tries to find an email in the content of the page

nodejs javascript crawler scraper email lowdb node-crawler

• Updated Dec 9, 2022
• JavaScript

collection of old pjs

react rust golang django typescript vue mobx nuxt parcel react-dnd kong dva pandora node-crawler puppeteer

• Updated Jan 7, 2023
• JavaScript

A collection web crawler, spider and resources in different languages.

crawler scraper spider web-scraper node-crawler

• Updated Jul 26, 2025

Crawl all images from any website

javascript node node-crawler

• Updated Nov 7, 2018
• JavaScript