一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

python crawler spider example selenium multithreading stock wechat taobao pyquery tmall fund agent-pool wechat-report wereader

• Updated Jun 28, 2025
• HTML

Pythonic HTML Parsing for Humans™

python html http scraping requests kennethreitz beautifulsoup lxml css-selectors pyquery

• Updated Apr 16, 2024
• Python

「DLsite 同人作品重命名工具」依据 RJ|VJ|BJ 号从 dlsite.com 爬取 "标题" 和 "社团" 等信息，按照自定义模板对文件夹批量格式化命名，并将文件夹封面修改为作品封面。

sqlite requests wxpython peewee pyinstaller pyquery dlsite

• Updated Sep 26, 2025
• Python

爬虫学习仓库，适合零基础的人学习，对新手比较友好

mysql python crawler selenium update requests xpath scrapy beginner pyquery

• Updated Oct 10, 2020
• Python

Downloader for Free Books from Springer COVID-19 Package

pdf downloader books wget pyquery springer-free

• Updated May 16, 2020
• Python

spider for chinese medical websites with wechat notification enabled

spider requests wechat pyquery

• Updated May 24, 2017
• Python

智能云爬虫Demo

web-app css-selector pyquery

• Updated Aug 16, 2017
• HTML

stock market predictions using sentiment analysis, a deep learning project(data and news based on pakistani stock exchange and news(Dawn news))

python machine-learning sentiment-analysis neural-network numpy keras pandas web-scraping artificial-neural-networks matplotlib evolutionary-algorithm vader-sentiment-analysis pyquery stock-exchange

• Updated Oct 14, 2020
• Jupyter Notebook

Simple API scrapper on LyricFInd 🎹

api python3 scrapper pyquery

• Updated Sep 24, 2024
• Python

Python tool for scraping any timetable page on the University of Aveiro's academic portal (PACO) and exporting it to different formats

python timetable universidade webscraping ua pyquery paco aveiro horario universidade-de-aveiro sttx smarttimetable

• Updated Jan 30, 2020
• Python

Twitter Scraper - Scrape tweets for a user or a #hashtag.

python scraper twitter tweets pyquery

• Updated Jan 2, 2022
• Python

URL Feature extraction and Engineering aided with Classification via Neural Networks

url deep-learning whois classification pyquery tinyml

• Updated Dec 11, 2021
• Python

[NOT MAINTAINED] Job/Occupation data scraping tool that uses scrapy and pyquery

scraper jobs scrapy pyquery careerbuilder onetonline

• Updated May 13, 2017
• Python

Selenium with ChromeDrive/PhantomJS; Crawler with BeautifulSoup4, Scrapy, PyQuery

python chrome-extension phantomjs selenium pymysql pyquery

• Updated May 3, 2018
• Python

A webscrapper that can scrape bbcnews using Scrapy and mongoDB

mongodb pymongo python3 xpath scrapy webscraping pyquery crawlspider bbc-news

• Updated Dec 22, 2018
• Python

百度贴吧极速签到,200个吧用时1.6秒,简单直接

python threading tieba gevent pyquery qiandao tieba-qiandao py-ba

• Updated Nov 18, 2017
• Python

Python网络爬虫与信息提取

requests scrapy beautifulsoup lxml pyquery python-spider urllib

• Updated Dec 27, 2020
• Python

Learn to parse HTML using PyQuery, a Python library for web scraping and manipulating HTML.

python parser parsing web-scraping pyquery web-scraping-python

• Updated Sep 25, 2025
• Python

Scraping of ewrc-results.com

python scraping scraping-websites python-requests pyquery python-pptx scraping-python

• Updated Nov 23, 2024
• Python

CNN Website Scraping Using Python

python scraping cnn requests scraping-websites pyquery scraping-python

• Updated Jan 8, 2024
• Python