Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

nlp crawler text-mining html-to-markdown scraping news-aggregator text-extraction web-scraping rss-feed readability tei html2text news-crawler corpus-builder corpus-tools article-extractor text-cleaning rag text-preprocessing llm

• Updated Nov 11, 2026
• Python

Golang HTML to plaintext conversion library

go golang html-emails plaintext html2text

• Updated Mar 3, 2026
• Go

A python based HTML to text conversion library, command line client and Web service.

python html client converter library html2text web-service

• Updated Nov 9, 2026
• Python

Any HTML to the cleanest Markdown, for humans and AI agents: a TypeScript library, a CLI with an Agent Skill, and a hosted crawl/scrape API.

markdown text-mining extractor html-to-markdown scraping web-scraping readability html2text ai-agents article-extractor html2markdown rag html2md cloudflare-workers llm llms-txt agent-skills

• Updated Nov 10, 2026
• TypeScript

📝 Html2Text - Convert HTML to formatted plain text, e.g. for text mails.

php mail hacktoberfest html2text

• Updated Nov 7, 2026
• PHP

Python library for converting HTML to markup or plain text

python markdown html-to-markdown html2text html2markdown html2md html-to-text

• Updated Apr 23, 2026
• Rust

An extremely configurable markdown reverser for Python3.

python html markdown parser flexible reverse-engineering python3 beautifulsoup html2text reverser markdown-reverser reverse-markdown

• Updated Oct 21, 2026
• Python

RxNLP APIs for clustering sentences, extracting topics, counting words & n-grams, extracting text from html or URL, computing similarity between texts and more.

nlp natural-language-processing text-mining nlp-apis mashape html2text topic-extraction sentence-clustering opinosis-summarization rxnlp-apis

• Updated Jan 24, 2020

A very simple (but efficient) "HTML to plain text" converter ✍️

html php converter php7 text html-converter plain-text html2text convertor text-converter email-text-parsing htmltotext symfony-mailer text-convertor html-text-conversion html2text-converter html-convertor

• Updated Sep 7, 2026
• PHP

inscriptis - HTML to text conversion library for Java

java converter library html2text

• Updated Aug 4, 2022
• Java

Article title, authors, date and body extraction dataset.

text-mining news html-to-markdown scraping corpus news-aggregator text-extraction dataset web-scraping readability datasets scraping-websites html2text news-crawler corpus-builder corpus-tools article-extractor text-cleaning text-preprocessing

• Updated Mar 26, 2024
• HTML

html2text but in node

html markdown cli node html2text

• Updated Nov 2, 2025
• JavaScript

DeepSpam milter v2 - content-based NN spamfilter using pytorch or numpy

nlp email-parsing spam-filtering html2text spam-detection neural

• Updated Oct 23, 2026
• Python

My Python Projects.

python adb python3 pip shellscript html2text pip3 dagster pydriller ppadb

• Updated Oct 23, 2026
• Python

AI chat app to response data in Markdown format with text and images. Tutorial from: https://youtu.be/qKtM2AlDTs8

python html2text beautifulsoup4 opeanai streamlit langchain llama-index

• Updated Aug 20, 2023
• Python

A Python-based RAG chatbot leveraging GPT-4o and Bright Data's SERP API to deliver contextually rich and up-to-date AI responses using real-time search engine data.

python api json ai chatbot chatbots serp html2text beautifulsoup4 rag serp-api playwright bright-data chatgpt

• Updated Aug 20, 2025

There is simple project to scrape and collect news using rss and llm API based on rust.

rss crawler scraper rss-feed html2text llm ai-crawler

• Updated May 15, 2025
• Rust

C'est un projet de web scraping qui utilise Streamlit, BeautifulSoup, et html2text pour extraire, convertir en Markdown, et afficher le contenu de toutes les pages liées à une URL donnée. Il fournit un sommaire interactif des URL visitées et permet d'afficher le contenu extrait dans un format facile à lire.

markdown open-source interactive python3 web-application web-scraping data-extraction html2text beautifulsoup4 streamlit

• Updated May 23, 2023
• Python

Go package that cleans a HTML page for better readability.

go html golang text extractor text-extraction readability html2text html-extractor

• Updated Aug 1, 2023
• HTML

a cli tool to fetch webpages main content and print it as markdown

markdown html-to-markdown python3 readability html2text readability-lxml readability-cli fetch-webpages

• Updated Oct 31, 2020
• Python