Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

A python based HTML to text conversion library, command line client and Web service.

An extremely configurable markdown reverser for Python3.

DeepSpam milter v2

AI chat app to response data in Markdown format with text and images. Tutorial from: https://youtu.be/qKtM2AlDTs8

Python code which extracts the html content, converts it to clean text and pre-processes the text

a cli tool to fetch webpages main content and print it as markdown

Microservice for text and images collection for data science purposes.

html2text Search Command for Splunk

C'est un projet de web scraping qui utilise Streamlit, BeautifulSoup, et html2text pour extraire, convertir en Markdown, et afficher le contenu de toutes les pages liées à une URL donnée. Il fournit un sommaire interactif des URL visitées et permet d'afficher le contenu extrait dans un format facile à lire.

batch convert html files to mardown files

My Python Codes.

Receive Packt Publishing Ltd. Free Learning updates in Telegram every day

The goal is to create a solution that crawls for articles from a news website (Theguardian), cleanses the response, stores it in a hosted mongo database (MongoDB Atlas), then makes it available to search via an API.

Scraped Web using an automated python script that acted as scrapper to extract content from Wikipedia pages and created a clean dataset from it.