Tool to extracts the text from a web article urls and get frequency words, entities recognition, automatic summary and more
Benson turns a list of URLs into mp3s of the contents of each web page - take control over your reading backlog!
This repository houses a Python application for extracting YouTube video transcripts and summarizing its content.
Mobile First Indexing Tool
This Python-based repository hosts a sophisticated service designed for scraping web articles and converting them into Markdown format. The core functionality of this service includes extracting the main content of articles, such as headlines, key paragraphs, and associated images, and then seamlessly transforming this content into well-structured…
The metadata and text content extractor for almost every file type.
Tools for parsing and manipulating JATS XML documents.
Multi-process crawler which extracts main content and sustain itself by extracting more links to crawl.
Opinionated and Sophisticated Document Region Analyzer.
Transform PowerPoint presentations into LLM-optimized markdown while preserving instructional design narrative. Built for technical trainers.
Crawler for MIT OCW - organized scraping with batch control, timers, and content deduplication.
WebScraperAPI is a powerful web application that transforms any website into structured data using the Firecrawl API. It provides an intuitive interface for extracting specific information from websites and converting it into structured formats like JSON and CSV.
A web-based article extractor and text-to-speech converter. Extract content from any URL and listen to articles with natural voice synthesis. Supports multiple extraction methods.
🤖 Automated Q&A Dataset Generation Pipeline powered by LLMs. Multi-stage pipeline that searches, filters, extracts and transforms web content into high-quality question-answer datasets for LLM training. Supports multiple LLM providers (Groq, Mistral, Ollama) and search engines.
A Python library for scraping technical documentation with ease — supports single-page and domain-wide crawling, multiple output formats (Markdown, JSON, TXT), and proxy-friendly setups. Ideal for AI, research, and content generation workflows.
extract and analyze content from various file formats including PDFs, text files, and images.
A python content extraction library for the structured extraction of Terms and Conditions from German and English online shops
Add a description, image, and links to the content-extraction topic page so that developers can more easily learn about it.
To associate your repository with the content-extraction topic, visit your repo's landing page and select "manage topics."