Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).
-
Updated
Jul 22, 2025 - Go
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).
general-purpose fast, stateless, and deterministic feature extractor written in golang for use in machine learning
A simple tool to consolidate multiple files into a single .txt file. Perfect for feeding your files to AI tools without any fuss.
Add a description, image, and links to the data-preparation topic page so that developers can more easily learn about it.
To associate your repository with the data-preparation topic, visit your repo's landing page and select "manage topics."