Pinned Loading

1. robotstxtscanner robotstxtscanner Public

   Python script to identify which (government) sites are using robots.txt and which agents they (attempt) govern.

   Jupyter Notebook 1

2. sectext sectext Public

   Interface for text analytics of SEC 10-K filings

   Python 4

3. link_crawler link_crawler Public

   Small script designed to crawl a website for links. Designed to research spammy websites who market themselves as government support.

   Jupyter Notebook 1

4. publicagencyprofile publicagencyprofile Public

   Create a structured profile of a public agency (nonprofit or government organization) based on their website.

   Python