This is a basic Django application to manage robots.txt files following the robots exclusion protocol, complementing the Django Sitemap contrib app.
For installation instructions, see the documentation install section; for instructions on how to use this application, and on what it provides, see the file "overview.txt" in the "docs/" directory or on ReadTheDocs: https://django-robots.readthedocs.io/
- Django 2.0
- Django 1.11
For older Django versions (1.6-1.10) use django-robots==3.0
.
- Python 2.7 (Django 1.11 only)
- Python 3.4, 3.5, 3.6