When doing releases, only files tracked in git and all the files tracked in git should be included in the release posted to pypi. We should look into https://pypi.org/project/setuptools-scm/ - that plugin is supposed to help with this.