Storage: Update to 1.16.0 can cause google-cloud-core or google-api-core to fail.

[blairg23]

Environment details

1. Specify the API at the beginning of the title (for example, "BigQuery: ...")
   General, Core, and Other are also allowed as types

Google Cloud Storage using the google-cloud-storage Python library

2. OS type and version

Ubuntu Linux 18.04.2 LTS

3. Python version and virtual environment information: python --version

Python 3.6.7

4. google-cloud- version: pip show google-<service> or pip freeze

google-api-core version 1.9.0 <- causes the conflict
google-cloud-core version 1.0.0
google-cloud-storage version 1.16.0

Steps to reproduce

1. Create a fresh virtualenv environment with Python 3
2. Create a requirements.txt file with the following requirements:

backoff==1.8.0
pylimit==0.1.7
django<2.0
django-allauth>=0.27.0
django-jet>=0
django-celery-email>=1.1.4
django-celery-results>=1.0.2
django-celery-beat>=1.0.1
django-redis-cache>=1.7.1
djangorestframework>=3.2.3
djangorestframework-filters>=0
django-cors-headers>=1.2.2
django-rest-auth[with_social]>=0.8.1
django-extensions>=1.7.3
django-nvd3>=0.9.7
django-autoslug>=1.9.3
django-websocket-redis>=0.5.0
django-filters>=0
# django-silk>=0
celery==4.1.1
kombu==4.2.0
redis<3
gevent>=1.0.1
geocoder>=1.29.1
greenlet>=0.4.5
feedparser>=5.2.1
drfdocs>=0.0.11
drf-extensions>=0.3.1
drf-writable-nested>=0
httplib2==0.10.3
pillow>=0
stripe>=0
google-api-python-client>=1.5.5
googleads>=10.1.0
oauth2client==1.5.2
numpy>=1.12.0
pandas>=0.19.2
twilio>=5.7.0
coreapi>=0
python-dateutil>=0
jsonfield>=2.0.1
pytz>=2017.2
requests>=2.18.1
requests-oauthlib>=0.8.0
cryptography>=0
pydotplus>=0
ipython>=6.2.1
rpy2<2.9.3
graphviz>=0.8.3
sentry-sdk==0.7.6
bitly_api>=0
phonenumbers>=0
tabulate>=0.8.2
tqdm>=4.27.0
coverage>=0
psycopg2-binary>=0
pytest>=4.2.0
pytest-cov>=2.6.1
pytest-django>=3.4.7
factory-boy>=2.11.1
coveralls>=1.6.0
pytest-xdist>=1.26.1
tzlocal>=1.5.1
sendgrid>=0
google-cloud-storage
django-storages
billiard==3.5.0.4

3. Run pip install -r requirements.txt --upgrade
4. This is the output

$ Requirement already up-to-date: backoff==1.8.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 1)) (1.8.0)
$ Requirement already up-to-date: pylimit==0.1.7 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 2)) (0.1.7)
$ Requirement already up-to-date: django<2.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 3)) (1.11.20)
$ Requirement already up-to-date: django-allauth>=0.27.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 4)) (0.39.1)
$ Requirement already up-to-date: django-jet>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 7)) (1.0.8)
$ Requirement already up-to-date: django-celery-email>=1.1.4 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 8)) (2.0.1)
$ Requirement already up-to-date: django-celery-results>=1.0.2 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 9)) (1.0.4)
$ Requirement already up-to-date: django-celery-beat>=1.0.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 10)) (1.4.0)
$ Requirement already up-to-date: django-redis-cache>=1.7.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 11)) (2.0.0)
$ Requirement already up-to-date: djangorestframework>=3.2.3 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 12)) (3.9.4)
$ Requirement already up-to-date: djangorestframework-filters>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 13)) (0.11.1)
$ Requirement already up-to-date: django-cors-headers>=1.2.2 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 14)) (3.0.1)
$ Requirement already up-to-date: django-rest-auth[with_social]>=0.8.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 15)) (0.9.5)
$ Collecting django-extensions>=1.7.3 (from -r requirements.txt (line 16))
$ �[?25l Downloading https://files.pythonhosted.org/packages/f8/df/c72d146a2df6aaadbaa3ca0b766a5e1fa0513f024458b405b673b3823310/django_extensions-2.1.7-py2.py3-none-any.whl (221kB)
$ 4% |█▌ | 10kB 16.3MB/s eta 0:00:01
$ 9% |███ | 20kB 17.0MB/s eta 0:00:01
$ 13% |████▌ | 30kB 14.6MB/s eta 0:00:01
$ 18% |██████ | 40kB 7.5MB/s eta 0:00:01
$ 23% |███████▍ | 51kB 7.6MB/s eta 0:00:01
$ 27% |█████████ | 61kB 8.8MB/s eta 0:00:01
$ 32% |██████████▍ | 71kB 8.5MB/s eta 0:00:01
$ 37% |███████████▉ | 81kB 8.1MB/s eta 0:00:01
$ 41% |█████████████▍ | 92kB 8.9MB/s eta 0:00:01
$ 46% |██████████████▉ | 102kB 8.6MB/s eta 0:00:01
$ 50% |████████████████▎ | 112kB 8.9MB/s eta 0:00:01
$ 55% |█████████████████▉ | 122kB 8.1MB/s eta 0:00:01
$ 60% |███████████████████▎ | 133kB 7.8MB/s eta 0:00:01
$ 64% |████████████████████▊ | 143kB 10.3MB/s eta 0:00:01
$ 69% |██████████████████████▎ | 153kB 11.0MB/s eta 0:00:01
$ 74% |███████████████████████▊ | 163kB 10.2MB/s eta 0:00:01
$ 78% |█████████████████████████▏ | 174kB 11.5MB/s eta 0:00:01
$ 83% |██████████████████████████▊ | 184kB 12.6MB/s eta 0:00:01
$ 88% |████████████████████████████▏ | 194kB 12.7MB/s eta 0:00:01
$ 92% |█████████████████████████████▋ | 204kB 14.4MB/s eta 0:00:01
$ 97% |███████████████████████████████▏| 215kB 13.3MB/s eta 0:00:01
$ 100% |████████████████████████████████| 225kB 12.7MB/s
$ �[?25hRequirement already up-to-date: django-nvd3>=0.9.7 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 17)) (0.9.7)
$ Requirement already up-to-date: django-autoslug>=1.9.3 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 18)) (1.9.4)
$ Requirement already up-to-date: django-websocket-redis>=0.5.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 19)) (0.5.2)
$ Requirement already up-to-date: django-filters>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 20)) (0.2.1)
$ Requirement already up-to-date: celery==4.1.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 22)) (4.1.1)
$ Requirement already up-to-date: kombu==4.2.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 23)) (4.2.0)
$ Requirement already up-to-date: redis<3 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 24)) (2.10.6)
$ Requirement already up-to-date: gevent>=1.0.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 26)) (1.4.0)
$ Requirement already up-to-date: geocoder>=1.29.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 27)) (1.38.1)
$ Requirement already up-to-date: greenlet>=0.4.5 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 28)) (0.4.15)
$ Requirement already up-to-date: feedparser>=5.2.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 29)) (5.2.1)
$ Requirement already up-to-date: drfdocs>=0.0.11 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 30)) (0.0.11)
$ Requirement already up-to-date: drf-extensions>=0.3.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 31)) (0.5.0)
$ Requirement already up-to-date: drf-writable-nested>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 32)) (0.5.1)
$ Requirement already up-to-date: httplib2==0.10.3 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 33)) (0.10.3)
$ Requirement already up-to-date: pillow>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 34)) (6.0.0)
$ Collecting stripe>=0 (from -r requirements.txt (line 35))
$ �[?25l Downloading https://files.pythonhosted.org/packages/a0/2b/5e669b5012047d95552ff7f6f7639cc61b15ec38346e964615342c49fd2b/stripe-2.28.1-py2.py3-none-any.whl (197kB)
$ 5% |█▋ | 10kB 16.8MB/s eta 0:00:01
$ 10% |███▎ | 20kB 21.5MB/s eta 0:00:01
$ 15% |█████ | 30kB 24.5MB/s eta 0:00:01
$ 20% |██████▋ | 40kB 27.1MB/s eta 0:00:01
$ 25% |████████▎ | 51kB 25.8MB/s eta 0:00:01
$ 31% |██████████ | 61kB 27.1MB/s eta 0:00:01
$ 36% |███████████▋ | 71kB 27.4MB/s eta 0:00:01
$ 41% |█████████████▎ | 81kB 24.4MB/s eta 0:00:01
$ 46% |███████████████ | 92kB 24.8MB/s eta 0:00:01
$ 51% |████████████████▋ | 102kB 25.8MB/s eta 0:00:01
$ 57% |██████████████████▎ | 112kB 28.3MB/s eta 0:00:01
$ 62% |████████████████████ | 122kB 29.1MB/s eta 0:00:01
$ 67% |█████████████████████▋ | 133kB 29.3MB/s eta 0:00:01
$ 72% |███████████████████████▎ | 143kB 29.7MB/s eta 0:00:01
$ 77% |█████████████████████████ | 153kB 30.4MB/s eta 0:00:01
$ 83% |██████████████████████████▋ | 163kB 27.9MB/s eta 0:00:01
$ 88% |████████████████████████████▎ | 174kB 28.6MB/s eta 0:00:01
$ 93% |██████████████████████████████ | 184kB 32.3MB/s eta 0:00:01
$ 98% |███████████████████████████████▋| 194kB 34.0MB/s eta 0:00:01
$ 100% |████████████████████████████████| 204kB 20.0MB/s
$ �[?25hRequirement already up-to-date: google-api-python-client>=1.5.5 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 36)) (1.7.8)
$ Requirement already up-to-date: googleads>=10.1.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 37)) (19.0.0)
$ Requirement already up-to-date: oauth2client==1.5.2 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 38)) (1.5.2)
$ Requirement already up-to-date: numpy>=1.12.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 40)) (1.16.3)
$ Requirement already up-to-date: pandas>=0.19.2 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 41)) (0.24.2)
$ Requirement already up-to-date: twilio>=5.7.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 42)) (6.27.0)
$ Requirement already up-to-date: coreapi>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 44)) (2.3.3)
$ Requirement already up-to-date: python-dateutil>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 45)) (2.8.0)
$ Requirement already up-to-date: jsonfield>=2.0.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 46)) (2.0.2)
$ Requirement already up-to-date: pytz>=2017.2 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 47)) (2019.1)
$ Requirement already up-to-date: requests>=2.18.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 48)) (2.22.0)
$ Requirement already up-to-date: requests-oauthlib>=0.8.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 49)) (1.2.0)
$ Requirement already up-to-date: cryptography>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 50)) (2.6.1)
$ Requirement already up-to-date: pydotplus>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 51)) (2.0.2)
$ Requirement already up-to-date: ipython>=6.2.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 52)) (7.5.0)
$ Requirement already up-to-date: rpy2<2.9.3 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 53)) (2.9.2)
$ Requirement already up-to-date: graphviz>=0.8.3 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 54)) (0.10.1)
$ Requirement already up-to-date: sentry-sdk==0.7.6 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 55)) (0.7.6)
$ Requirement already up-to-date: bitly_api>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 56)) (0.3)
$ Requirement already up-to-date: phonenumbers>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 57)) (8.10.12)
$ Requirement already up-to-date: tabulate>=0.8.2 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 58)) (0.8.3)
$ Requirement already up-to-date: tqdm>=4.27.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 59)) (4.32.1)
$ Requirement already up-to-date: coverage>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 60)) (4.5.3)
$ Requirement already up-to-date: psycopg2-binary>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 61)) (2.8.2)
$ Requirement already up-to-date: pytest>=4.2.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 62)) (4.5.0)
$ Requirement already up-to-date: pytest-cov>=2.6.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 63)) (2.7.1)
$ Requirement already up-to-date: pytest-django>=3.4.7 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 64)) (3.4.8)
$ Requirement already up-to-date: factory-boy>=2.11.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 65)) (2.12.0)
$ Requirement already up-to-date: coveralls>=1.6.0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 66)) (1.7.0)
$ Requirement already up-to-date: pytest-xdist>=1.26.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 67)) (1.28.0)
$ Requirement already up-to-date: tzlocal>=1.5.1 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 68)) (1.5.1)
$ Requirement already up-to-date: sendgrid>=0 in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 69)) (6.0.5)
**$ Collecting google-cloud-storage (from -r requirements.txt (line 70))**
$ �[?25l Downloading https://files.pythonhosted.org/packages/34/7c/e2f563c1af1d9042b1a4e03dfcdd73fc31a5236fd108440b4981b4eaea8d/google_cloud_storage-1.16.0-py2.py3-none-any.whl (65kB)
$ 15% |█████ | 10kB 19.0MB/s eta 0:00:01
$ 31% |██████████ | 20kB 24.3MB/s eta 0:00:01
$ 47% |███████████████ | 30kB 27.7MB/s eta 0:00:01
$ 62% |████████████████████ | 40kB 29.9MB/s eta 0:00:01
$ 78% |█████████████████████████ | 51kB 31.6MB/s eta 0:00:01
$ 94% |██████████████████████████████ | 61kB 33.7MB/s eta 0:00:01
$ 100% |████████████████████████████████| 71kB 24.0MB/s
$ �[?25hRequirement already up-to-date: django-storages in /usr/local/lib/python3.6/dist-packages (from -r requirements.txt (line 71)) (1.7.1)
$ Requirement already satisfied, skipping upgrade: python3-openid>=3.0.8 in /usr/local/lib/python3.6/dist-packages (from django-allauth>=0.27.0->-r requirements.txt (line 4)) (3.1.0)
$ Requirement already satisfied, skipping upgrade: django-appconf in /usr/local/lib/python3.6/dist-packages (from django-celery-email>=1.1.4->-r requirements.txt (line 8)) (1.0.3)
$ Requirement already satisfied, skipping upgrade: python-crontab>=2.3.4 in /usr/local/lib/python3.6/dist-packages (from django-celery-beat>=1.0.1->-r requirements.txt (line 10)) (2.3.6)
$ Requirement already satisfied, skipping upgrade: django-timezone-field>=2.0 in /usr/local/lib/python3.6/dist-packages (from django-celery-beat>=1.0.1->-r requirements.txt (line 10)) (3.0)
$ Requirement already satisfied, skipping upgrade: django-filter~=1.1 in /usr/local/lib/python3.6/dist-packages (from djangorestframework-filters>=0->-r requirements.txt (line 13)) (1.1.0)
$ Requirement already satisfied, skipping upgrade: six>=1.9.0 in /usr/local/lib/python3.6/dist-packages (from django-rest-auth[with_social]>=0.8.1->-r requirements.txt (line 15)) (1.12.0)
$ Requirement already satisfied, skipping upgrade: python-nvd3==0.14.2 in /usr/local/lib/python3.6/dist-packages (from django-nvd3>=0.9.7->-r requirements.txt (line 17)) (0.14.2)
$ Requirement already satisfied, skipping upgrade: setuptools in /usr/local/lib/python3.6/dist-packages (from django-websocket-redis>=0.5.0->-r requirements.txt (line 19)) (40.8.0)
$ Requirement already satisfied, skipping upgrade: billiard<3.6.0,>=3.5.0.2 in /usr/local/lib/python3.6/dist-packages (from celery==4.1.1->-r requirements.txt (line 22)) (3.5.0.5)
$ Requirement already satisfied, skipping upgrade: amqp<3.0,>=2.1.4 in /usr/local/lib/python3.6/dist-packages (from kombu==4.2.0->-r requirements.txt (line 23)) (2.4.2)
$ Requirement already satisfied, skipping upgrade: click in /usr/local/lib/python3.6/dist-packages (from geocoder>=1.29.1->-r requirements.txt (line 27)) (7.0)
$ Requirement already satisfied, skipping upgrade: ratelim in /usr/local/lib/python3.6/dist-packages (from geocoder>=1.29.1->-r requirements.txt (line 27)) (0.1.6)
$ Requirement already satisfied, skipping upgrade: future in /usr/local/lib/python3.6/dist-packages (from geocoder>=1.29.1->-r requirements.txt (line 27)) (0.17.1)
$ Requirement already satisfied, skipping upgrade: google-auth>=1.4.1 in /usr/local/lib/python3.6/dist-packages (from google-api-python-client>=1.5.5->-r requirements.txt (line 36)) (1.6.3)
$ Requirement already satisfied, skipping upgrade: google-auth-httplib2>=0.0.3 in /usr/local/lib/python3.6/dist-packages (from google-api-python-client>=1.5.5->-r requirements.txt (line 36)) (0.0.3)
$ Requirement already satisfied, skipping upgrade: uritemplate<4dev,>=3.0.0 in /usr/local/lib/python3.6/dist-packages (from google-api-python-client>=1.5.5->-r requirements.txt (line 36)) (3.0.0)
$ Requirement already satisfied, skipping upgrade: zeep>=2.5.0 in /usr/local/lib/python3.6/dist-packages (from googleads>=10.1.0->-r requirements.txt (line 37)) (3.3.1)
$ Requirement already satisfied, skipping upgrade: suds-jurko<0.7,>=0.6 in /usr/local/lib/python3.6/dist-packages (from googleads>=10.1.0->-r requirements.txt (line 37)) (0.6)
$ Requirement already satisfied, skipping upgrade: xmltodict<1.0.0,>=0.9.2 in /usr/local/lib/python3.6/dist-packages (from googleads>=10.1.0->-r requirements.txt (line 37)) (0.12.0)
$ Requirement already satisfied, skipping upgrade: PyYAML<6.0,>=5.1 in /usr/local/lib/python3.6/dist-packages (from googleads>=10.1.0->-r requirements.txt (line 37)) (5.1)
$ Requirement already satisfied, skipping upgrade: google-auth-oauthlib<1.0.0,>=0.0.1 in /usr/local/lib/python3.6/dist-packages (from googleads>=10.1.0->-r requirements.txt (line 37)) (0.2.0)
$ Requirement already satisfied, skipping upgrade: pyasn1>=0.1.7 in /usr/local/lib/python3.6/dist-packages (from oauth2client==1.5.2->-r requirements.txt (line 38)) (0.4.5)
$ Requirement already satisfied, skipping upgrade: rsa>=3.1.4 in /usr/local/lib/python3.6/dist-packages (from oauth2client==1.5.2->-r requirements.txt (line 38)) (4.0)
$ Requirement already satisfied, skipping upgrade: pyasn1-modules>=0.0.5 in /usr/local/lib/python3.6/dist-packages (from oauth2client==1.5.2->-r requirements.txt (line 38)) (0.2.4)
$ Requirement already satisfied, skipping upgrade: pysocks; python_version >= "3.0" in /usr/local/lib/python3.6/dist-packages (from twilio>=5.7.0->-r requirements.txt (line 42)) (1.6.8)
$ Requirement already satisfied, skipping upgrade: PyJWT>=1.4.2 in /usr/local/lib/python3.6/dist-packages (from twilio>=5.7.0->-r requirements.txt (line 42)) (1.7.1)
$ Requirement already satisfied, skipping upgrade: coreschema in /usr/local/lib/python3.6/dist-packages (from coreapi>=0->-r requirements.txt (line 44)) (0.0.4)
$ Requirement already satisfied, skipping upgrade: itypes in /usr/local/lib/python3.6/dist-packages (from coreapi>=0->-r requirements.txt (line 44)) (1.1.0)
$ Requirement already satisfied, skipping upgrade: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests>=2.18.1->-r requirements.txt (line 48)) (1.24.1)
$ Requirement already satisfied, skipping upgrade: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests>=2.18.1->-r requirements.txt (line 48)) (2019.3.9)
$ Requirement already satisfied, skipping upgrade: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests>=2.18.1->-r requirements.txt (line 48)) (3.0.4)
$ Requirement already satisfied, skipping upgrade: idna<2.9,>=2.5 in /usr/local/lib/python3.6/dist-packages (from requests>=2.18.1->-r requirements.txt (line 48)) (2.8)
$ Requirement already satisfied, skipping upgrade: oauthlib>=3.0.0 in /usr/local/lib/python3.6/dist-packages (from requests-oauthlib>=0.8.0->-r requirements.txt (line 49)) (3.0.1)
$ Requirement already satisfied, skipping upgrade: asn1crypto>=0.21.0 in /usr/local/lib/python3.6/dist-packages (from cryptography>=0->-r requirements.txt (line 50)) (0.24.0)
$ Requirement already satisfied, skipping upgrade: cffi!=1.11.3,>=1.8 in /usr/local/lib/python3.6/dist-packages (from cryptography>=0->-r requirements.txt (line 50)) (1.12.2)
$ Requirement already satisfied, skipping upgrade: pyparsing>=2.0.1 in /usr/local/lib/python3.6/dist-packages (from pydotplus>=0->-r requirements.txt (line 51)) (2.3.1)
$ Requirement already satisfied, skipping upgrade: pygments in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (2.3.1)
$ Requirement already satisfied, skipping upgrade: jedi>=0.10 in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (0.13.3)
$ Requirement already satisfied, skipping upgrade: pexpect; sys_platform != "win32" in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (4.6.0)
$ Requirement already satisfied, skipping upgrade: decorator in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (4.4.0)
$ Requirement already satisfied, skipping upgrade: backcall in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (0.1.0)
$ Requirement already satisfied, skipping upgrade: pickleshare in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (0.7.5)
$ Requirement already satisfied, skipping upgrade: prompt-toolkit<2.1.0,>=2.0.0 in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (2.0.9)
$ Requirement already satisfied, skipping upgrade: traitlets>=4.2 in /usr/local/lib/python3.6/dist-packages (from ipython>=6.2.1->-r requirements.txt (line 52)) (4.3.2)
$ Requirement already satisfied, skipping upgrade: jinja2 in /usr/local/lib/python3.6/dist-packages (from rpy2<2.9.3->-r requirements.txt (line 53)) (2.10)
$ Requirement already satisfied, skipping upgrade: wcwidth in /usr/local/lib/python3.6/dist-packages (from pytest>=4.2.0->-r requirements.txt (line 62)) (0.1.7)
$ Requirement already satisfied, skipping upgrade: pluggy!=0.10,<1.0,>=0.9 in /usr/local/lib/python3.6/dist-packages (from pytest>=4.2.0->-r requirements.txt (line 62)) (0.11.0)
$ Requirement already satisfied, skipping upgrade: atomicwrites>=1.0 in /usr/local/lib/python3.6/dist-packages (from pytest>=4.2.0->-r requirements.txt (line 62)) (1.3.0)
$ Requirement already satisfied, skipping upgrade: py>=1.5.0 in /usr/local/lib/python3.6/dist-packages (from pytest>=4.2.0->-r requirements.txt (line 62)) (1.8.0)
$ Requirement already satisfied, skipping upgrade: more-itertools>=4.0.0; python_version > "2.7" in /usr/local/lib/python3.6/dist-packages (from pytest>=4.2.0->-r requirements.txt (line 62)) (6.0.0)
$ Requirement already satisfied, skipping upgrade: attrs>=17.4.0 in /usr/local/lib/python3.6/dist-packages (from pytest>=4.2.0->-r requirements.txt (line 62)) (19.1.0)
$ Requirement already satisfied, skipping upgrade: Faker>=0.7.0 in /usr/local/lib/python3.6/dist-packages (from factory-boy>=2.11.1->-r requirements.txt (line 65)) (1.0.4)
$ Requirement already satisfied, skipping upgrade: docopt>=0.6.1 in /usr/local/lib/python3.6/dist-packages (from coveralls>=1.6.0->-r requirements.txt (line 66)) (0.6.2)
$ Requirement already satisfied, skipping upgrade: pytest-forked in /usr/local/lib/python3.6/dist-packages (from pytest-xdist>=1.26.1->-r requirements.txt (line 67)) (1.0.2)
$ Requirement already satisfied, skipping upgrade: execnet>=1.1 in /usr/local/lib/python3.6/dist-packages (from pytest-xdist>=1.26.1->-r requirements.txt (line 67)) (1.5.0)
$ Requirement already satisfied, skipping upgrade: python-http-client>=3.0 in /usr/local/lib/python3.6/dist-packages (from sendgrid>=0->-r requirements.txt (line 69)) (3.1.0)
**$ Requirement already satisfied, skipping upgrade: google-resumable-media>=0.3.1 in /usr/local/lib/python3.6/dist-packages (from google-cloud-storage->-r requirements.txt (line 70)) (0.3.2)**
**$ Requirement already satisfied, skipping upgrade: google-api-core<2.0.0dev,>=1.6.0 in /usr/local/lib/python3.6/dist-packages (from google-cloud-storage->-r requirements.txt (line 70)) (1.9.0)**
**$ Collecting google-cloud-core<2.0dev,>=1.0.0 (from google-cloud-storage->-r requirements.txt (line 70))**
$ Downloading https://files.pythonhosted.org/packages/34/ba/251d9b6a1695d25d9f081a3db537b0dfb15edaf2037b423e4a98280df7f9/google_cloud_core-1.0.0-py2.py3-none-any.whl
$ Requirement already satisfied, skipping upgrade: defusedxml in /usr/local/lib/python3.6/dist-packages (from python3-openid>=3.0.8->django-allauth>=0.27.0->-r requirements.txt (line 4)) (0.5.0)
$ Requirement already satisfied, skipping upgrade: python-slugify==1.1.4 in /usr/local/lib/python3.6/dist-packages (from python-nvd3==0.14.2->django-nvd3>=0.9.7->-r requirements.txt (line 17)) (1.1.4)
$ Requirement already satisfied, skipping upgrade: vine>=1.1.3 in /usr/local/lib/python3.6/dist-packages (from amqp<3.0,>=2.1.4->kombu==4.2.0->-r requirements.txt (line 23)) (1.3.0)
$ Requirement already satisfied, skipping upgrade: cachetools>=2.0.0 in /usr/local/lib/python3.6/dist-packages (from google-auth>=1.4.1->google-api-python-client>=1.5.5->-r requirements.txt (line 36)) (3.1.0)
$ Requirement already satisfied, skipping upgrade: appdirs>=1.4.0 in /usr/local/lib/python3.6/dist-packages (from zeep>=2.5.0->googleads>=10.1.0->-r requirements.txt (line 37)) (1.4.3)
$ Requirement already satisfied, skipping upgrade: cached-property>=1.3.0 in /usr/local/lib/python3.6/dist-packages (from zeep>=2.5.0->googleads>=10.1.0->-r requirements.txt (line 37)) (1.5.1)
$ Requirement already satisfied, skipping upgrade: isodate>=0.5.4 in /usr/local/lib/python3.6/dist-packages (from zeep>=2.5.0->googleads>=10.1.0->-r requirements.txt (line 37)) (0.6.0)
$ Requirement already satisfied, skipping upgrade: requests-toolbelt>=0.7.1 in /usr/local/lib/python3.6/dist-packages (from zeep>=2.5.0->googleads>=10.1.0->-r requirements.txt (line 37)) (0.9.1)
$ Requirement already satisfied, skipping upgrade: lxml>=3.1.0 in /usr/local/lib/python3.6/dist-packages (from zeep>=2.5.0->googleads>=10.1.0->-r requirements.txt (line 37)) (4.3.2)
$ Requirement already satisfied, skipping upgrade: pycparser in /usr/local/lib/python3.6/dist-packages (from cffi!=1.11.3,>=1.8->cryptography>=0->-r requirements.txt (line 50)) (2.19)
$ Requirement already satisfied, skipping upgrade: parso>=0.3.0 in /usr/local/lib/python3.6/dist-packages (from jedi>=0.10->ipython>=6.2.1->-r requirements.txt (line 52)) (0.3.4)
$ Requirement already satisfied, skipping upgrade: ptyprocess>=0.5 in /usr/local/lib/python3.6/dist-packages (from pexpect; sys_platform != "win32"->ipython>=6.2.1->-r requirements.txt (line 52)) (0.6.0)
$ Requirement already satisfied, skipping upgrade: ipython-genutils in /usr/local/lib/python3.6/dist-packages (from traitlets>=4.2->ipython>=6.2.1->-r requirements.txt (line 52)) (0.2.0)
$ Requirement already satisfied, skipping upgrade: MarkupSafe>=0.23 in /usr/local/lib/python3.6/dist-packages (from jinja2->rpy2<2.9.3->-r requirements.txt (line 53)) (1.1.1)
$ Requirement already satisfied, skipping upgrade: text-unidecode==1.2 in /usr/local/lib/python3.6/dist-packages (from Faker>=0.7.0->factory-boy>=2.11.1->-r requirements.txt (line 65)) (1.2)
$ Requirement already satisfied, skipping upgrade: apipkg>=1.4 in /usr/local/lib/python3.6/dist-packages (from execnet>=1.1->pytest-xdist>=1.26.1->-r requirements.txt (line 67)) (1.5)
**$ Requirement already satisfied, skipping upgrade: protobuf>=3.4.0 in /usr/local/lib/python3.6/dist-packages (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-storage->-r requirements.txt (line 70)) (3.7.1)**
**$ Requirement already satisfied, skipping upgrade: googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 in /usr/local/lib/python3.6/dist-packages (from google-api-core<2.0.0dev,>=1.6.0->google-cloud-storage->-r requirements.txt (line 70)) (1.5.9)**
$ Requirement already satisfied, skipping upgrade: Unidecode>=0.04.16 in /usr/local/lib/python3.6/dist-packages (from python-slugify==1.1.4->python-nvd3==0.14.2->django-nvd3>=0.9.7->-r requirements.txt (line 17)) (1.0.23)
**$ google-cloud-core 1.0.0 has requirement google-api-core<2.0.0dev,>=1.11.0, but you'll have google-api-core 1.9.0 which is incompatible.**
**$ Installing collected packages: django-extensions, stripe, google-cloud-core, google-cloud-storage**
$ Found existing installation: django-extensions 2.1.6
$ Uninstalling django-extensions-2.1.6:
$ Successfully uninstalled django-extensions-2.1.6
$ Found existing installation: stripe 2.28.0
$ Uninstalling stripe-2.28.0:
$ Successfully uninstalled stripe-2.28.0
**$ Found existing installation: google-cloud-core 0.29.1**
**$ Uninstalling google-cloud-core-0.29.1:**
**$ Successfully uninstalled google-cloud-core-0.29.1**
**$ Found existing installation: google-cloud-storage 1.15.1**
**$ Uninstalling google-cloud-storage-1.15.1:**
**$ Successfully uninstalled google-cloud-storage-1.15.1**
**$ Successfully installed django-extensions-2.1.7 google-cloud-core-1.0.0 google-cloud-storage-1.16.0 stripe-2.28.1**
$ You are using pip version 19.0.3, however version 19.1.1 is available.
$ You should consider upgrading via the 'pip install --upgrade pip' command.
$ Traceback (most recent call last):
$ File "/usr/local/lib/python3.6/dist-packages/storages/backends/gcloud.py", line 18, in <module>
$ from google.cloud.storage.client import Client
$ File "/usr/local/lib/python3.6/dist-packages/google/cloud/storage/__init__.py", line 38, in <module>
$ from google.cloud.storage.batch import Batch
$ File "/usr/local/lib/python3.6/dist-packages/google/cloud/storage/batch.py", line 31, in <module>
$ from google.cloud.storage._http import Connection
$ File "/usr/local/lib/python3.6/dist-packages/google/cloud/storage/_http.py", line 17, in <module>
$ from google.cloud import _http
$ File "/usr/local/lib/python3.6/dist-packages/google/cloud/_http.py", line 24, in <module>
$ from google.api_core.client_info import ClientInfo
$ ModuleNotFoundError: No module named 'google.api_core.client_info'
$ During handling of the above exception, another exception occurred:
$ Traceback (most recent call last):
$ File "./manage.py", line 11, in <module>
$ execute_from_command_line(sys.argv)
$ File "/usr/local/lib/python3.6/dist-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
$ utility.execute()
$ File "/usr/local/lib/python3.6/dist-packages/django/core/management/__init__.py", line 338, in execute
$ django.setup()
$ File "/usr/local/lib/python3.6/dist-packages/django/__init__.py", line 27, in setup
$ apps.populate(settings.INSTALLED_APPS)
$ File "/usr/local/lib/python3.6/dist-packages/django/apps/registry.py", line 108, in populate
$ app_config.import_models()
$ File "/usr/local/lib/python3.6/dist-packages/django/apps/config.py", line 202, in import_models
$ self.models_module = import_module(models_module_name)
$ File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
$ return _bootstrap._gcd_import(name[level:], package, level)
$ File "<frozen importlib._bootstrap>", line 994, in _gcd_import
$ File "<frozen importlib._bootstrap>", line 971, in _find_and_load
$ File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
$ File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
$ File "<frozen importlib._bootstrap_external>", line 678, in exec_module
$ File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
$ File "/root/tomis-backend/component/workflow/models.py", line 63, in <module>
$ from .action import start, stop, event, email, error, task
$ File "/root/tomis-backend/component/workflow/action.py", line 7, in <module>
$ from component.notifications.utils import create_assignee_notifications
$ File "/root/tomis-backend/component/notifications/utils.py", line 21, in <module>
$ from component.notifications.storages import dataframe_snapshot_storage
$ File "/root/tomis-backend/component/notifications/storages.py", line 8, in <module>
$ from storages.backends.gcloud import GoogleCloudStorage
$ File "/usr/local/lib/python3.6/dist-packages/storages/backends/gcloud.py", line 22, in <module>
$ raise ImproperlyConfigured("Could not load Google Cloud Storage bindings.\n"
$ django.core.exceptions.ImproperlyConfigured: Could not load Google Cloud Storage bindings.
$ See https://github.com/GoogleCloudPlatform/gcloud-python

5. It's very hard to reproduce because a simple pip uninstall -r requirements.txt and pip install -r requirements.txt --upgrade fixes the issues. Hopefully the above snippet can shed some light on where the issue lies. It appears that some dependency in either google-core-api or google-cloud-storage is causing the dependency mismatch for google-cloud-core

[tseaver]

I cannot reproduce this in a fresh environment with a stripped-down set of requirements:

$ python3.6 -m venv /tmp/gcp/8085
$ /tmp/gcp/8085/bin/pip install --upgrade setuptools pip wheel
...
Successfully installed pip-19.1.1 setuptools-41.0.1 wheel-0.33.4
$ /tmp/gcp/8085/bin/pip install "google-api-python-client>=1.5.5" google-cloud-storage
...
Successfully installed cachetools-3.1.0 certifi-2019.3.9 chardet-3.0.4 google-api-core-1.11.0 google-api-python-client-1.7.9 google-auth-1.6.3 google-auth-httplib2-0.0.3 google-cloud-core-1.0.0 google-cloud-storage-1.16.0 google-resumable-media-0.3.2 googleapis-common-protos-1.6.0 httplib2-0.12.3 idna-2.8 protobuf-3.7.1 pyasn1-0.4.5 pyasn1-modules-0.2.5 pytz-2019.1 requests-2.22.0 rsa-4.0 six-1.12.0 uritemplate-3.0.0 urllib3-1.25.3
$ /tmp/gcp/8085/bin/python -c "from google.cloud import storage; print(storage.__version__)"
1.16.0

Output from pip freeze in that environment:

cachetools==3.1.0
certifi==2019.3.9
chardet==3.0.4
google-api-core==1.11.0
google-api-python-client==1.7.9
google-auth==1.6.3
google-auth-httplib2==0.0.3
google-cloud-core==1.0.0
google-cloud-storage==1.16.0
google-resumable-media==0.3.2
googleapis-common-protos==1.6.0
httplib2==0.12.3
idna==2.8
protobuf==3.7.1
pyasn1==0.4.5
pyasn1-modules==0.2.5
pytz==2019.1
requests==2.22.0
rsa==4.0
six==1.12.0
uritemplate==3.0.0
urllib3==1.25.3

Please reopen if you can provide more information about reproducing the issue.

[Tredence-GitHub]

pip3 install google-cloud-storage

This is the error I'm getting:
Traceback (most recent call last):
File "json_bucket.py", line 3, in
from google.cloud import storage
File "/usr/local/lib/python3.7/site-packages/google/cloud/storage/init.py", line 38, in
from google.cloud.storage.batch import Batch
File "/usr/local/lib/python3.7/site-packages/google/cloud/storage/batch.py", line 31, in
from google.cloud.storage._http import Connection
File "/usr/local/lib/python3.7/site-packages/google/cloud/storage/_http.py", line 17, in
from google.cloud import _http
File "/usr/local/lib/python3.7/site-packages/google/cloud/_http.py", line 24, in
from google.api_core.client_info import ClientInfo
ModuleNotFoundError: No module named 'google.api_core.client_info'

[tseaver]

@Tredence-GitHub Can you please show the output of pip3 --freeze?

Also, I suspect that you may need to run pip3 install --upgrade google-cloud-storage to get up-to-date.

[blairg23]

When I proc'd it, it was my pip3 install -r requirements.txt --upgrade command that caused it initially.

One thing I realized that might help us figure it out: I didn't have a virtualenv set up on that box when this error occurred. It was going off the Ubuntu 18.04 LTS Python 3 environment as well. It's possible some distutils were conflicting. Unfortunately, I don't have a pip freeze from that time period, but it should've only been the default Ubuntu 18.04 LTS packages.

Uninstalling all pip requirements and reinstalling seemed to fix it. I had to use pip3 install -r requirements.txt --upgrade --ignore-installed to reinstall and now it works without --ignore-installed. If you look through the screendump I pasted, you can see that it seems to be a dependency tree failure (accidentally requires the wrong version of the google-api-core after it previously installed a higher version, so it downgrades automatically... just a theory).

[Tredence-GitHub]

pip3 freeze

cachetools==3.1.0
certifi==2019.3.9
chardet==3.0.4
google-api-core==1.10.0
google-auth==1.6.3
google-auth-oauthlib==0.3.0
google-cloud==0.34.0
google-cloud-bigquery==1.11.2
google-cloud-core==0.28.1
google-cloud-pubsub==0.41.0
google-cloud-storage==1.10.0
google-resumable-media==0.3.2
googleapis-common-protos==1.5.10
grpc-google-iam-v1==0.11.4
grpcio==1.20.1
idna==2.8
mysql-connector-python==8.0.16
numpy==1.16.3
oauthlib==3.0.1
pandas==0.24.2
pandas-gbq==0.10.0
protobuf==3.7.1
pyasn1==0.4.5
pyasn1-modules==0.2.5
pydata-google-auth==0.1.3
python-dateutil==2.8.0
pytz==2019.1
requests==2.21.0
requests-oauthlib==1.2.0
rsa==4.0
six==1.12.0
urllib3==1.24.3

Initially I did pip3 install google-cloud-storage, which I assume takes the latest version i.e.. 1.16.0. And since I got the error, i did pip3 install google-cloud-storage==1.10.0 to download a previous version as a work around to this issue.

[tseaver]

Installing the three API libraries (google-cloud-storage, google-cloud-pubsub, and google-cloud-bigquery) into a fresh virtual environment:

$ python3.6 -m venv /tmp/gcp/8085-redux
$ /tmp/gcp/8085-redux/bin/pip install --upgrade pip setuptools wheel
...
Successfully installed pip-19.1.1 setuptools-41.0.1 wheel-0.33.4
$ /tmp/gcp/8085-redux/bin/pip install google-cloud-storage google-cloud-pubsub google-cloud-bigquery
...
Successfully installed cachetools-3.1.1 certifi-2019.3.9 chardet-3.0.4 google-api-core-1.11.1 google-auth-1.6.3 google-cloud-bigquery-1.12.1 google-cloud-core-1.0.1 google-cloud-pubsub-0.41.0 google-cloud-storage-1.16.0 google-resumable-media-0.3.2 googleapis-common-protos-1.6.0 grpc-google-iam-v1-0.11.4 grpcio-1.21.1 idna-2.8 protobuf-3.8.0 pyasn1-0.4.5 pyasn1-modules-0.2.5 pytz-2019.1 requests-2.22.0 rsa-4.0 six-1.12.0 urllib3-1.25.3
$ /tmp/gcp/8085-redux/bin/pip freeze | grep -v "^-f"
cachetools==3.1.1
certifi==2019.3.9
chardet==3.0.4
google-api-core==1.11.1
google-auth==1.6.3
google-cloud-bigquery==1.12.1
google-cloud-core==1.0.1
google-cloud-pubsub==0.41.0
google-cloud-storage==1.16.0
google-resumable-media==0.3.2
googleapis-common-protos==1.6.0
grpc-google-iam-v1==0.11.4
grpcio==1.21.1
idna==2.8
protobuf==3.8.0
pyasn1==0.4.5
pyasn1-modules==0.2.5
pytz==2019.1
requests==2.22.0
rsa==4.0
six==1.12.0
urllib3==1.25.3
$ /tmp/gcp/8085-redux/bin/python
Python 3.6.7 (default, Oct 22 2018, 11:30:50) 
[GCC 5.4.0 20160609] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from google.cloud import storage, pubsub, bigquery
>>> ^D

[gdubicki]

I am having the same issue in a virtualenv with these packages:

(venv) [root@host:/path]# pip freeze
cachetools==3.1.0
certifi==2019.3.9
chardet==3.0.4
google-api-core==1.9.0
google-auth==1.6.3
google-cloud-core==1.0.1
google-cloud-storage==1.16.0
google-resumable-media==0.3.2
googleapis-common-protos==1.5.9
idna==2.8
pipenv==2018.11.26
protobuf==3.7.1
pyasn1==0.4.5
pyasn1-modules==0.2.5
pytz==2019.1
requests==2.21.0
rsa==4.0
six==1.12.0
urllib3==1.24.2
virtualenv==16.5.0
virtualenv-clone==0.5.3
You are using pip version 10.0.1, however version 19.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

[tseaver]

@gdubicki You have an out-of-date version of google-api-core (1.9.0, vs. 1.11.0 which added the needed non-gRPC ClientInfo support). Looks like google-cloud-storage is not pinning that version.

[tseaver]

Oddly, you have google-cloud-core 1.0.1 installed, which does pin that version: I'm not sure how you managed to get to that state.