Why pip install don't cache packages?

[hongyi-zhao]

Hi,

With the following environment:

$ pip --version
pip 20.0.2 from /home/werner/.pyenv/versions/3.8.1/envs/test1/lib/python3.8/site-packages/pip (python 3.8)

Tested with the following steps:

(test1) werner@ubuntu-01:~$ pip install six
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting six
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/eb/1f97cb97bfc2390a276969c6fae16075da282f5058082d4cb10c6c5c1dba/six-1.14.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: six
Successfully installed six-1.14.0

(test1) werner@ubuntu-01:~$ pip uninstall six
Found existing installation: six 1.14.0
Uninstalling six-1.14.0:
  Would remove:
    /home/werner/.repo/github.com/pyenv/versions/linux-x86_64/3.8.1/envs/test1/lib/python3.8/site-packages/six-1.14.0.dist-info/*
    /home/werner/.repo/github.com/pyenv/versions/linux-x86_64/3.8.1/envs/test1/lib/python3.8/site-packages/six.py
Proceed (y/n)? y
  Successfully uninstalled six-1.14.0

(test1) werner@ubuntu-01:~$ pip install six
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Collecting six
  Downloading https://pypi.tuna.tsinghua.edu.cn/packages/65/eb/1f97cb97bfc2390a276969c6fae16075da282f5058082d4cb10c6c5c1dba/six-1.14.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: six
Successfully installed six-1.14.0

As you can see, when I run ``pip install'' for the second time, it will re-downloading the package instead of using the local cache.

And I also cannot find the downloaded package at the following location:

(test1) werner@ubuntu-01:~$ find ~/.cache/pip -type f -name 'six-1.14.0-py2.py3-none-any.whl'
(test1) werner@ubuntu-01:~$ 

Any hints?

Regards

[NoahGorny]

I suspect it has something to do with your index being insecure due to bad certs/old TLS.
Currently pip does not cache from insecure origins even if they are specified as "trusted hosts"

See #7847 and the PR I made to solve it #7885
Feel free to voice your opinion on the matter 😄

[duckinator]

I'm having this problem on FreeBSD 13.0 with no pip config whatsoever, meaning it's using the default configuration. This means it should be using https://pypi.org.

~$ pip3 --version
pip 21.2.4 from /home/puppy/.local/lib/python3.8/site-packages/pip (python 3.8)
~$ pip3 config debug
env_var:
env:
global:
  /etc/xdg/pip/pip.conf, exists: False
  /etc/pip.conf, exists: False
site:
  /usr/local/pip.conf, exists: False
user:
  /home/puppy/.pip/pip.conf, exists: False
  /home/puppy/.config/pip/pip.conf, exists: False
~$ pip3 cache info
Package index page cache location: /usr/home/puppy/.cache/pip/http
Package index page cache size: 87 kB
Number of HTTP files: 6
Wheels location: /usr/home/puppy/.cache/pip/wheels
Wheels size: 0 bytes
Number of wheels: 0
~$ pip3 cache list
Nothing cached.
~$ pip3 install emanate
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: emanate in ./.local/lib/python3.8/site-packages (7.0.0)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
~$ pip3 cache list
Nothing cached.

I also have no idea why it's insisting I'm running pip as root, since I'm not. But I'm pretty sure that's a separate problem.

[pradyunsg]

What's the output of pip3 debug and env | grep "PIP_"?

[duckinator]

pip3 debug --verbose:

WARNING: This command is only meant for debugging. Do not use this with automation for parsing and getting these details, since the output and options of this command may change without notice.
pip version: pip 21.3.dev0 from /usr/home/puppy/dev/duckinator/pip/src/pip (python 3.8)
sys.version: 3.8.10 (default, Jul  4 2021, 01:12:00) 
[Clang 11.0.1 (git@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c
sys.executable: /usr/home/puppy/dev/duckinator/pip/venv/bin/python3
sys.getdefaultencoding: utf-8
sys.getfilesystemencoding: utf-8
locale.getpreferredencoding: UTF-8
sys.platform: freebsd13
sys.implementation:
  name: cpython
'cert' config value: Not specified
REQUESTS_CA_BUNDLE: None
CURL_CA_BUNDLE: None
pip._vendor.certifi.where(): /usr/home/puppy/dev/duckinator/pip/src/pip/_vendor/certifi/cacert.pem
pip._vendor.DEBUNDLED: False
vendored library versions:
  appdirs==1.4.4
  CacheControl==0.12.6
  colorama==0.4.4
  distlib==0.3.2
  distro==1.6.0
  html5lib==1.1
  msgpack==1.0.2 (Unable to locate actual module version, using vendor.txt specified version)
  packaging==21.0
  pep517==0.11.0
  progress==1.5
  pyparsing==2.4.7
  requests==2.26.0
  certifi==2021.05.30
  chardet==4.0.0
  idna==3.2
  urllib3==1.26.6
  resolvelib==0.7.1
  setuptools==44.0.0 (Unable to locate actual module version, using vendor.txt specified version)
  six==1.16.0
  tenacity==8.0.1 (Unable to locate actual module version, using vendor.txt specified version)
  tomli==1.0.3
  webencodings==0.5.1 (Unable to locate actual module version, using vendor.txt specified version)
Compatible tags: 30
  cp38-cp38-freebsd_13_0_release_p1_amd64
  cp38-abi3-freebsd_13_0_release_p1_amd64
  cp38-none-freebsd_13_0_release_p1_amd64
  cp37-abi3-freebsd_13_0_release_p1_amd64
  cp36-abi3-freebsd_13_0_release_p1_amd64
  cp35-abi3-freebsd_13_0_release_p1_amd64
  cp34-abi3-freebsd_13_0_release_p1_amd64
  cp33-abi3-freebsd_13_0_release_p1_amd64
  cp32-abi3-freebsd_13_0_release_p1_amd64
  py38-none-freebsd_13_0_release_p1_amd64
  py3-none-freebsd_13_0_release_p1_amd64
  py37-none-freebsd_13_0_release_p1_amd64
  py36-none-freebsd_13_0_release_p1_amd64
  py35-none-freebsd_13_0_release_p1_amd64
  py34-none-freebsd_13_0_release_p1_amd64
  py33-none-freebsd_13_0_release_p1_amd64
  py32-none-freebsd_13_0_release_p1_amd64
  py31-none-freebsd_13_0_release_p1_amd64
  py30-none-freebsd_13_0_release_p1_amd64
  cp38-none-any
  py38-none-any
  py3-none-any
  py37-none-any
  py36-none-any
  py35-none-any
  py34-none-any
  py33-none-any
  py32-none-any
  py31-none-any
  py30-none-any

Also, that line starting with [Clang was copied in its entirety. It has no closing ) or ] as one would expect.

env | grep "PIP_" returns nothing.

[no-response]

This issue has been automatically closed because there has been no response to our request for more information from the original author. With only the information that is currently in the issue, we don't have enough information to take action. Please reach out if you have or find the answers we need so that we can investigate further.

[duckinator]

@pradyunsg can this be reopened? I've had the same problem and included the information that was asked for.