Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

'pip install -r requirements' often fail in CI checks on master branch #1867

Closed
anmyachev opened this issue Jul 30, 2020 · 4 comments · Fixed by #1868
Closed

'pip install -r requirements' often fail in CI checks on master branch #1867

anmyachev opened this issue Jul 30, 2020 · 4 comments · Fixed by #1868
Assignees
@anmyachev
Labels
bug 🦗 Something isn't working

Comments

@anmyachev
Copy link
Collaborator

Error message looks like:
ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE...

We need to establish CI checks as much as possible.
First of all, we probably should use pip install with --no-cache-dir option.

Example commits from master of last day with same problem:
@anmyachev anmyachev added the bug 🦗 Something isn't working label Jul 30, 2020
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: add '--no-cache-dir' option
2a2f3ce 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev anmyachev mentioned this issue Jul 30, 2020
Merged
6 tasks
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: use 'pip cache purge'
2119aeb 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: use pip cache list
bc685cd 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: remove purge usage
5ea4819 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: upgrade pip
3024acf 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: upgrade setuptools and wheel also
b82c283 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev anmyachev self-assigned this Jul 30, 2020
@anmyachev
Copy link
Collaborator Author

It's seems that pytest-testmon doesn't properly working.

testmon: collection automatically deactivated because it's not compatible with coverage.py, changed files: 8, skipping collection of 30 files, environment: default

@anmyachev
Copy link
Collaborator Author

The problem is not caching, because errors were reproduced even in the case of a disabled cache.

anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: remove '--no-cache-dir' option; upgrade pip; …
c896e55 
…pin pytest<6

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@devin-petersohn
Copy link
Collaborator

@anmyachev I have noticed this issue over the past week or so. Restarting CI can sometimes fix it. I cannot find the source of the issue.

Maybe we should just miniconda? https://github.com/marketplace/actions/setup-miniconda

anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: use setup-python@2; use checkout@v2
4ed57db 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: add pip list
4bd5102 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: use 2020-resolver feature
bfa8aa1 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: remove extra command
880bc8f 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 30, 2020
@anmyachev
FIX-modin-project#1867: install pyarrow explicitly
18207ff 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: add verbose mode
a415d60 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: try to use setup-miniconda action
9e6e289 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: remove setup-python action
d0b6ee8 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: fix test-api
8d7ce4a 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: add test-all, test-windows, test-pyarrow with…
52e4ba5 
… conda usage

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: try to use cache
2fad256 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: add some options for proper cache usage
67e378b 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: add pip cache
86a4b8d 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
@anmyachev
Copy link
Collaborator Author

@anmyachev I have noticed this issue over the past week or so. Restarting CI can sometimes fix it. I cannot find the source of the issue.

Maybe we should just miniconda? https://github.com/marketplace/actions/setup-miniconda

Thanks @devin-petersohn! Usage conda action with cache action seems to me a good solution for establish CI. Need more testing.

anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: work with coverage inside modin environment
970ebbf 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: fix CACHE_NUMBER setup for 'Cache pip' step
2671880 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Jul 31, 2020
@anmyachev
FIX-modin-project#1867: return 'requirements.txt' for teamcity tests
663db73 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 1, 2020
@anmyachev
FIX-modin-project#1867: fix coverage report name on windows
87102e6 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 1, 2020
@anmyachev
FIX-modin-project#1867: add tests for python 3.8
d6edee1 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 1, 2020
@anmyachev
FIX-modin-project#1867: use unix-like separator for codecov on Windows
031b10d 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: try to use 'github.run_id' for cache key
7b7e563 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: add include option for coverage
ed5fdeb 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: update push.yml
d18daa1 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: test if condition
ae33bf6 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: fix cache pip
23e0da7 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: remove auto-activate-base option
9a64063 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 2, 2020
@anmyachev
FIX-modin-project#1867: remove pytest_custom-exit-code
ba4797d 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: update test-experimental
95ac6b6 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: remove auto-update-conda option for ubuntu
7609a07 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: add prepare-cache job to ci.yml
af23f3b 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: fix needs
7fd6919 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: fix yml syntax
7a6383e 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: change if condition
ab60ee5 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: return python3.7 for test API
1b30bbb 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: use runner.os for key name
8f72b9e 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: skip tests only on Windows
9a92f9d 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue Aug 3, 2020
@anmyachev
FIX-modin-project#1867: remove Cache conda step
8ae3eae 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
devin-petersohn pushed a commit that referenced this issue Aug 3, 2020
@anmyachev
FIX-#1867: establish CI (#1868)
e640ecd 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
aregm pushed a commit to aregm/modin that referenced this issue Sep 16, 2020
@anmyachev @aregm
FIX-modin-project#1867: establish CI (modin-project#1868)
2fc06d3 
Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@anmyachev anmyachev

Labels
bug 🦗 Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

FIX-#1867: establish CI anmyachev/modin
2 participants
@devin-petersohn @anmyachev