-
Notifications
You must be signed in to change notification settings - Fork 906
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Speed up e2e-tests locally by skipping environment setup #3527
Conversation
Signed-off-by: Nok <nok.lam.chan@quantumblack.com>
I did a quick test that it doesn't work very well on GitPod yet, locally it works fine. It seems to be a problem of the path of the virtualenv on GitPod. |
features/environment.py
Outdated
|
||
|
||
def _install_project_requirements(context): | ||
return |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this intentional?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
They are not!
Signed-off-by: Nok <nok.lam.chan@quantumblack.com>
…o-org/kedro into noklam/local-speedup-e2e Signed-off-by: Nok <nok.lam.chan@quantumblack.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @noklam, this is pretty cool! :D
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice, super handy for development! Thank you @noklam! 👍
e2e-tests-fast: export BEHAVE_LOCAL_ENV=TRUE | ||
e2e-tests-fast: | ||
behave --tags=-skip --no-capture |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can't this be
e2e-tests-fast: export BEHAVE_LOCAL_ENV=TRUE | |
e2e-tests-fast: | |
behave --tags=-skip --no-capture | |
e2e-tests-fast: | |
BEHAVE_LOCAL_ENV=TRUE behave --tags=-skip --no-capture |
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Description
While e2e-tests aim to simulate a fresh setup, it takes a lot of time to run the test because 95% of the time the tests is building up a new
venv
andpip install
which is unlikely the problem.I introduce a
BEHAVE_LOCAL_ENV
flag to skip this setup and additionally ae2e-tests-fast
command in MAKEFILE. When developer want to quickly run some test, they can choose to enable the flag.However, the CI should always run the full test, this is mainly for local development.
Development notes
Developer Certificate of Origin
We need all contributions to comply with the Developer Certificate of Origin (DCO). All commits must be signed off by including a
Signed-off-by
line in the commit message. See our wiki for guidance.If your PR is blocked due to unsigned commits, then you must follow the instructions under "Rebase the branch" on the GitHub Checks page for your PR. This will retroactively add the sign-off to all unsigned commits and allow the DCO check to pass.
Checklist
RELEASE.md
file