Pin pip < 23.2 and Port unit tests, lint and e2e tests to Github Actions unblock CI

[ankatiyar]

NOTE: Kedro datasets are moving from kedro.extras.datasets to a separate kedro-datasets package in
kedro-plugins repository. Any changes to the dataset implementations
should be done by opening a pull request in that repository.

Description

To unblock the CI 😄

Development notes

• pinned version for pip ->pip<23.2
• kedro-tests.yml calls the tests in lint-tests.yml, unit-tests.yml and e2e-tests.yml
• kedro-docs-only.yml calls lint-tests.yml for python 3.7-3.10

Checklist

• Read the contributing guidelines
• Opened this PR as a 'Draft Pull Request' if it is work-in-progress
• Updated the documentation to reflect the code changes
• Added a description of this change in the RELEASE.md file
• Added tests to cover my changes

[noklam]

I love how the setup is so much shorter on Github Action and it's easier to refactor the logic into smaller files.

[ankatiyar]

@merelcht @noklam Maybe this needs to be removed somewhere -> ci/circleci: all_circleci_checks_succeeded

[merelcht]

@merelcht @noklam Maybe this needs to be removed somewhere -> ci/circleci: all_circleci_checks_succeeded

Yes I need to change this on the repo settings. In standup I think we decided to keep the circleci builds for the time being, but just not make them required right?

[ankatiyar]

Yes I need to change this on the repo settings. In standup I think we decided to keep the circleci builds for the time being, but just not make them required right?

Yeah, I had already created a commit 😅 so I just wanted to check if the tests are working as expected before I add it back in. Reverting the change to continue_config.yml now.

[noklam]

Yes - I am confident the Github Action works, but just to stay on the safe side, we will keep Github Action & CircleCI run in parallel, but remove the checks from CircleCI. @merelcht

[astrojuanlu]

Left a few comments, so excited about this 🙌

[astrojuanlu]

Maybe redundant with Read the Docs?

[ankatiyar]

Following the current behaviour for now. I think read the docs errors are very hard to find 😅

[merelcht]

Minor nitpicks: I would probably rename kedro-tests.yml to something like all-checks.yml so it's obvious this is not just running tests but also linting, and I'd rename lint-tests.yml to just lint.yml because now to me it sounds like lint-tests.yml does linting on the tests rather than linting everything.

[merelcht]

Great work, thanks @ankatiyar ⭐ 💪 Probably also worth mentioning this in the release notes for our own reference.

[astrojuanlu]