Add basic CLI for test infra

[eliorerz]

CLI tool for test-infra:
Supported commands:

• help - Print a list of all supported commands
• list clusters - List available clusters (name and id)
• test - execute test function. Format: test <test_file> <test_name> - autocomplete all fields
• clear - clear CLI

/cc @eliorerz

test-infra-cli-demo.mp4

[openshift-ci]

@eliorerz: GitHub didn't allow me to request PR reviews from the following users: eliorerz.

Note that only openshift members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to this:

/cc @eliorerz

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[eliorerz]

/test ?

[eliorerz]

/retest

[osherdp]

partial review

[osherdp]

Seems like we're doing something wrong here, rather than instantiating it somewhere top-level and propagating it anywhere needed
Can we handle it some other way?

[eliorerz]

We are, but we can't change global_variables behavior.
Our assumption was that the container is executed once per set of tests with n environment variables.
In this case we are triggering the test directly from code and not from pytest-cli-command, so when the test-infra CLI is triggers the test, it will not update the global_variables with the actual env vars values.

[osherdp]

__all__ looks to be related to some kind of known magic function in Python, which isn't the case I think
I'll suggest:

Suggested change

	@classmethod
	def __all__(cls):
	return [cls.OpenShiftSDN, cls.OVNKubernetes]
	@classmethod
	def all(cls):
	return [cls.OpenShiftSDN, cls.OVNKubernetes]

[osherdp]

Same for other enums
(btw, why not just use enums? then it's just list(NetworkType) or however you want to iterate over it)

[eliorerz]

I think we should changed that.
A while back I suggested that and there was some resistance to change those classes to Enum due to the need to access the value with extra action. e.g. NetworkType.OpenShiftSDN.value

[eliorerz]

/retest

[openshift-ci]

@eliorerz: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-metal-assisted-multi-version-suite	7a33610	link	false	/test e2e-metal-assisted-multi-version-suite
ci/prow/e2e-metal-assisted-4.6	77a16a5	link	false	/test e2e-metal-assisted-4.6
ci/prow/e2e-metal-assisted-kube-api-late-binding-single-node	5a19baa	link	false	/test e2e-metal-assisted-kube-api-late-binding-single-node

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: eliorerz, osherdp

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [eliorerz,osherdp]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment