Supporting out-of-tree drivers on OpenShift

[zvonkok]

Support out-of-tree drivers on OpenShift for enabling custom hardware and third-party kernel modules on container and non-container based operating systems.

In OpenShift v3.x out-of-tree drivers could be easily installed on the nodes, since the node was a full RHEL node with a subscription and needed tools were installed easily with yum.
In OpenShift v4.x this changed with the introduction of RHCOS. There are currently two different documented ways to enable out-of-tree drivers. One way is using an SRO based operator such as the nvidia GPU operator and the other is using kmods-via-containers.
We want to come up with a unified solution that works for our customers across RHCOS and RHEL. The solution should also help customers that are currently on RHEL7 to consider moving to RHCOS which is fully managed and easier to support in OpenShift.

(As a side note we had DriverContainers running with OCP-3.11 on AtomicHost)

[zvonkok]

@zshi-redhat PTAL

[zvonkok]

/cc @fepan @derekwaynecarr @dustymabe @cgwalters @eparis

[ashcrow]

/cc @darkmuggle

[zvonkok]

Depends on: #384 #389 #363

[openshift-ci]

@zvonkok: The following test failed, say /retest to rerun all failed tests:

Test name	Commit	Details	Rerun command
ci/prow/markdownlint	0185308	link	/test markdownlint

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[SchSeba]

small comment

[SchSeba]

some of the environments that need OOT drivers are in disconnected environments will it be reasonable to add the ability to use a container image as a container for the driver source?

[zvonkok]

See CR section artifacts: from Claim, Image or HostPath