add e2e notebook tests

[briangallagher]

What this PR does / why we need it:
Add e2e tests to ensure that the sdk is still compatible with the latest version of trainer.

Which issue(s) this PR fixes (optional, in Fixes #<issue number>, #<issue number>, ... format, will close the issue(s) when PR gets merged):

Fixes #18

Checklist:

• Docs included if any changes are user facing

[google-oss-prow]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign andreyvelich for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[briangallagher]

@andreyvelich Can you approve this workflow?

[Electronic-Waste]

/ok-to-test
/rerun-all

[kramaranya]

We don't have go.mod in sdk repo, could just set a fallback value?

[briangallagher]

yes, will set to current version, v0.27.0, thanks

[kramaranya]

Those should be imported from trainer repo, right?

Suggested change

	NOTEBOOK_INPUT=./examples/training/pytorch/image-classification/mnist.ipynb \
	NOTEBOOK_OUTPUT=./artifacts/notebooks/${{ matrix.kubernetes-version }}_mnist.ipynb \
	PAPERMILL_TIMEOUT=900
	make test-e2e-notebook \
	NOTEBOOK_INPUT=./examples/training/pytorch/question-answering/fine-tune-distilbert.ipynb \
	NOTEBOOK_OUTPUT=./artifacts/notebooks/${{ matrix.kubernetes-version }}_fine-tune-distilbert.ipynb \
	NOTEBOOK_INPUT=./trainer/examples/pytorch/image-classification/mnist.ipynb \
	NOTEBOOK_OUTPUT=./artifacts/notebooks/${{ matrix.kubernetes-version }}_mnist.ipynb \
	PAPERMILL_TIMEOUT=900
	make test-e2e-notebook \
	NOTEBOOK_INPUT=./trainer/examples/pytorch/question-answering/fine-tune-distilbert.ipynb \
	NOTEBOOK_OUTPUT=./artifacts/notebooks/${{ matrix.kubernetes-version }}_fine-tune-distilbert.ipynb \

[briangallagher]

@Electronic-Waste @andreyvelich Workflow is waiting approval again.
Also, I think it got stuck in the queue the last time because the workflow is requesting ubuntu-latest-16-cores
I copied this config from the trainer repo so I presume it will be required to execute the notebooks successfully?
Can this 16 core image be approved and configured?

[tenzen-y]

@Electronic-Waste @andreyvelich Workflow is waiting approval again. Also, I think it got stuck in the queue the last time because the workflow is requesting ubuntu-latest-16-cores I copied this config from the trainer repo so I presume it will be required to execute the notebooks successfully? Can this 16 core image be approved and configured?

Done.

[tenzen-y]

@kubeflow/kubeflow-steering-committee could you enable this instance in this repository as well as other repositories?