Add datasets image to Operate First

[pacospace]

Is your feature request related to a problem? Please describe.
As Thoth contributor,

I want to learn about Thoth datasets directly from Operate First, spawning an image in JH.

As Thoth Maintainer,
I would like to publish datasets about knowledge collected by Thoth and make it available in Operate First.

Describe the solution you'd like
Move datasets to Ceph Public Bucket on Operate First and modify notebooks to retrieve data from there (remove git LFS dependency). At the end add the new image created to Operate First to be spawned.

Tasks:

• Learn how to access notebooks in JupyterHub[1] available through Open Data Hub [8] on Operate First [2] spawning Experimental Elyra image and learn about Thoth datasets [3].
• Verify/Request the credentials of the public bucket available on Operate First.
• Place datasets on that bucket under thoth/datasets/{dataset-name} using aws/s3 CLI [4] from your local terminal.
• Modify notebooks to retrieve data from s3 instead of using local datasets.
• Push changes to thoth-station/datasets using Git extension [5].
• Create a release using Kebechet [6] and AICoE-CI [7]
• Add image to JupyterHub list of images, so that users can learn about thoth datasets.
• Demo

References:

• [1] https://jupyter.org/hub
• [2] https://www.operate-first.cloud/
• [3] https://github.com/thoth-station/datasets
• [4] https://aws.amazon.com/it/cli/
• [5] https://github.com/jupyterlab/jupyterlab-git
• [6] https://github.com/thoth-station/kebechet
• [7] https://github.com/AICoE/aicoe-ci
• [8] https://opendatahub.io/

[goern]

/kind feature
/kind demo
/assign @tumido
/sig user-experience

[pacospace]

/kind feature
/kind demo
/assign @tumido
/sig user-experience

@goern this requires the extension of S2I builds to handle GIT LFS, cc @harshad16 @sub-mod. It is something we will need for the predictabe deployment pipeline as well.

[goern]

sounds like a good feature request.

/label triage/needs-information

what needs to be added? is there an issue with s2i-thoth repo?

[sesheta]

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

/lifecycle rotten

[pacospace]

/remove-lifecycle rotten

[sesheta]

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

/close

[sesheta]

@sesheta: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[pacospace]

• Move datasets to public Ceph on Operate First
• Adjust notebooks to use those instead of local files.

[sesheta]

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

/close

[sesheta]

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

/lifecycle rotten

[sesheta]

@sesheta: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[goern]

/help
/label hacktoberfest

[sesheta]

@goern:
This request has been marked as needing help from a contributor.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/help
/label hacktoberfest

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[sesheta]

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[goern]

/remove-lifecycle stale

@pacospace @mayaCostantini could you please update the status of this one?

[mayaCostantini]

@goern I think the two last acceptance might not be completed yet,

• Add image to JupyterHub list of images, so that users can learn about thoth datasets.
• Demo

The first one depending on if we would like to have a meteor compatible and/or an image always available in the spawner on JupyterHub, wdyt?

[goern]

ja, I think we should have it visible.

/priority important-soon

[sesheta]

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[sesheta]

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

/lifecycle rotten

[harshad16]

/remove-lifecycle rotten
/lifecycle frozen