Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add %%docker magic to jupyter kernel. #72

Merged
merged 2 commits into from
Nov 6, 2018
Merged

Add %%docker magic to jupyter kernel. #72

merged 2 commits into from
Nov 6, 2018

Conversation

qimingj
Copy link
Contributor

@qimingj qimingj commented Nov 6, 2018

It helps submitting a docker build job more easily with one cell:

%%docker gcr.io/bradley-playground/mytest-image:latest gs://bradley-playground

FROM ubuntu:16.04

RUN apt-get update -y
RUN apt-get install -y -q python-dev python-setuptools

This change is Reviewable

Copy link
Contributor

@gaoning777 gaoning777 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qimingj
Copy link
Contributor Author

qimingj commented Nov 6, 2018

@gaoning777, I need /lgtm and /approve.

@qimingj
Copy link
Contributor Author

qimingj commented Nov 6, 2018

/lgtm

@k8s-ci-robot
Copy link
Contributor

@qimingj: you cannot LGTM your own PR.

In response to this:

/lgtm

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

1 similar comment
@google-prow-robot
Copy link
Collaborator

@qimingj: you cannot LGTM your own PR.

In response to this:

/lgtm

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@qimingj
Copy link
Contributor Author

qimingj commented Nov 6, 2018

/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: qimingj

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@gaoning777
Copy link
Contributor

/lgtm

@k8s-ci-robot k8s-ci-robot removed the lgtm label Nov 6, 2018
@gaoning777
Copy link
Contributor

/lgtm

@qimingj
Copy link
Contributor Author

qimingj commented Nov 6, 2018

/retest

@k8s-ci-robot k8s-ci-robot merged commit 458c817 into master Nov 6, 2018
try:
import IPython
import IPython.core.magic
except ImportError:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This breaks Python's official unittest module when it's applied to our standard layout.

@Ark-kun
Copy link
Contributor

Ark-kun commented Nov 6, 2018

This code does not have any tests for user-facing API.

@Ark-kun
Copy link
Contributor

Ark-kun commented Nov 6, 2018

======================================================================
ERROR: kfp.notebook (unittest.loader._FailedTest)
----------------------------------------------------------------------
ImportError: Failed to import test module: kfp.notebook
Traceback (most recent call last):
  File "/home/travis/build/kubeflow/pipelines/sdk/python/kfp/notebook/_magic.py", line 17, in <module>
    import IPython
ImportError: No module named 'IPython'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/opt/python/3.5.6/lib/python3.5/unittest/loader.py", line 462, in _find_test_path
    package = self._get_module_from_name(name)
  File "/opt/python/3.5.6/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name
    __import__(name)
  File "/home/travis/build/kubeflow/pipelines/sdk/python/kfp/notebook/__init__.py", line 16, in <module>
    from . import _magic
  File "/home/travis/build/kubeflow/pipelines/sdk/python/kfp/notebook/_magic.py", line 20, in <module>
    raise Exception('This module can only be loaded in Jupyter.')
Exception: This module can only be loaded in Jupyter.
----------------------------------------------------------------------
Ran 45 tests in 0.848s
FAILED (errors=1, expected failures=10)
The command "python3 -m unittest --verbose" exited with 1.

k8s-ci-robot pushed a commit that referenced this pull request Nov 7, 2018
* Moves docs from the /samples README to the wiki

I've copied all the info from the googleprivate/samples README.md to the wiki. This PR removes most of the content from the README, adds a simple introduction, and points people to the wiki docs for further information.

Relevant wiki files:
https://github.com/kubeflow/pipelines/wiki/Deploy-the-Kubeflow-Pipelines-Service
https://github.com/kubeflow/pipelines/wiki/Build-a-Pipeline
https://github.com/kubeflow/pipelines/wiki/Build-Your-Own-Component

* SDK/Tests/Components - Improve temporary file handling (#37)

* Improve temporary file handling in python op tests

* More small temp path fixes

* Fix tfx name bug in the tfma sample test (#67)

* fix tfx name bug

* update release build for the data publish

* SDK/DSL/Compiler - Fixed compilation of dsl.Condition (#28)

* Fixed compilation of dsl.Conditional
The compiler no longer produced intermediate steps.

* Got rid of _create_new_groups

* Changed the sub_group.type check

* Fix tfx name bug in the tfma sample test (#67)

* fix tfx name bug

* update release build for the data publish

* Build Python SDK in the releasing (#70)

* publish python sdk in the cloud build

* update cloudbuild

* adjust output path

* add dependency for buildapiserver

* mlp -> kfp.dsl (#88)

* Removed instruction to clone the repo.

* Changed link to samples doc on wiki.

* Add %%docker magic to jupyter kernel. It helps submitting a docker build job more easily with one cell. (#72)

* fix miscellaneous List API issue (#90)

* fix

* Update job_store.go

* Update run_store.go

* Update presubmit-tests.sh

* Update job_store.go

* Moves docs from pipelines main README to wiki (#83)

I've copied all the info from the kubeflow/pipelines README.md to the wiki. This PR removes most of the content from the README, adds a simple introduction, and points people to the wiki docs for further information.

Relevant wiki files:
https://github.com/kubeflow/pipelines/wiki
https://github.com/kubeflow/pipelines/wiki/Deploy-the-Kubeflow-Pipelines-Service
https://github.com/kubeflow/pipelines/wiki/Build-a-Pipeline

* SDK/DSL/Compiler - Reverted fix of dsl.Condition until the UI is ready. (#94)

* sort by run display name by default (#96)

* CSS changes for nav menu and tables (#99)

* debug tfma failure (#91)

* debug tfma failure

* tft version bug

* minor fix

* comment the test validation

* Fix validation check for maximum size limit (#104)

* Fixed the Minikube tests after moving to the new repo (#98)

* Don't barf when experiment name is already used (#101)

* don't barf when experiment name is already used

* make mock backend use case insensitive names

* ExperimentList tests, use immer.js (#86)

* experiment list tests

* use produce in more places

* remove extra test

* remove extra import

* Use the experiment's resource reference in the listJobs request (#105)

* use the experiment's resource reference in the listJobs request

* fix test import

* Add Ning and Alexey to OWNERS for components, samples and sample-test (#102)

* Compile samples instead of hard code them in API server (#76)

* compile samples

* update logging

* update description

* update sample

* add immediate value sample

* revert

* fail fast if the samples are failed to load

* comment

* address comments

* comment out

* update command

* comments

* Account for padding in metric progress fill (#107)

* Account for padding in metric progress fill

* small mock backend fix

* move to css classes, add color

* changes to breadcrumb style

* increase width of summary card

* tests

* merge tests

* First integration test for the ML Pipeline CLI (Pipeline List). (#81)

* First integration test for the ML Pipeline CLI (Pipeline List).

* Fixing an issue with an undefined variable

* Adding the --debug flag to help with debugging.

* Changing the namespace to Kubeflow.

* Add tests for the NewExperiment page (#109)

* Add tests for the NewExperiment page

* Fix test name

* Remove obsolete tests

* Clean up

* add xgboost: migrate from the old repo (#46)

* migrate from the old repo

* fix bug: accidentally override tfma test

* add tfma test back

* add tfma back

* typo fix

* fix small typo

* if job fails, exit after logs are output

* Remove CMLE sample for now since we are waiting for a service fix to support TPU. (#113)

* image tag update for release (#114)

* update image tag for new releases

* add more

* delete the accidentaly added sample

* fix typo (#116)

* Fix an issue that %%docker doesn't work. (#119)

* updated favicon to monochrome color (#118)

* Expanded row changes (#120)

* updated favicon to monochrome color

* simple CSS changes to expanded row

* Removed mentions of ark7 in tests (#111)

* Add basic sample tests (#79)

* add sequential sample test

* add condition basic sample

* reuse script

* add all the other basic tests

* update sample test dockerfile to add run_basic_test file

* write test output

* typo bug
@qimingj qimingj deleted the docker branch November 8, 2018 01:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants