Support for installation from a branch of StreamSets Data Collector #21
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dimaspivak
requested changes
Mar 27, 2018
kirtiv1
force-pushed
the
sdc_install_from_branch
branch
from
7513ffc to
a0d975f
Compare
dimaspivak
requested changes
Mar 30, 2018
images/sdc/Dockerfile
Outdated
|
|
||
| # See http://community.cloudera.com/t5/Cloudera-Manager-Installation/Stop-CM-undistributing-my-parcel/m-p/61402. | ||
| RUN touch "${PARCEL_DIRECTORY}/.dont_delete" | ||
| RUN touch "${PARCEL_REPO_DIRECTORY}/.dont_delete" |
There was a problem hiding this comment.
I think we can remove this (but should do a quick test to be sure)
topology.yaml
Outdated
| --sdc-build: | ||
| help: If specified, the build from which to install StreamSets Data Collector (e.g. of the form "2038" "3.1.0.0" "latest") | ||
| metavar: ver | ||
| --sdc-S3-bucket: |
start.py
Outdated
|
|
||
|
|
||
| def _get(url): | ||
| response = requests.Session().get(url) |
start.py
Outdated
| 'chown cloudera-scm:cloudera-scm /opt/cloudera/csd/STREAMSETS*.jar', | ||
| 'chmod 644 /opt/cloudera/csd/STREAMSETS*.jar', | ||
| 'chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/STREAMSETS_*'] | ||
| primary_node.execute('; '.join(commands)) |
There was a problem hiding this comment.
Might wanna join with && to make sure failing commands kill it.
kirtiv1
force-pushed
the
sdc_install_from_branch
branch
from
a0d975f to
ab5eef0
Compare
|
lgtm +2 |
dimaspivak
pushed a commit
that referenced
this pull request
May 4, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
dimaspivak
pushed a commit
that referenced
this pull request
May 8, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
May 15, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
May 18, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
dimaspivak
pushed a commit
that referenced
this pull request
May 21, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
May 22, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
dimaspivak
pushed a commit
that referenced
this pull request
May 22, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 7, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 14, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 14, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 15, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 20, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 20, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 20, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Jun 20, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Jun 20, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Jun 21, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 21, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Jun 22, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
dimaspivak
pushed a commit
that referenced
this pull request
Jul 6, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Jul 24, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Aug 23, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Aug 31, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Sep 12, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Sep 21, 2018
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Oct 5, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Oct 26, 2018
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Feb 16, 2019
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Mar 19, 2019
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
that referenced
this pull request
Apr 10, 2019
) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 6, 2019
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
kirtiv1
added a commit
to kirtiv1/topology_cdh
that referenced
this pull request
Jun 11, 2019
…lusterdock#21) * Support for installation from a branch of StreamSets Data Collector * Install StreamSets DataCollector parcel using a local parcel repository * Work on review comments, make arguments same across topology.yaml and build_images script * Remove arguments sdc-build, sdc-s3-bucket etc. and just keep sdc-version
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This allows to specify sdc_build and sdc_S3_bucket. Using these two parameters, clusterdock pulls the correct version of SDC and installs it.