feat: connect client image includes JupyterLab #1071
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
razvan
moved this from Development: In Progress
to Development: Waiting for Review
in Stackable Engineering
|
Is this image used for every spark connect application? |
It is used for tests and demos as a client of the spark connect server. |
|
Okay, thanks. We need to make sure that this image is not meant for production and is not part of our product. I haven't looked at the docs yet or how it's used. That's my only concern. |
This comment was marked as resolved.
This comment was marked as resolved.
razvan
moved this from Development: Waiting for Review
to Development: Done
in Stackable Engineering
labrenbe
pushed a commit
that referenced
this pull request
May 8, 2025
* feat: install demo dependencies * spark-connect-client is now built directly off of spark-k8s * run pre-commit hooks * fix shellcheck sc2102
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 19, 2025
* build nifi-opa-plugin from source with workaround * add changelog entry * add patch * build nifi-opa-plugin from branch feat/reworked-opa-response * Update nifi/Dockerfile Co-authored-by: Malte Sander <malte.sander.it@gmail.com> * chore(⏲): Use fast download mirrors (#1061) * chore: Use fast download mirrors * chore: Show download progress bar * chore: Improve gpg key warning message * chore: Show upload progress bar Thanks to <https://bashupload.com/how_to_upload_progress_curl> * Apply suggestions from code review Co-authored-by: Techassi <sascha.lautenschlaeger@stackable.tech> * chore: Make output more consistent --------- Co-authored-by: Techassi <sascha.lautenschlaeger@stackable.tech> * chore(⏲): Add missing tool update tasks to templates (#1062) * chore(issue_templates): Use YY.M.X placeholders * chore(issue_templates): Remove tasklists :sob: * chore(issue_templates): Add missing tool update tasks for cyclonedx and auditable * feat: move patch apply logic to patchable (#1032) * wip * Update druid/Dockerfile Co-authored-by: Natalie Klestrup Röijezon <nat@nullable.se> * fix: remove unnecessary check / shadow repo root var * fix: druid src path * fix: druid src path * feat: introduce stackable-devel image * fix: use PathBuf in ProductVersionContext * chore: align zookeeper patch directory structure * fix: stackable-devel dnf and shell config * chore: switch patch process in other products * fix: hive build * fix: trino build * fix: spark build * chore: make hadolint happy * fix: remove hbase intermediate sources / remove unnecessary and operator * fix: permissions in patchable build process * chore: remove unnecessary curl command in build process * chore: move adding of JMX config and start-metastore script from builder stage to final stage * chore: remove git repo in trino and hbase-operator-tools to avoid maven commit plugin bug --------- Co-authored-by: Natalie Klestrup Röijezon <nat@nullable.se> * fix: add missing patchable config for Kafka 3.8.0 (#1065) * fix(pr-template): Fix the rendering of the list (#1073) * feat: make image namespace a workflow input (default sdp) (#1072) * feat: make image namespace a workflow input (default sdp) * feat: add registry namespace input to build workflows and remove default * ci(mirror): Include image name and version in run-name (#1089) * ci(mirror): Include image and version in run-name * chore: Use colon * fix: spark connect client Harbor credentials (#1088) * fix: spark connect client Harbor credentials (#1092) * feat: connect client image includes JupyterLab (#1071) * feat: install demo dependencies * spark-connect-client is now built directly off of spark-k8s * run pre-commit hooks * fix shellcheck sc2102 * chore: Bump tools ahead of 25.7.0 (#1090) * chore(jmx_exporter): Bump products to use 1.2.0 * chore(tools): Bump kubectl (1.33.0 and yq (4.45.2) * chore(cyclonedx-bom): Bump to 6.0.0 * chore: Update changelog * chore: Changelog formatting * chore(java): Add JDK 24 (#1097) * chore(java): Add JDK 24 * chore: Update changelog * chore(vector): Bump to 0.46.1 (#1098) * chore(vector): Bump to 0.46.1 * chore(vector): Bump products to use 0.46.1 * chore(zookeeper): Remove 3.9.2 (#1093) * chore: Changelog formatting * chore(zookeeper): Remove 2.9.2 * chore: Update changelog * chore: Update changelog * chore(ubi-rust-builders): Update container images ahead of Stackable Release 25.7.0 (#1091) * chore(ubi-rust-builders): Remove ubi8-rust-builder * chore(ubi-rust-builders): Update base image and use protoc 30.2 * Apply suggestions from code review Co-authored-by: Techassi <sascha.lautenschlaeger@stackable.tech> Co-authored-by: Sebastian Bernauer <sebastian.bernauer@stackable.de> --------- Co-authored-by: Techassi <sascha.lautenschlaeger@stackable.tech> Co-authored-by: Sebastian Bernauer <sebastian.bernauer@stackable.de> * chore(opa): Update versions ahead of 25.7.0 (#1103) * chore(opa): Remove 0.67.1 * chore(opa): Remove legacy bundle-builder * chore(opa): Bump ubi9 base image * chore(opa): Add 1.4.2 * fix(opa): Manually install Go version NOTE: The dnf package was 1.23.6 and OPA required 1.23.8 NOTE: I tried making the version paramaterized, but bake wouldn't allow it (it worked fine with `docker build` and `docker build xbuild`). * ci(mirror): Add golang * chore(opa): Use mirrored golang image * chore(opa): Parameterise golang container version * chore: Update changelog * fix: Bump vector to 0.46.1 for java-base:24 (#1104) * chore(superset): Add 4.1.2 (#1102) * chore(superset): Add 4.1.2 * fix(superset): Remove invalid parts of the file * chore: Update changelog * feat(nifi): Add nifi-iceberg-bundle (#1060) * feat(nifi): Add nifi-iceberg-bundle * changelog * Add SBOM to final image * Use version 0.0.1 * hadolint * Bump to 0.0.2 * Bump to 0.0.3 * fix(nifi): Delete correct intermediate folder (#1106) * fix(nifi): Delete correct intermediate folder * changelog * fix Dockerfile * build nifi opa plugin from tag * Update CHANGELOG.md Co-authored-by: Malte Sander <malte.sander.it@gmail.com> * fix hadolint * Update nifi/Dockerfile Co-authored-by: Malte Sander <malte.sander.it@gmail.com> --------- Co-authored-by: Malte Sander <malte.sander.it@gmail.com> Co-authored-by: Nick <10092581+NickLarsenNZ@users.noreply.github.com> Co-authored-by: Techassi <sascha.lautenschlaeger@stackable.tech> Co-authored-by: Lukas Krug <lukas.voetmand@stackable.tech> Co-authored-by: Natalie Klestrup Röijezon <nat@nullable.se> Co-authored-by: Razvan-Daniel Mihai <84674+razvan@users.noreply.github.com> Co-authored-by: Sebastian Bernauer <sebastian.bernauer@stackable.de>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Part of: stackabletech/spark-k8s-operator#284
Required for stackabletech/demos#209