Skip to content

Use our build-repo to cache NPM dependencies #1219

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 25, 2025
Merged

Use our build-repo to cache NPM dependencies #1219

merged 1 commit into from
Jul 25, 2025

Conversation

lfrancke
Copy link
Member

@lfrancke lfrancke commented Jul 24, 2025

Description

We're already using our mirror to cache Maven dependencies.
This uses the same mirror for NPM dependencies.

I tried building all of these and they worked:

  • Airflow
  • Druid
  • HBase
  • Hadoop HDFS
  • Hive
  • Kafka
  • NiFi
  • Spark
  • Superset
  • Trino
  • ZooKeeper
  • OPA

Definition of Done Checklist

  • Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
  • Add an entry to the CHANGELOG.md file

How I tested this

I did apply the patch and built all images in all versions. They all succeeded so I'm sure that things have not gotten worse. At the same time I tailed the logs for our build-repo server and saw accesses to the NPM mirror. As we're not using that mirror anywhere else I'm fairly certain that these requests must be coming from me.

As a side-effect I also built a spike which introduces a proxy in our build process which can intercept these calls. The branch is available here https://github.com/stackabletech/docker-images/tree/feat/proxy but I did not test it with this yet. That's for the future. This is purely informational and this branch is NOT READY for use.

After these tests I'm convinced that the mirroring will work for at least some projects and it does not break any of them.

@lfrancke lfrancke moved this to Development: In Progress in Stackable Engineering Jul 24, 2025
@lfrancke lfrancke marked this pull request as ready for review July 24, 2025 18:40
@lfrancke lfrancke moved this from Development: In Progress to Development: Waiting for Review in Stackable Engineering Jul 24, 2025
@maltesander maltesander self-requested a review July 25, 2025 15:03
@maltesander maltesander moved this from Development: Waiting for Review to Development: In Review in Stackable Engineering Jul 25, 2025
@lfrancke lfrancke enabled auto-merge July 25, 2025 15:18
Copy link
Member

@maltesander maltesander left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@lfrancke lfrancke added this pull request to the merge queue Jul 25, 2025
Merged via the queue into main with commit f8e41f1 Jul 25, 2025
3 checks passed
@lfrancke lfrancke deleted the feat/cache-npm branch July 25, 2025 16:31
@lfrancke lfrancke moved this from Development: In Review to Development: Done in Stackable Engineering Jul 29, 2025
@lfrancke lfrancke moved this from Development: Done to Done in Stackable Engineering Aug 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

2 participants