Skip to content

Fetch packages from package-storage #21

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
May 18, 2020

Conversation

mtojek
Copy link
Contributor

@mtojek mtojek commented May 13, 2020

Changes:

  • modify the mage build to include packages from package-storage
  • allow to run mage build multiple times (don't re-checkout the package-storage)
  • remove dev/packages/alpha as they are in the package-storage (import recent alpha packages)

@mtojek mtojek requested a review from ruflin May 13, 2020 10:55
@mtojek mtojek self-assigned this May 13, 2020
@elasticmachine
Copy link

elasticmachine commented May 13, 2020

💚 Build Succeeded

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

.gitignore Outdated
@@ -3,3 +3,5 @@
.idea
build
public

/dev/packages/storage
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we put it under build/packages/storage instead?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this one doesn't need special cleaning. Fixed.

@mtojek mtojek requested a review from ruflin May 13, 2020 11:39
magefile.go Outdated
tarGz = true
publicDir = "./public"
buildDir = "./build"
storageDir = "./dev/packages/storage"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this still correct?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Leftover, not needed anymore.

@exekias
Copy link

exekias commented May 13, 2020

ey folks, trying to understand the workflow here. Why is integrations repo fetching packages from storage?

@mtojek
Copy link
Contributor Author

mtojek commented May 13, 2020

ey folks, trying to understand the workflow here. Why is integrations repo fetching packages from storage?

Packages served by the package-registry are stored in the package-storage. There are some of them that are internal/required like: base, endpoint, system. As they're not in the integrations repo, we need to fetch them from the package-storage.

Currently there are no simple ways of attaching more packages to the registry. I can look into possibilities and modify the registry, but changes the scope of this task a bit.

@ruflin
Copy link
Contributor

ruflin commented May 13, 2020

One reason are the required packages but there is also a very nice side effect here. As all the existing packages are pulled in, any testing of new packages together with Kibana is what it will look like in the end. Example:

Someone is working on the nginx package 1.3.2. The current version shipped is 1.3.1. 1.3.1 will be pulled in from the package-storage and 1.3.2 will be on top of it.

@mtojek
Copy link
Contributor Author

mtojek commented May 14, 2020

  • remove dev/packages/alpha as they are in the package-storage

This point depends on outcome of the discussion here: #15

Copy link
Contributor

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change LGTM.

My understanding of this PR now:

  • package-storage are checked out into build directory so only change related to this is in the magefile
  • The diff on the alpha packages are coming from (version-)changes since this repo was created (mostly).

@mtojek mtojek merged commit 3979920 into elastic:master May 18, 2020
@ycombinator ycombinator mentioned this pull request Feb 16, 2021
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants