Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace checked-in ZIP with a dynamic dependency #514

Merged
merged 1 commit into from
Mar 28, 2022

Conversation

penghuo
Copy link
Collaborator

@penghuo penghuo commented Mar 25, 2022

Description

Replace checked-in ZIP with a dynamic dependency

Issues Resolved

#491

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@penghuo penghuo requested a review from a team as a code owner March 25, 2022 00:38
@codecov-commenter
Copy link

codecov-commenter commented Mar 25, 2022

Codecov Report

Merging #514 (0d98b1a) into main (6771968) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##               main     #514   +/-   ##
=========================================
  Coverage     95.24%   95.24%           
  Complexity     2744     2744           
=========================================
  Files           276      276           
  Lines          7410     7410           
  Branches        537      537           
=========================================
  Hits           7058     7058           
  Misses          298      298           
  Partials         54       54           
Flag Coverage Δ
query-workbench 62.91% <ø> (ø)
sql-engine 98.40% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6771968...0d98b1a. Read the comment docs.

Signed-off-by: penghuo <penghuo@gmail.com>
@@ -188,6 +189,8 @@ task compileJdbc(type: Exec) {
String bwcVersion = "1.13.2.0";
String baseName = "sqlBwcCluster"
String bwcFilePath = "src/test/resources/bwc/"
String bwcOpenDistroPlugin = "opendistro-sql-1.13.2.0.zip"
String bwcRemoteFile = 'https://d3g5vo6xdbdb9a.cloudfront.net/downloads/elasticsearch-plugins/opendistro-sql/opendistro-sql-1.13.2.0.zip'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How do we maintain this zip file in cloudfront? Like if this package has merged a new bug fix commit, do we need to build the zip file locally then upload it to cloudfront? Then although it's not a checked-in dependency anymore, it's still not a dynamic dependency?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

opendistro-sql-1.13.2.0.zip is the released latest opendistro SQL plugin. we didn't maintain opendistro-sql-1.13.2.0.zip

Copy link
Contributor

@jackiehanyang jackiehanyang Mar 25, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if opendistro SQL plugin release a new version, do we need to replace this zip file on cloudfront with a one build with latest version?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, it is required.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the official URL for this .zip? I see in https://opendistro.github.io/for-elasticsearch-docs/docs/install/plugins/ that we reference the cloudfront URL. If that's how it should be, so be it, but I would use something like opendistrowhateverthatwas.org if that exists.

Copy link
Member

@joshuali925 joshuali925 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what about the opensearch-ml zip?

@penghuo penghuo merged commit 69affa5 into opensearch-project:main Mar 28, 2022
Copy link
Member

@dblock dblock left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -188,6 +189,8 @@ task compileJdbc(type: Exec) {
String bwcVersion = "1.13.2.0";
String baseName = "sqlBwcCluster"
String bwcFilePath = "src/test/resources/bwc/"
String bwcOpenDistroPlugin = "opendistro-sql-1.13.2.0.zip"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: I would use bcwVersion from above in the file name.

@@ -188,6 +189,8 @@ task compileJdbc(type: Exec) {
String bwcVersion = "1.13.2.0";
String baseName = "sqlBwcCluster"
String bwcFilePath = "src/test/resources/bwc/"
String bwcOpenDistroPlugin = "opendistro-sql-1.13.2.0.zip"
String bwcRemoteFile = 'https://d3g5vo6xdbdb9a.cloudfront.net/downloads/elasticsearch-plugins/opendistro-sql/opendistro-sql-1.13.2.0.zip'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the official URL for this .zip? I see in https://opendistro.github.io/for-elasticsearch-docs/docs/install/plugins/ that we reference the cloudfront URL. If that's how it should be, so be it, but I would use something like opendistrowhateverthatwas.org if that exists.

@penghuo penghuo deleted the issue-491 branch March 28, 2022 20:20
@penghuo
Copy link
Collaborator Author

penghuo commented Mar 28, 2022

@dblock I think plugin zip only available at cloudfront URL. I didn't aware opendistrowhateverthatwas.org link.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants