Skip to content

Conversation

@ykmr1224
Copy link
Collaborator

Description

Refactor SparkQueryDispatcher to reduce the direct dependency (pure refactoring).

  • Extracted QueryHandlerFactory to remove constructor dependency to query hander classes and direct dependent classes.
  • Reduced redundancy of code and improved readability.

Issues Resolved

N/A

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
@ykmr1224
Copy link
Collaborator Author

Removed EMRServerlessClientFactory from SparkQueryDispatcher, and fixed build error due to spotless check

@ykmr1224 ykmr1224 force-pushed the refactor-spark branch 2 times, most recently from 986cbc7 to bbed24a Compare April 29, 2024 18:27
Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
@vamsimanohar vamsimanohar added maintenance Improves code quality, but not the product backport 2.x labels Apr 30, 2024
@vamsimanohar vamsimanohar merged commit d32cf94 into opensearch-project:main Apr 30, 2024
opensearch-trigger-bot bot pushed a commit that referenced this pull request Apr 30, 2024
* Refactor SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

* Remove EMRServerlessClientFactory from SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

* Fix unit test failures in SparkQueryDispatcherTest

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

---------

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
(cherry picked from commit d32cf94)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
ykmr1224 pushed a commit to ykmr1224/sql that referenced this pull request May 13, 2024
* Refactor SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

* Remove EMRServerlessClientFactory from SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

* Fix unit test failures in SparkQueryDispatcherTest

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

---------

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
(cherry picked from commit d32cf94)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
ykmr1224 added a commit that referenced this pull request May 14, 2024
* Refactor SparkQueryDispatcher (#2636)

* Refactor SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

* Remove EMRServerlessClientFactory from SparkQueryDispatcher

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

* Fix unit test failures in SparkQueryDispatcherTest

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

---------

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
(cherry picked from commit d32cf94)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix conflicted test case

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>

---------

Signed-off-by: Tomoyuki Morita <moritato@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@ykmr1224 ykmr1224 deleted the refactor-spark branch June 12, 2024 22:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 2.x maintenance Improves code quality, but not the product

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants