Skip to content

Adding new field expressionOverrideHints into PinotQuery#8421

Merged
xiangfu0 merged 1 commit intoapache:masterfrom
xiangfu0:pinotquery-thrift
Mar 28, 2022
Merged

Adding new field expressionOverrideHints into PinotQuery#8421
xiangfu0 merged 1 commit intoapache:masterfrom
xiangfu0:pinotquery-thrift

Conversation

@xiangfu0
Copy link
Contributor

@xiangfu0 xiangfu0 commented Mar 28, 2022

Description

This is to enable best-effort query rewrite at the segment level. The hint is computed at the broker and passed through to all the servers and applied to each segment for further processing.

Note that the generated java files don't follow the Pinot code style, so I modified them a bit.

Upgrade Notes

Does this PR prevent a zero down-time upgrade? (Assume upgrade order: Controller, Broker, Server, Minion)

  • Yes (Please label as backward-incompat, and complete the section below on Release Notes)

Does this PR fix a zero-downtime upgrade introduced earlier?

  • Yes (Please label this as backward-incompat, and complete the section below on Release Notes)

Does this PR otherwise need attention when creating release notes? Things to consider:

  • New configuration options
  • Deprecation of configurations
  • Signature changes to public methods/interfaces
  • New plugins added or old plugins removed
  • Yes (Please label this PR as release-notes and complete the section on Release Notes)

Release Notes

Documentation

@codecov-commenter
Copy link

codecov-commenter commented Mar 28, 2022

Codecov Report

Merging #8421 (6f60343) into master (bf70c65) will increase coverage by 0.04%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #8421      +/-   ##
============================================
+ Coverage     70.79%   70.83%   +0.04%     
  Complexity     4281     4281              
============================================
  Files          1655     1655              
  Lines         86665    86665              
  Branches      13067    13067              
============================================
+ Hits          61353    61392      +39     
+ Misses        21071    21034      -37     
+ Partials       4241     4239       -2     
Flag Coverage Δ
integration1 28.77% <ø> (+0.07%) ⬆️
integration2 27.22% <ø> (-0.14%) ⬇️
unittests1 67.02% <ø> (ø)
unittests2 14.10% <ø> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ontroller/api/resources/ServerTableSizeReader.java 83.33% <0.00%> (-16.67%) ⬇️
...he/pinot/segment/local/segment/store/IndexKey.java 65.00% <0.00%> (-10.00%) ⬇️
...a/org/apache/pinot/common/utils/ServiceStatus.java 60.00% <0.00%> (-7.15%) ⬇️
...or/transform/function/IsNullTransformFunction.java 67.85% <0.00%> (-7.15%) ⬇️
...pache/pinot/common/utils/grpc/GrpcQueryClient.java 76.59% <0.00%> (-4.26%) ⬇️
...gregation/function/StUnionAggregationFunction.java 73.52% <0.00%> (-2.95%) ⬇️
...core/startree/operator/StarTreeFilterOperator.java 90.90% <0.00%> (-2.10%) ⬇️
.../pinot/server/starter/helix/BaseServerStarter.java 57.34% <0.00%> (-1.98%) ⬇️
...e/pinot/broker/broker/helix/BaseBrokerStarter.java 78.60% <0.00%> (-1.00%) ⬇️
.../helix/core/realtime/SegmentCompletionManager.java 72.00% <0.00%> (-0.82%) ⬇️
... and 17 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bf70c65...6f60343. Read the comment docs.

*
*/
@javax.annotation.Generated(value = "Autogenerated by Thrift Compiler (0.13.0)", date = "2021-09-28")
@javax.annotation.Generated(value = "Autogenerated by Thrift Compiler (0.13.0)", date = "2022-03-28")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since we have upgraded thrift to 0.15.0, consider re-compiling the files with 0.15.0

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hmm, maybe do it in another PR for thrift upgrade?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will submit the new PR after this.

@xiangfu0 xiangfu0 merged commit 7655fcc into apache:master Mar 28, 2022
@xiangfu0 xiangfu0 deleted the pinotquery-thrift branch March 28, 2022 22:30
@xiangfu0 xiangfu0 mentioned this pull request Mar 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants