Skip to content

Multi stage int tests#11404

Merged
xiangfu0 merged 26 commits intoapache:masterfrom
gortiz:multiStageIntTests
Sep 7, 2023
Merged

Multi stage int tests#11404
xiangfu0 merged 26 commits intoapache:masterfrom
gortiz:multiStageIntTests

Conversation

@gortiz
Copy link
Contributor

@gortiz gortiz commented Aug 22, 2023

We want to improve the test coverage when using multi stage engine.

In this PR I'm repeating in V2 some test that previously were only in V1

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here I decided to create a subclass because the base test is already using data providers

@gortiz gortiz force-pushed the multiStageIntTests branch from 2cd8597 to 33aaa5e Compare August 22, 2023 13:05
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test was incorrect. It was always running as multi stage while some test actually call setUseMultiStageQueryEngine in order to do some things with V1

@gortiz gortiz force-pushed the multiStageIntTests branch from 33aaa5e to 266a602 Compare August 22, 2023 13:19
@codecov-commenter
Copy link

codecov-commenter commented Aug 22, 2023

Codecov Report

Merging #11404 (b093ea3) into master (b3c87ec) will increase coverage by 48.53%.
Report is 2 commits behind head on master.
The diff coverage is n/a.

@@              Coverage Diff              @@
##             master   #11404       +/-   ##
=============================================
+ Coverage     14.51%   63.04%   +48.53%     
- Complexity      201     1107      +906     
=============================================
  Files          2320     2320               
  Lines        124658   124658               
  Branches      19031    19031               
=============================================
+ Hits          18095    78593    +60498     
+ Misses       105031    40465    -64566     
- Partials       1532     5600     +4068     
Flag Coverage Δ
integration 0.00% <ø> (ø)
integration2 0.00% <ø> (ø)
java-11 63.02% <ø> (+48.54%) ⬆️
java-17 14.50% <ø> (+0.02%) ⬆️
java-20 14.48% <ø> (-0.03%) ⬇️
temurin 63.04% <ø> (+48.53%) ⬆️
unittests 63.04% <ø> (+48.53%) ⬆️
unittests1 67.44% <ø> (?)
unittests2 14.51% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
...ava/org/apache/pinot/client/ConnectionFactory.java 38.46% <ø> (ø)

... and 1499 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@gortiz gortiz force-pushed the multiStageIntTests branch 2 times, most recently from 763bd5b to 9b3f50e Compare August 31, 2023 06:40
@gortiz gortiz force-pushed the multiStageIntTests branch from 9b3f50e to f2125d3 Compare August 31, 2023 15:24
@Jackie-Jiang Jackie-Jiang added testing multi-stage Related to the multi-stage query engine labels Aug 31, 2023
@gortiz gortiz force-pushed the multiStageIntTests branch from 014cd7e to 2fc610c Compare September 6, 2023 11:04
@xiangfu0
Copy link
Contributor

xiangfu0 commented Sep 6, 2023

seems more tests to fix due to error code.

@gortiz
Copy link
Contributor Author

gortiz commented Sep 6, 2023

Yeah, my other commits were merged :D

@xiangfu0 xiangfu0 merged commit be496bc into apache:master Sep 7, 2023
@gortiz gortiz deleted the multiStageIntTests branch September 7, 2023 06:33
};
}

protected void notSupportedInV2() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

per discussion with @gortiz This was added to skip V2 when there's test failure. however some test cases actually sequentially ran though the queries. so if the earlier one fails. there's no way to capture the latter ones.

we should switch to a provider pattern otherwise the sequential query run will not capture enough

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

multi-stage Related to the multi-stage query engine testing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants