[Feature] Support IsDistinctFrom and IsNotDistinctFrom

[61yao]

The operators IsDistinctFrom and IsNotDistinctFrom only supports column names as argument for now.
When null option is disabled, the row is considered as not null by default.
Expected value:
Null is IsDistinctFrom ValueA: True
Null is IsDistinctFrom Null: False
ValueA is IsDistinctFrom ValueB: NotEquals(ValueA, ValueB)
Null is IsNotDistinctFrom ValueA: False
Null is IsNotDistinctFrom Null: True
ValueA is IsNotDistinctFrom ValueB: Equals(ValueA, ValueB)

Example Usage:
ColumnA IsDistinctFrom ColumnB
ColumnA IsNotDistinctFrom ColumnB

[codecov-commenter]

Codecov Report

Merging #9312 (4610d4f) into master (ff2a333) will decrease coverage by 38.56%.
The diff coverage is 64.10%.

@@              Coverage Diff              @@
##             master    #9312       +/-   ##
=============================================
- Coverage     63.40%   24.84%   -38.57%     
+ Complexity     4762       53     -4709     
=============================================
  Files          1832     1876       +44     
  Lines         98146   100105     +1959     
  Branches      15020    15251      +231     
=============================================
- Hits          62231    24871    -37360     
- Misses        31321    72701    +41380     
+ Partials       4594     2533     -2061     

Flag	Coverage Δ
integration2	24.84% <64.10%> (?)
unittests1	?
unittests2	?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...form/function/BinaryOperatorTransformFunction.java	20.61% <ø> (-19.25%)	⬇️
...nsform/function/DistinctFromTransformFunction.java	54.83% <54.83%> (ø)
...e/pinot/common/function/TransformFunctionType.java	88.42% <100.00%> (-11.58%)	⬇️
...form/function/IsDistinctFromTransformFunction.java	100.00% <100.00%> (ø)
...m/function/IsNotDistinctFromTransformFunction.java	100.00% <100.00%> (ø)
...r/transform/function/TransformFunctionFactory.java	88.35% <100.00%> (+1.55%)	⬆️
...in/java/org/apache/pinot/spi/utils/BytesUtils.java	0.00% <0.00%> (-100.00%)	⬇️
.../java/org/apache/pinot/spi/utils/BooleanUtils.java	0.00% <0.00%> (-100.00%)	⬇️
...java/org/apache/pinot/spi/trace/BaseRecording.java	0.00% <0.00%> (-100.00%)	⬇️
...java/org/apache/pinot/spi/trace/NoOpRecording.java	0.00% <0.00%> (-100.00%)	⬇️
... and 1537 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[Jackie-Jiang]

LGTM otherwise

[Jackie-Jiang]

Suggested change

	protected DistinctFromTransformFunction(boolean distinctType) {
	protected DistinctFromTransformFunction(boolean distinct) {

[61yao]

Done.

[Jackie-Jiang]

It should be faster if we iterate in the following way:

• Iterate over left null and set _distinctResult
• Iterate over right null and set _distinctResult
• Iterate over left AND right null and set _notDistinctResult

[61yao]

Changed to iterate through xor and and bitset