Commit c826009
authored
Refactor
## Which issue does this PR close?
<!--
We generally require a GitHub issue to be filed for all bug fixes and
enhancements and this helps us generate change logs for our releases.
You can link an issue to this PR using the GitHub syntax. For example
`Closes #123` indicates that this PR will close issue #123.
-->
Part of #14763 and #14760
## Rationale for this change
<!--
Why are you proposing this change? If this is already explained clearly
in the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand
your changes and offer better suggestions for fixes.
-->
Current `log()` signature has some drawbacks:
https://github.com/apache/datafusion/blob/a5eb9121ccf802dda547897155403b08a4fbf774/datafusion/functions/src/math/log.rs#L78-L105
- A bit nasty to look at: mixes numeric with exact float/int with exact
decimal (of exact precision and scale)
- Can't accommodate arbitrary decimals of any precision/scale (this is
true for other functions too)
Aim of this PR is to refactor it to use the coercion API, uplifting the
API where necessary to make this possible. This simplifies the signature
in code, whilst not losing flexibility.
Also other minor refactors are included to log.
## What changes are included in this PR?
<!--
There is no need to duplicate the description in the issue here but it
is sometimes worth providing a summary of the individual changes in this
PR.
-->
New `TypeSignatureClass` variants: Float, Decimal & Numeric
Refactor `log()` signature to be more in line with it's supported
implementations.
Fix issue in `log()` where `ColumnarValue::Scalar`s were being lost as
`ColumnarValue::Array`s for the base.
Support null propagation in `simplify()` for `log()`.
~~Fix issue with `calculate_binary_math` where it wasn't casting
scalars.~~
## Are these changes tested?
<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code
If tests are not included in your PR, please explain why (for example,
are they covered by existing tests)?
-->
Added new tests.
- Tests for float16, decimal32, decimal64, decimals with different
scales/precisions
- Test for null propagation (ensure use array input to avoid function
inlining)
## Are there any user-facing changes?
<!--
If there are user-facing changes then we may require documentation to be
updated before approving the PR.
-->
No.
<!--
If there are any breaking changes to public APIs, please add the `api
change` label.
-->log() signature to use coercion API + fixes (#18519)1 parent 2233796 commit c826009
File tree
7 files changed
+216
-122
lines changed- datafusion
- common/src
- scalar
- types
- expr-common/src
- functions/src/math
- sqllogictest/test_files
7 files changed
+216
-122
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1734 | 1734 | | |
1735 | 1735 | | |
1736 | 1736 | | |
1737 | | - | |
| 1737 | + | |
1738 | 1738 | | |
1739 | 1739 | | |
1740 | 1740 | | |
| |||
1750 | 1750 | | |
1751 | 1751 | | |
1752 | 1752 | | |
1753 | | - | |
| 1753 | + | |
1754 | 1754 | | |
1755 | 1755 | | |
1756 | 1756 | | |
| |||
4407 | 4407 | | |
4408 | 4408 | | |
4409 | 4409 | | |
| 4410 | + | |
4410 | 4411 | | |
4411 | 4412 | | |
4412 | 4413 | | |
| |||
4563 | 4564 | | |
4564 | 4565 | | |
4565 | 4566 | | |
| 4567 | + | |
4566 | 4568 | | |
4567 | 4569 | | |
4568 | 4570 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
430 | 430 | | |
431 | 431 | | |
432 | 432 | | |
433 | | - | |
434 | | - | |
435 | | - | |
436 | | - | |
437 | | - | |
438 | | - | |
439 | | - | |
440 | | - | |
441 | | - | |
442 | | - | |
443 | | - | |
444 | | - | |
445 | | - | |
446 | | - | |
447 | | - | |
448 | | - | |
| 433 | + | |
449 | 434 | | |
450 | 435 | | |
451 | 436 | | |
| |||
491 | 476 | | |
492 | 477 | | |
493 | 478 | | |
| 479 | + | |
| 480 | + | |
| 481 | + | |
| 482 | + | |
| 483 | + | |
| 484 | + | |
| 485 | + | |
| 486 | + | |
| 487 | + | |
| 488 | + | |
494 | 489 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
24 | | - | |
| 24 | + | |
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
| |||
333 | 333 | | |
334 | 334 | | |
335 | 335 | | |
336 | | - | |
337 | | - | |
338 | 336 | | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
339 | 340 | | |
340 | 341 | | |
341 | 342 | | |
| |||
378 | 379 | | |
379 | 380 | | |
380 | 381 | | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
| 386 | + | |
| 387 | + | |
| 388 | + | |
381 | 389 | | |
382 | 390 | | |
383 | 391 | | |
| |||
395 | 403 | | |
396 | 404 | | |
397 | 405 | | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
398 | 409 | | |
399 | 410 | | |
400 | 411 | | |
| |||
428 | 439 | | |
429 | 440 | | |
430 | 441 | | |
| 442 | + | |
| 443 | + | |
| 444 | + | |
| 445 | + | |
| 446 | + | |
| 447 | + | |
| 448 | + | |
| 449 | + | |
| 450 | + | |
431 | 451 | | |
432 | 452 | | |
433 | 453 | | |
| |||
0 commit comments