Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[incubator-kie-issues#507] DMN - Add a new "list replace" function #5645

Merged
merged 6 commits into from
Jan 15, 2024

Conversation

gitgabrio
Copy link
Contributor

@gitgabrio gitgabrio commented Jan 10, 2024

Fixes apache/incubator-kie-issues#507

Also requires kiegroup/dmn-feel-handbook#19

How to replicate CI configuration locally?

Build Chain tool does "simple" maven build(s), the builds are just Maven commands, but because the repositories relates and depends on each other and any change in API or class method could affect several of those repositories there is a need to use build-chain tool to handle cross repository builds and be sure that we always use latest version of the code for each repository.

build-chain tool is a build tool which can be used on command line locally or in Github Actions workflow(s), in case you need to change multiple repositories and send multiple dependent pull requests related with a change you can easily reproduce the same build by executing it on Github hosted environment or locally in your development environment. See local execution details to get more information about it.

How to retest this PR or trigger a specific build:
  • for pull request checks
    Please add comment: Jenkins retest this

  • for a specific pull request check
    Please add comment: Jenkins (re)run [drools|kogito-runtimes|kogito-apps|kogito-examples] tests

  • for a full downstream build

    • for jenkins job: please add comment: Jenkins run fdb
    • for github actions job: add the label run_fdb
  • a compile downstream build please add comment: Jenkins run cdb

  • an upstream build please add comment: Jenkins run upstream

  • for quarkus branch checks
    Run checks against Quarkus current used branch
    Please add comment: Jenkins run quarkus-branch

  • for a quarkus branch specific check
    Run checks against Quarkus current used branch
    Please add comment: Jenkins (re)run [drools|kogito-runtimes|kogito-apps|kogito-examples] quarkus-branch

  • for quarkus main checks
    Run checks against Quarkus main branch
    Please add comment: Jenkins run quarkus-main

  • for a specific quarkus main check
    Run checks against Quarkus main branch
    Please add comment: Jenkins (re)run [drools|kogito-runtimes|kogito-apps|kogito-examples] quarkus-main

  • for quarkus lts checks
    Run checks against Quarkus lts branch
    Please add comment: Jenkins run quarkus-lts

  • for a specific quarkus lts check
    Run checks against Quarkus lts branch
    Please add comment: Jenkins (re)run [drools|kogito-runtimes|kogito-apps|kogito-examples] quarkus-lts

  • for native checks
    Run native checks
    Please add comment: Jenkins run native

  • for a specific native check
    Run native checks
    Please add comment: Jenkins (re)run [drools|kogito-runtimes|kogito-apps|kogito-examples] native

  • for native lts checks
    Run native checks against quarkus lts branch
    Please add comment: Jenkins run native-lts

  • for a specific native lts check
    Run native checks against quarkus lts branch
    Please add comment: Jenkins (re)run [drools|kogito-runtimes|kogito-apps|kogito-examples] native-lts

How to backport a pull request to a different branch?

In order to automatically create a backporting pull request please add one or more labels having the following format backport-<branch-name>, where <branch-name> is the name of the branch where the pull request must be backported to (e.g., backport-7.67.x to backport the original PR to the 7.67.x branch).

NOTE: backporting is an action aiming to move a change (usually a commit) from a branch (usually the main one) to another one, which is generally referring to a still maintained release branch. Keeping it simple: it is about to move a specific change or a set of them from one branch to another.

Once the original pull request is successfully merged, the automated action will create one backporting pull request per each label (with the previous format) that has been added.

If something goes wrong, the author will be notified and at this point a manual backporting is needed.

NOTE: this automated backporting is triggered whenever a pull request on main branch is labeled or closed, but both conditions must be satisfied to get the new PR created.

return FEELFnResult.ofError(new InvalidParametersEvent(Severity.ERROR, "position", "cannot be null"));
}
int intPosition = position.intValue();
if (intPosition < 1 || intPosition > list.size()) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

iirc in FEEL you can access by negative index (a-la python so to speak).

I don't have access to the spec, maybe you want to check if you need to support negative indexing here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tarilabs
That's true, and TBH this is a tricky part I did not understood:
position must be a non-zero integer (0 scale number) in the range [-L..L], where L is the length of the list
this is the given example
list replace( [2, 4, 7, 8], 3, 6) = [2, 4, 6, 8]
but

  1. the position in the example seems to be 1 based
  2. what does negative position means ? i.e. in the following example
    list replace( [2, 4, 7, 8], -3, 6) = ... what should be the expected behavior ?
    Thanks for help and suggestion!!!

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TBH this is a tricky part I did not understood:
integer (0 scale number)

means it's not a floating point, just a int ("zero scale" here I believe they refer as: no decimals)

non-zero integer

the set of integers, except 0

in the range [-L..L], where L is the length of the list

it's an integer, but cannot be 0, in the range from -size to size included.

For a list of 2 elements such as [1,2], L = 2, so position can be [-2..2],
For a list of 3 elements such as [1,2,3], L = 3, so position can be [-3..3],
etc. but in any case L is never 0.

the position in the example seems to be 1 based

Yes as specified, and consistent with:

10.3.2.5 Lists and filters
... The nth element from the beginning can be accessed using L[n], and the nth element from the end can be accessed using L[-n].

taken from the spec, semantic of List

what does negative position means ? i.e. in the following example
list replace( [2, 4, 7, 8], -3, 6) = ... what should be the expected behavior ?

list replace( [2, 4, 7, 8], -3, 6) = [2, 6, 7, 8]

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @tarilabs ! This helps a lot

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tarilabs Fixed!

{"list replace ( [2, 4, 7, 8], 3, 6)", Arrays.asList(BigDecimal.valueOf(2), BigDecimal.valueOf(4), BigDecimal.valueOf(6), BigDecimal.valueOf(8)), null},
{"list replace ( [2, 4, 7, 8], function(item, newItem) item + newItem, 6)", null , FEELEvent.Severity.ERROR},
{"list replace ( [\"El-1\", \"El-2\", \"El-3\", \"El-4\"], function(item, newItem) item = \"El-2\", null)", Arrays.asList("El-1", null, "El-3", "El-4"), null},
{"list replace ( [2, 4, 7, 8], function(item, newItem) item < newItem, 5)", Arrays.asList(BigDecimal.valueOf(5), BigDecimal.valueOf(5), BigDecimal.valueOf(7), BigDecimal.valueOf(8)), null}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so my understanding the semantic of the list replace to take:

  • as first argument, the list subject of replacements
  • as second argument, a FEEL:number for the position (or a predicate function)
  • as third argument, the to-replace value

so either replace-at-position or replace-when-predicate semantic

in case the 2nd arg is a predicate, is a predicate in 2 arguments, the "current" item being processed and the third to-replace value.

There is no doubt for the second argument (a FEEL:number for the position or a predicate function) in which variant of the built-in function you are -- ie it's not like Collections.replaceAll
this is my understanding 👍

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tarilabs
This is from spec:
[..] return a new list where newItem replaced at all positions where the match function returned true
with example
list replace ( [2, 4, 7, 8], function(item, newItem) item < newItem, 5) = [5, 5, 7, 8]
so, I get it as "replace all elements where the match is true" - in the given example: replace all items that are less then 5: does this make sense ? Is that what you meant ?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yep, I'm just unsure why they specified the 2nd argument predicate to be a function in two arguments?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess beacuse the matching function could depend on both (current) item and newItem: would it be possible to achieve that with a function with only one argument (I just started working on DMN specs)?
Anyway, I also wrote a test where the match function does not use the newItem at all, since, reading the documentation, seems a valid use case (e.g. if a number is even, replace with the newItem)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's indeed what I would ask to the DMN RTF, since IBM is a member.

Here I can only comment personally as an external observer.
See even your example, you wrote:

list replace ( [2, 4, 7, 8], function(item, newItem) item < newItem, 5)

the 3rd argument, the item to be replaced into, is the value 5.
it will always be a value.
and even if you place in there a function invocation, the intent of FEEL/DMN is to be idempotent, so the resulting value should always be the same.

let's now focus on the 2nd argument of list replace(, the predicate-function.
I personally don't see much of a case where you need then to specify newItem as a second parameter of the predicate-function. It will always be the value 5.
So you just could have written it as function(item) item < 5.

It could be either of the two:

  • in the DMN 1.5 Beta changebar they had a typo, it was not meant to be signature of function(item, newItem) but it was meant as signature of function(item)
  • they really meant function(item, newItem) , and I understand it can also works this way, but to me seems a bit overcomplicated and I didn't understand the reasoning behind the choice --should be asked to the DMN RTF, or maybe someone in the TCK knows (as some also participate in the RTF as well)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@baldimir ^^ ?

@gitgabrio gitgabrio merged commit 9ecc8ce into apache:main Jan 15, 2024
rgdoliveira pushed a commit to rgdoliveira/drools that referenced this pull request Jan 16, 2024
…pache#5645)

* [incubator-kie-issues#507] Implement FEEL list replace

* [incubator-kie-issues#507] Fixed as per PR suggestion

* [incubator-kie-issues#507] Fix typo

---------

Co-authored-by: BAMOE CI <bamoe.ci@ibm.com>
@gitgabrio gitgabrio deleted the incubator-kie-issues#507 branch April 5, 2024 07:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

DMN - Add a new "list replace" function
4 participants