ES|QL: add local optimizations for constant_keyword

[luigidellaquila]

Adding local planning optimizations for constant field values (eg. constant_keyword).

The rule tries to get the value at planning time and replaces it with a literal, avoiding field extraction and allowing to trigger further optimizations.

[luigidellaquila]

After discussing it with @alex-spies, we decided to simplify it a bit (to the cost of some minor optimizations) and diverge a bit from what we do in ReplaceMissingFieldWithNull.
In particular, now we avoid to reuse NameIDs, that is potentially dangerous in the long term

[elasticsearchmachine]

Pinging @elastic/es-analytical-engine (Team:Analytics)

[astefan]

With the following test data, things do not seem to work as they do on main:

test1

{
  "settings": {
    "index": {
      "number_of_shards": "1",
      "number_of_replicas": "0"
    }
  },
  "mappings": {
    "properties": {
      "f1": {
        "type": "keyword"
      }
    }
  }
}

test2

{
  "settings": {
    "index": {
      "number_of_shards": "1",
      "number_of_replicas": "0"
    }
  },
  "mappings": {
    "properties": {
      "f1": {
        "type": "long"
      }
    }
  }
}

test3

{
  "settings": {
    "index": {
      "number_of_shards": "1",
      "number_of_replicas": "0"
    }
  },
  "mappings": {
    "properties": {
      "f1": {
        "type": "constant_keyword"
      }
    }
  }
}

{"index":{"_index":"test1","_id":1}}
{"f1":"foo"}
{"index":{"_index":"test2","_id":1}}
{"f1":123}
{"index":{"_index":"test3","_id":1}}
{"bar":"baz"}
{"index":{"_index":"test3","_id":2}}
{"f1":"abc"}
{"index":{"_index":"test3","_id":3}}
{"f1":"foo"}

FROM test*,-test2 METADATA _index, _id | where f1 == "abc"

Results in

      bar      |  bar.keyword  |      f1       |    _index     |      _id      
---------------+---------------+---------------+---------------+---------------
null           |null           |foo            |test1          |1              
baz            |baz            |abc            |test3          |1              
null           |null           |abc            |test3          |2

[elasticsearchmachine]

Hi @luigidellaquila, I've created a changelog YAML for you.

[luigidellaquila]

My bad, a missing else.
Before moving forward I'll add more tests, especially with mixed types (eg. text and constant_keyword)

[nik9000]

I'm good with it. It'd be nice if there were an easier way to get the constant value, but this'll do. If everyone else is good, I'm good.

[nik9000]

I believe we tend to use BytesRefs encoded as utf-8.

[astefan]

My bad, a missing else. Before moving forward I'll add more tests, especially with mixed types (eg. text and constant_keyword)

No worries.
Next time, the reviewers' job would be less challenging and more swift if the PR would be ready for review with the tests you mention above. Much better for both parties if there is no need to double-check (with additional tests from reviewers) the validity of the solution. Thanks you :-).

[astefan]

Please, provide a more explanatory comment. I am looking for "reusing NameIDs is dangerous" explanation.

[astefan]

Also, having an eval doing the value "replacement" is not about performance, but about making use of other mechanisms that already exists in the optimizer to naturally "move"/"flow" the EVAL through the Nodes tree (like constant folding, moving literals on the right hand side of boolean expressions etc).

[astefan]

Thinking about this some more... this rule and ReplaceMissingFieldWithNull are, in essence, doing the same thing.

The only essential aspect that is different between them is
localLogicalOptimizerContext.searchStats().exists(f.fieldName())

and

localLogicalOptimizerContext.searchStats().constantValue(attribute.name())

Meaning, the "constant" is either null or is a value coming from a constant_keyword field. Try to see if you can abstract away this logic and either:

• have two rules that use common code and the only thing different is the searchStats() check
• have only one rule that does the null and constant check at the same time.