Add sessionId parameters for create async query API

[penghuo]

Description

1. API doc. https://github.com/opensearch-project/sql/blob/2b1ad6a912a91f64056446aa24601ee1f1ab469c/docs/user/interfaces/asyncqueryinterface.rst
2. feature disable by default.

Todo

1. create .query_execution_request index if not exist.
2. change REPL job Spark parameters.
3. add IT in following PR.
4. enable the feature by default.

Test Queries

• enable feature.

PUT {{baseUrl}}/_plugins/_query/settings
Content-Type: application/x-ndjson

{"transient":{"plugins.query.executionengine.spark.session.enabled":"true"}}

{
  "acknowledged": true,
  "persistent": {},
  "transient": {
    "plugins": {
      "query": {
        "executionengine": {
          "spark": {
            "session": {
              "enabled": "true"
            }
          }
        }
      }
    }
  }
}

• submit query without sessionId, new sessionId will be allocated.

POST {{baseUrl}}/_plugins/_async_query
Content-Type: application/x-ndjson

{
  "datasource": "mys3",
  "lang": "sql",
  "query": "select * from mys3.default.http_logs limit 1"
}

{
  "queryId": "HlbM61kX6MDkAktO",
  "sessionId": "1Giy65ZnzNlmsPAm"
}

• fetch query result

GET {{baseUrl}}/_plugins/_async_query/HlbM61kX6MDkAktO

{
  "status": "waiting"
}

• submit new query in same session

POST {{baseUrl}}/_plugins/_async_query
Content-Type: application/x-ndjson

{
  "datasource": "mys3",
  "lang": "sql",
  "query": "select * from mys3.default.http_logs limit 1",
  "sessionId" : "1Giy65ZnzNlmsPAm"
}

{
  "queryId": "7GC4mHhftiTejvxN",
  "sessionId": "1Giy65ZnzNlmsPAm"
}

Issues Resolved

[List any issues this PR will resolve]

Check List

• New functionality includes testing.
  • All tests pass, including unit test, integration test and doctest
• New functionality has been documented.
  • New functionality has javadoc added
  • New functionality has user manual doc added
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

Merging #2312 (2b1ad6a) into main (297e26f) will increase coverage by 0.11%.
The diff coverage is 96.73%.

@@             Coverage Diff              @@
##               main    #2312      +/-   ##
============================================
+ Coverage     96.58%   96.69%   +0.11%     
- Complexity     4823     4839      +16     
============================================
  Files           454      454              
  Lines         13134    13203      +69     
  Branches        887      896       +9     
============================================
+ Hits          12685    12767      +82     
+ Misses          436      422      -14     
- Partials         13       14       +1     

Flag	Coverage Δ
sql-engine	96.69% <96.73%> (+0.11%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files	Coverage Δ
...rch/sql/opensearch/setting/OpenSearchSettings.java	100.00% <100.00%> (ø)
...park/asyncquery/AsyncQueryExecutorServiceImpl.java	100.00% <100.00%> (ø)
...earch/sql/spark/data/constants/SparkConstants.java	0.00% <ø> (ø)
...rch/sql/spark/dispatcher/SparkQueryDispatcher.java	100.00% <100.00%> (ø)
...nsearch/sql/spark/execution/session/SessionId.java	100.00% <100.00%> (ø)
...ch/sql/spark/execution/session/SessionManager.java	100.00% <100.00%> (ø)
...rch/sql/spark/execution/statement/StatementId.java	100.00% <100.00%> (ø)
.../sql/spark/rest/model/CreateAsyncQueryRequest.java	93.54% <90.00%> (+70.82%)	⬆️
.../spark/asyncquery/model/AsyncQueryJobMetadata.java	82.60% <66.66%> (-2.76%)	⬇️

[penghuo]

change length from 10 to 16, making it similar to EMR-S job id.

[vamsi-amazon]

Nit:: randomAlphaNumeric? random Id is looking bad with "=" and other characters.

[penghuo]

done.