[meta] 7.5 release

[Mpdreamz]

New features

Features/ILM+SLM

• Add API to execute SLM retention on-demand Add API to execute SLM retention on-demand elasticsearch#47405 (issues: Retention for Snapshot Lifecycle Management elasticsearch#43663, [CI] SLMSnapshotBlockingIntegTests.testRetentionWhileSnapshotInProgress failure on master elasticsearch#46508) - PR: Implement SLM Execute Retention API #4258
• Add retention to Snapshot Lifecycle Management Add retention to Snapshot Lifecycle Management elasticsearch#46407 (issues: Snapshot lifecycle management elasticsearch#38461, Retention for Snapshot Lifecycle Management elasticsearch#43663, Add SLM metrics gathering and endpoint elasticsearch#45362) - PR: Implement setting snapshot retention configuration on SLM lifecycles. #4261

Features/Ingest

• Add enrich processor Add enrich processor elasticsearch#48039 (issue: [ingest] Enrich documents prior to indexing  elasticsearch#32789) - PR: Add enrich processor and APIs #4275

Machine Learning

• Implement evaluation API for multiclass classification problem Implement evaluation API for multiclass classification problem elasticsearch#47126 (issue: [ML] Introduce classification analysis type elasticsearch#46735) no client changes needed as API is not GA
• Implement new analysis type: classification Implement new analysis type: classification elasticsearch#46537 (issue: [ML] Introduce classification analysis type elasticsearch#46735) no client changes needed as API is not GA

Enhancements

Aggregations

• Support geotile_grid aggregation in composite agg sources Support geotile_grid aggregation in composite agg sources elasticsearch#45810 (issue: Support for geohash_grid in composite aggs elasticsearch#40568) - PR: Support geotile_grid aggregation in composite agg sources. #4271

Authorization

• Add support to retrieve all API keys if user has privilege Add support to retrieve all API keys if user has privilege elasticsearch#47274 (issue: Support retrieval of all API keys elasticsearch#46887) - PR: Add support to retrieve all API keys if user has privilege. #4272

CCR

• Add Pause/Resume Auto Follower APIs Add Pause/Resume Auto Follower APIs elasticsearch#47510 (issue: API to pause auto-follow patterns elasticsearch#46665) - PR: Add Pause/Resume Auto Follower APIs #4273

CRUD

• Allow optype CREATE for append-only indexing operations Allow optype CREATE for append-only indexing operations elasticsearch#47169 No client changes needed

Features/ILM+SLM

• Separate SLM stop/start/status API from ILM Separate SLM stop/start/status API from ILM elasticsearch#47710 (issue: Retention for Snapshot Lifecycle Management elasticsearch#43663) - PR: Add SLM Start/Stop/Status APIs #4245
• Add support for POST requests to SLM Execute API Add support for POST requests to SLM Execute API  elasticsearch#47061 - PR: Modify SLM execute lifecycle to use POST method as opposed to PUT. #4246

Features/Ingest

• Add the ability to require an ingest pipeline (also add default if not exist alread) Add the ability to require an ingest pipeline elasticsearch#46847 - PR: Add the ability to require an ingest pipeline. #4274

Machine Learning

• Add option to stop datafeed that finds no data [ML] Add option to stop datafeed that finds no data elasticsearch#47922 - PR: Add option to stop machine learning datafeed that finds no data. #4286
• Add lazy assignment job config option [ML] Add lazy assignment job config option elasticsearch#47726 - PR: Add allow_lazy_open to machine learning jobs. #4277
• Additional outlier detection parameters [ML] Additional outlier detection parameters elasticsearch#47600 no client changes needed, API is not GA

Transform

• [x] Add support for wait_for_checkpoint flag on _stop API [ML][Data Frame] add support for wait_for_checkpoint flag on _stop API elasticsearch#45469 (issue: Add the option to wait until the next checkpoint when stopping a transform elasticsearch#45293) still beta

Bug fixes

Aggregations

• DocValueFormat implementation for date range fields DocValueFormat implementation for date range fields elasticsearch#47472 (issues: Format parameter for Date Histogram over Range Fields elasticsearch#47323, Separation of Concerns in DocValueFormat elasticsearch#47469) no client changes needed

CRUD

• Use optype CREATE for single auto-id index requests Use optype CREATE for single auto-id index requests elasticsearch#47353 no client changes needed
• Ignore replication for noop updates Ignore replication for noop updates elasticsearch#46458 (issues: Simplify TransportShardBulkAction#performOnReplica elasticsearch#41065, Return seq_no and primary_term for noop update elasticsearch#44603, Unexpected request operation type on replica: update elasticsearch#46366) No client changes needed

Features/ILM+SLM

• Add SLM support to xpack usage and info APIs Add SLM support to xpack usage and info APIs elasticsearch#48096 (issue: Retention for Snapshot Lifecycle Management elasticsearch#43663) - PR: Implement Get SLM Stats API #4264
• Change policy_id to list type in slm.get_lifecycle Change policy_id to list type in slm.get_lifecycle elasticsearch#47766 (issue: policy_id type in Get Snapshot Lifecycle API REST spec should be list elasticsearch#47765) - *no client changes needed as generator now emits Ids instead of Id. Will need to call out in breaking changes.
• Throw error retrieving non-existent SLM policy Throw error retrieving non-existent SLM policy elasticsearch#47679 (issue: Snapshot Lifecycle Policy API return empty object instead 404 when policy not exist elasticsearch#47664) - PR: Ensure missing SLM policy is handled by client correctly #4265
• Fixes for API specification Fixes for API specification elasticsearch#46522 - no client changes needed as introduced in 7.4.0

Features/Ingest

• Allow dropping documents with auto-generated ID Allow dropping documents with auto-generated ID elasticsearch#46773 (issue: 7.3.1 master only nodes (not as as ingestion nodes) receive java.lang.NullPointerException / HTTP 500 error during _BULK operations from filebeat elasticsearch#46678) no client changes needed
• Expose cache setting in UserAgentPlugin Expose cache setting in UserAgentPlugin elasticsearch#46533 no client changes needed

[Mpdreamz]

Integration branch 7.5 is cut and brought up to date with the rest-api-spec

https://github.com/elastic/elasticsearch-net/compare/7.x...7.5?expand=1