Skip to content

[DOCS] Add 7.4 breaking changes for transforms and data frame analytics #47034

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Sep 25, 2019
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
62 changes: 62 additions & 0 deletions docs/reference/migration/migrate_7_4.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -139,3 +139,65 @@ deprecated, and will be removed in version 8.0.0. Instead, use `node.pidfile`.
To ensure that all settings are in a proper namespace, the `processors` setting
is deprecated, and will be removed in version 8.0.0. Instead, use
`node.processors`.

[discrete]
[[breaking_74_transform_changes]]
=== {transform-cap} changes

[discrete]
[[transform_stats_format]]
==== Stats response format changes

The response format of the <<get-transform-stats>> is very different
to previous versions:

- `task_state` and `indexer_state` are combined into a single `state` field
that replaces the old `state` object.
- Within the `checkpointing` object, `current` is renamed to `last` and
`in_progress` to `next`.
- The `checkpoint` number is now nested under `last` and `next`.
- `checkpoint_progress` is now reported in an object nested in the `next`
checkpoint object. (If there is no `next` checkpoint then no checkpoint is
in progress and by definition the `last` checkpoint is 100% complete.)

For an example of the new format see <<get-transform-stats-example>>.

[discrete]
[[breaking_74_df_analytics_changes]]
=== {dfanalytics-cap} changes

[discrete]
[[progress_reporting_change]]
==== Changes to progress reporting

The single integer `progress_percent` field at the top level of the
{dfanalytics-job} stats is replaced by a `progress` field that is an array
of objects. Each object contains the `phase` name and `progress_percent` of one
phase of the analytics. For example:

[source,js]
----
{
"id" : "my_job",
"state" : "analyzing",
"progress" : [
{
"phase" : "reindexing",
"progress_percent" : 100
},
{
"phase" : "loading_data",
"progress_percent" : 100
},
{
"phase" : "analyzing",
"progress_percent" : 47
},
{
"phase" : "writing_results",
"progress_percent" : 0
}
]
}
----
// NOTCONSOLE