Skip to content

Index Transforms - Schedule start time issue #801

@SDikshaR

Description

@SDikshaR

When creating a transform job, where specified as start_time to run in a few hours in the future. However , always the start_time is set as the time that transform job is created.

Reproduction Steps:

Created a transform job with the start_time as 1684701322 using below API:

PUT _plugins/_transform/sample
{
"transform": {
"enabled": true,
"continuous": true,
"schedule": {
"interval": {
"period": 1,
"unit": "Minutes",
"start_time": 1684701322
}
},
"description": "Sample transform job",
"source_index": "sample1",
"target_index": "sample2",
"data_selection_query": {
"match_all": {}
},
"page_size": 1,
"groups": [
{
"terms": {
"source_field": "color",
"target_field": "colors"
}
}
],
"aggregations": {
}
}
}

OUTPUT:

{
"_id": "sample",
"_version": 1,
"_seq_no": 3407,
"_primary_term": 1,
"transform": {
"transform_id": "sample",
"schema_version": 17,
"schedule": {
"interval": {
"start_time": 1684733779323,
"period": 1,
"unit": "Minutes"
}
},
"metadata_id": null,
"updated_at": 1684733779323,
"enabled": true,
"enabled_at": 1684733779323,
"description": "Sample transform job",
"source_index": "sample1",
"data_selection_query": {
"match_all": {
"boost": 1
}

The time specified in the output is not same as time given at the time of creation

Expected behaviour:

When a specific time is specified then it should return in the output and job to be scheduled at that time.

Tested on:

  • OS: AWS opensearch
  • Version 2.5
  • Plugins

How do we determine the start time of the job as the output is giving different results to the specified start_time .

Metadata

Metadata

Assignees

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions