Skip to content

[Index management] Re-enable index template tests #60780

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 6 commits into from
Mar 21, 2020
Merged

[Index management] Re-enable index template tests #60780

merged 6 commits into from
Mar 21, 2020

Conversation

@sebelga
Copy link
Contributor

@sebelga sebelga commented Mar 20, 2020 •
edited
Loading

This PR fixes the flaky client integration tests that had been removed in 50471f1

Fixes #59934
Fixes #59869
Fixes #59863
Fixes #59861
Fixes #59858
Fixes #59859
Fixes #59855
Fixes #59849
Fixes #59030
Fixes #54890

Note for the reviewer: Open the commit with the diff of changes: 0da4c7d.
Also, the describe('on component mount', () => { block has been closed correctly after its test. This made a lot of "whitespace" changes that should not be taken into account.

@sebelga sebelga requested a review from cjcenizal March 20, 2020 17:03
@sebelga sebelga added release_note:skip Skip the PR/issue when compiling release notes Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more t// v7.7.0 labels Mar 20, 2020
@elasticmachine
Copy link
Contributor

elasticmachine commented Mar 20, 2020

Pinging @elastic/es-ui (Team:Elasticsearch UI)

@cjcenizal cjcenizal requested review from alisonelizabeth and removed request for cjcenizal March 20, 2020 19:42
alisonelizabeth
alisonelizabeth approved these changes Mar 20, 2020
View reviewed changes
Copy link
Contributor

@alisonelizabeth alisonelizabeth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing the tests @sebelga! I ran through them locally and all tests passed. I mainly focused my review on 0da4c7d and left one comment around an existing skipped test.

I also was wondering if you think these tests need to be run multiple times on CI to ensure the flakiness is resolved?

@sebelga
Copy link
Contributor Author

sebelga commented Mar 20, 2020

@elasticmachine merge upstream

@sebelga
Copy link
Contributor Author

sebelga commented Mar 21, 2020

Thanks for the review @alisonelizabeth ! I removed the .skip on the test and fixed it.

I will run a few times the CI to make sure there isn't any flakiness but I am confident they should pass.

@sebelga
Copy link
Contributor Author

sebelga commented Mar 21, 2020

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

kibanamachine commented Mar 21, 2020

💛 Build succeeded, but was flaky

Test Failures

Kibana Pipeline / kibana-oss-agent / Chrome UI Functional Tests.test/functional/apps/dashboard/dashboard_snapshots·js.dashboard app using current data dashboard snapshots compare TSVB snapshot

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 3 times on tracked branches: https://github.com/elastic/kibana/issues/52854

[00:00:00]       │
[00:00:00]         └-: dashboard app
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: using current data
[00:00:00]             └-> "before all" hook
[00:00:00]             └-> "before all" hook: loadCurrentData
[00:00:00]               │ info [logstash_functional] Unloading indices from "mappings.json"
[00:00:00]               │ info [logstash_functional] Unloading indices from "data.json.gz"
[00:00:01]               │ info [dashboard/current/data] Loading "mappings.json"
[00:00:01]               │ info [dashboard/current/data] Loading "data.json.gz"
[00:00:01]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [animals-dogs-2018-01-01] creating index, cause [api], templates [], shards [5]/[1], mappings [_doc]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-dogs-2018-01-01"
[00:00:01]               │ debg [dashboard/current/data] "animals-dogs-2018-01-01" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [animals-dogs-2018-04-10] creating index, cause [api], templates [], shards [5]/[1], mappings [_doc]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-dogs-2018-04-10"
[00:00:01]               │ debg [dashboard/current/data] "animals-dogs-2018-04-10" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [animals-cats-2018-01-01] creating index, cause [api], templates [], shards [5]/[1], mappings [_doc]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-cats-2018-01-01"
[00:00:01]               │ debg [dashboard/current/data] "animals-cats-2018-01-01" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [animals-cats-2018-04-10] creating index, cause [api], templates [], shards [5]/[1], mappings [_doc]
[00:00:01]               │ info [dashboard/current/data] Created index "animals-cats-2018-04-10"
[00:00:01]               │ debg [dashboard/current/data] "animals-cats-2018-04-10" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:01]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [dogbreeds] creating index, cause [api], templates [], shards [5]/[1], mappings [_doc]
[00:00:02]               │ info [dashboard/current/data] Created index "dogbreeds"
[00:00:02]               │ debg [dashboard/current/data] "dogbreeds" settings {"index":{"number_of_replicas":"1","number_of_shards":"5"}}
[00:00:02]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [logstash-0] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:00:02]               │ info [dashboard/current/data] Created index "logstash-0"
[00:00:02]               │ debg [dashboard/current/data] "logstash-0" settings {"index":{"analysis":{"analyzer":{"makelogs_url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:11]               │ info progress: 10529
[00:00:13]               │ info [dashboard/current/data] Indexed 6 docs into "animals-dogs-2018-01-01"
[00:00:13]               │ info [dashboard/current/data] Indexed 6 docs into "animals-dogs-2018-04-10"
[00:00:13]               │ info [dashboard/current/data] Indexed 6 docs into "animals-cats-2018-01-01"
[00:00:13]               │ info [dashboard/current/data] Indexed 5 docs into "animals-cats-2018-04-10"
[00:00:13]               │ info [dashboard/current/data] Indexed 6 docs into "dogbreeds"
[00:00:13]               │ info [dashboard/current/data] Indexed 14005 docs into "logstash-0"
[00:15:15]             └-: dashboard snapshots
[00:15:15]               └-> "before all" hook
[00:15:15]               └-> "before all" hook
[00:15:15]                 │ info [dashboard/current/kibana] Loading "mappings.json"
[00:15:15]                 │ info [dashboard/current/kibana] Loading "data.json.gz"
[00:15:15]                 │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/FAsVSinzQTiZvrNV-pLb8w] deleting index
[00:15:15]                 │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_1/XkcC8QY2Q2CecILAgKwlAQ] deleting index
[00:15:15]                 │ info [dashboard/current/kibana] Deleted existing index [".kibana_2",".kibana_1"]
[00:15:15]                 │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:15:15]                 │ info [dashboard/current/kibana] Created index ".kibana"
[00:15:15]                 │ debg [dashboard/current/kibana] ".kibana" settings {"index":{"auto_expand_replicas":"0-1","number_of_replicas":"0","number_of_shards":"1"}}
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana/CeAKuGt4SuGPTH7TOv8pyw] update_mapping [_doc]
[00:15:15]                 │ info [dashboard/current/kibana] Indexed 84 docs into ".kibana"
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana/CeAKuGt4SuGPTH7TOv8pyw] update_mapping [_doc]
[00:15:15]                 │ debg Migrating saved objects
[00:15:15]                 │ proc [kibana]   log   [13:46:47.413] [info][savedobjects-service] Creating index .kibana_2.
[00:15:15]                 │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:15:15]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] updating number_of_replicas to [0] for indices [.kibana_2]
[00:15:15]                 │ proc [kibana]   log   [13:46:47.459] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:15:15]                 │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:15:15]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] updating number_of_replicas to [0] for indices [.kibana_1]
[00:15:15]                 │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] 8931 finished with response BulkByScrollResponse[took=42.6ms,timed_out=false,sliceId=null,updated=0,created=84,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:15:15]                 │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana/CeAKuGt4SuGPTH7TOv8pyw] deleting index
[00:15:15]                 │ proc [kibana]   log   [13:46:47.780] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:15]                 │ proc [kibana]   log   [13:46:48.026] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:15:15]                 │ proc [kibana]   log   [13:46:48.102] [info][savedobjects-service] Finished in 694ms.
[00:15:15]                 │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:15:16]                 │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-centos-tests-xl-1584796435310675355] [.kibana_2/-XUIZ-7xSn-aK8sMwFzBEQ] update_mapping [_doc]
[00:15:17]                 │ debg replacing kibana config doc: {"defaultIndex":"0bf35f60-3dc9-11e8-8660-4d65aa086b3c"}
[00:15:18]                 │ debg ======browser======== setWindowSize 1000 500
[00:15:18]                 │ debg ======browser======== actual initial screenshot size width=1200, height=800
[00:15:19]                 │ debg ======browser======== actual second screenshot size width= 600, height=400
[00:15:19]                 │ debg ======browser======== calculated values xBorder= 0, yBorder=0, xScaling=1, yScaling=1
[00:15:19]                 │ debg ======browser======== setting browser size to 1000 x 500
[00:15:19]                 │ debg ======browser======== final screenshot size width=1000, height=500
[00:15:19]                 │ debg navigating to dashboard url: http://localhost:6131/app/kibana#/dashboards
[00:15:19]                 │ debg Navigate to: http://localhost:6131/app/kibana#/dashboards
[00:15:19]                 │ debg ... sleep(700) start
[00:15:19]                 │ debg browser[INFO] http://localhost:6131/app/kibana?_t=1584798411588#/dashboards 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:15:19]                 │
[00:15:19]                 │ debg browser[INFO] http://localhost:6131/bundles/app/kibana/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:15:20]                 │ debg ... sleep(700) end
[00:15:20]                 │ debg returned from get, calling refresh
[00:15:21]                 │ debg browser[INFO] http://localhost:6131/app/kibana?_t=1584798411588#/dashboards 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:15:21]                 │
[00:15:21]                 │ debg browser[INFO] http://localhost:6131/bundles/app/kibana/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:15:22]                 │ debg currentUrl = http://localhost:6131/app/kibana#/dashboards
[00:15:22]                 │          appUrl = http://localhost:6131/app/kibana#/dashboards
[00:15:22]                 │ debg TestSubjects.find(kibanaChrome)
[00:15:22]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:15:27]                 │ debg TestSubjects.find(kibanaChrome)
[00:15:27]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=10000
[00:15:27]                 │ debg browser[INFO] http://localhost:6131/bundles/plugin/data/data.plugin.js 96:139970 "INFO: 2020-03-21T13:46:57Z
[00:15:27]                 │        Adding connection to http://localhost:6131/elasticsearch
[00:15:27]                 │
[00:15:27]                 │      "
[00:15:27]                 │ debg ... sleep(501) start
[00:15:27]                 │ debg ... sleep(501) end
[00:15:27]                 │ debg in navigateTo url = http://localhost:6131/app/kibana#/dashboards?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:now-15m,to:now))
[00:15:27]                 │ debg TestSubjects.exists(statusPageContainer)
[00:15:27]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:15:30]                 │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:15:30]               └-> compare TSVB snapshot
[00:15:30]                 └-> "before each" hook: global before each
[00:15:30]                 │ debg gotoDashboardLandingPage
[00:15:30]                 │ debg onDashboardLandingPage
[00:15:30]                 │ debg TestSubjects.exists(dashboardLandingPage)
[00:15:30]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="dashboardLandingPage"]') with timeout=5000
[00:15:30]                 │ debg TestSubjects.exists(newItemButton)
[00:15:30]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="newItemButton"]') with timeout=2500
[00:15:31]                 │ debg TestSubjects.click(newItemButton)
[00:15:31]                 │ debg Find.clickByCssSelector('[data-test-subj="newItemButton"]') with timeout=10000
[00:15:31]                 │ debg Find.findByCssSelector('[data-test-subj="newItemButton"]') with timeout=10000
[00:15:31]                 │ debg Setting absolute range to Apr 9, 2018 @ 00:00:00.000 to Apr 13, 2018 @ 00:00:00.000
[00:15:31]                 │ debg TestSubjects.exists(superDatePickerToggleQuickMenuButton)
[00:15:31]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerToggleQuickMenuButton"]') with timeout=20000
[00:15:31]                 │ debg TestSubjects.exists(superDatePickerShowDatesButton)
[00:15:31]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=2500
[00:15:32]                 │ debg TestSubjects.click(superDatePickerShowDatesButton)
[00:15:32]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=10000
[00:15:32]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=10000
[00:15:32]                 │ debg TestSubjects.exists(superDatePickerstartDatePopoverButton)
[00:15:32]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=2500
[00:15:32]                 │ debg TestSubjects.click(superDatePickerendDatePopoverButton)
[00:15:32]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerendDatePopoverButton"]') with timeout=10000
[00:15:32]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerendDatePopoverButton"]') with timeout=10000
[00:15:32]                 │ debg Find.findByCssSelector('div.euiPopover__panel-isOpen') with timeout=10000
[00:15:32]                 │ debg TestSubjects.click(superDatePickerAbsoluteTab)
[00:15:32]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:15:32]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:15:32]                 │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:15:32]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:32]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:32]                 │ debg TestSubjects.setValue(superDatePickerAbsoluteDateInput, Apr 13, 2018 @ 00:00:00.000)
[00:15:32]                 │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:15:32]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:32]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:33]                 │ debg ... sleep(500) start
[00:15:34]                 │ debg ... sleep(500) end
[00:15:34]                 │ debg TestSubjects.click(superDatePickerstartDatePopoverButton)
[00:15:34]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=10000
[00:15:34]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=10000
[00:15:34]                 │ debg Find.waitForElementStale with timeout=10000
[00:15:35]                 │ debg Find.findByCssSelector('div.euiPopover__panel-isOpen') with timeout=10000
[00:15:35]                 │ debg TestSubjects.click(superDatePickerAbsoluteTab)
[00:15:35]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:15:35]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:15:35]                 │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:15:35]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:35]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:35]                 │ debg TestSubjects.setValue(superDatePickerAbsoluteDateInput, Apr 9, 2018 @ 00:00:00.000)
[00:15:35]                 │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:15:35]                 │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:35]                 │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:15:36]                 │ debg TestSubjects.exists(superDatePickerApplyTimeButton)
[00:15:36]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerApplyTimeButton"]') with timeout=2500
[00:15:38]                 │ debg --- retry.tryForTime error: [data-test-subj="superDatePickerApplyTimeButton"] is not displayed
[00:15:39]                 │ debg TestSubjects.click(querySubmitButton)
[00:15:39]                 │ debg Find.clickByCssSelector('[data-test-subj="querySubmitButton"]') with timeout=10000
[00:15:39]                 │ debg Find.findByCssSelector('[data-test-subj="querySubmitButton"]') with timeout=10000
[00:15:40]                 │ debg Find.waitForElementStale with timeout=10000
[00:15:40]                 │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:15:40]                 │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:15:40]                 │ debg DashboardAddPanel.addEmbeddable, name: Rendering Test: tsvb-ts, type: visualization
[00:15:40]                 │ debg DashboardAddPanel.ensureAddPanelIsShowing
[00:15:40]                 │ debg DashboardAddPanel.isAddPanelOpen
[00:15:40]                 │ debg TestSubjects.exists(dashboardAddPanel)
[00:15:40]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="dashboardAddPanel"]') with timeout=2500
[00:15:42]                 │ debg --- retry.tryForTime error: [data-test-subj="dashboardAddPanel"] is not displayed
[00:15:43]                 │ debg DashboardAddPanel.clickOpenAddPanel
[00:15:43]                 │ debg TestSubjects.click(dashboardAddPanelButton)
[00:15:43]                 │ debg Find.clickByCssSelector('[data-test-subj="dashboardAddPanelButton"]') with timeout=10000
[00:15:43]                 │ debg Find.findByCssSelector('[data-test-subj="dashboardAddPanelButton"]') with timeout=10000
[00:15:43]                 │ debg ... sleep(500) start
[00:15:44]                 │ debg ... sleep(500) end
[00:15:44]                 │ debg DashboardAddPanel.isAddPanelOpen
[00:15:44]                 │ debg TestSubjects.exists(dashboardAddPanel)
[00:15:44]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="dashboardAddPanel"]') with timeout=2500
[00:15:44]                 │ debg DashboardAddPanel.addToFilter(visualization)
[00:15:44]                 │ debg Find.waitForDeletedByCssSelector('[data-test-subj="savedObjectFinderLoadingIndicator"]') with timeout=10000
[00:15:44]                 │ debg DashboardAddPanel.toggleFilter
[00:15:44]                 │ debg TestSubjects.click(savedObjectFinderFilterButton)
[00:15:44]                 │ debg Find.clickByCssSelector('[data-test-subj="savedObjectFinderFilterButton"]') with timeout=10000
[00:15:44]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectFinderFilterButton"]') with timeout=10000
[00:15:44]                 │ debg TestSubjects.click(savedObjectFinderFilter-visualization)
[00:15:44]                 │ debg Find.clickByCssSelector('[data-test-subj="savedObjectFinderFilter-visualization"]') with timeout=10000
[00:15:44]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectFinderFilter-visualization"]') with timeout=10000
[00:15:44]                 │ debg DashboardAddPanel.toggleFilter
[00:15:44]                 │ debg TestSubjects.click(savedObjectFinderFilterButton)
[00:15:44]                 │ debg Find.clickByCssSelector('[data-test-subj="savedObjectFinderFilterButton"]') with timeout=10000
[00:15:44]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectFinderFilterButton"]') with timeout=10000
[00:15:45]                 │ debg Find.waitForDeletedByCssSelector('[data-test-subj="savedObjectFinderLoadingIndicator"]') with timeout=10000
[00:15:45]                 │ debg TestSubjects.setValue(savedObjectFinderSearchInput, "Rendering Test: tsvb ts")
[00:15:45]                 │ debg TestSubjects.click(savedObjectFinderSearchInput)
[00:15:45]                 │ debg Find.clickByCssSelector('[data-test-subj="savedObjectFinderSearchInput"]') with timeout=10000
[00:15:45]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectFinderSearchInput"]') with timeout=10000
[00:15:46]                 │ debg Find.waitForDeletedByCssSelector('[data-test-subj="savedObjectFinderLoadingIndicator"]') with timeout=10000
[00:15:46]                 │ debg TestSubjects.click(savedObjectTitleRendering-Test:-tsvb-ts)
[00:15:46]                 │ debg Find.clickByCssSelector('[data-test-subj="savedObjectTitleRendering-Test:-tsvb-ts"]') with timeout=10000
[00:15:46]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectTitleRendering-Test:-tsvb-ts"]') with timeout=10000
[00:15:46]                 │ debg TestSubjects.exists(addObjectToDashboardSuccess)
[00:15:46]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addObjectToDashboardSuccess"]') with timeout=2500
[00:15:49]                 │ debg --- retry.tryForTime error: [data-test-subj="addObjectToDashboardSuccess"] is not displayed
[00:15:50]                 │ debg TestSubjects.exists(dashboardAddPanel)
[00:15:50]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="dashboardAddPanel"]') with timeout=1000
[00:15:50]                 │ debg Closing flyout dashboardAddPanel
[00:15:50]                 │ debg TestSubjects.find(dashboardAddPanel)
[00:15:50]                 │ debg Find.findByCssSelector('[data-test-subj="dashboardAddPanel"]') with timeout=10000
[00:15:50]                 │ debg Waiting up to 20000ms for flyout closed...
[00:15:50]                 │ debg TestSubjects.exists(dashboardAddPanel)
[00:15:50]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="dashboardAddPanel"]') with timeout=1000
[00:15:51]                 │ debg --- retry.tryForTime error: [data-test-subj="dashboardAddPanel"] is not displayed
[00:15:51]                 │ debg Find.existsByCssSelector('.euiToast') with timeout=2500
[00:15:51]                 │ debg Find.findByCssSelector('.euiToast') with timeout=20000
[00:15:52]                 │ debg Find.findByCssSelector('.euiToastHeader__title') with timeout=10000
[00:15:52]                 │ debg Toast title: 
[00:15:52]                 │ debg Find.clickByCssSelector('.euiToast__closeButton') with timeout=10000
[00:15:52]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:15:52]                 │ warn WebElementWrapper.click: stale element reference: element is not attached to the page document
[00:15:52]                 │        (Session info: headless chrome=80.0.3987.149)
[00:15:52]                 │        (Driver info: chromedriver=80.0.3987.16 (320f6526c1632ad4f205ebce69b99a062ed78647-refs/branch-heads/3987@{#185}),platform=Linux 3.10.0-1062.12.1.el7.x86_64 x86_64)
[00:15:52]                 │ debg finding element 'By(css selector, .euiToast__closeButton)' again, 2 attempts left
[00:16:02]                 │ debg --- retry.try error: no such element: Unable to locate element: {"method":"css selector","selector":".euiToast__closeButton"}
[00:16:02]                 │        (Session info: headless chrome=80.0.3987.149)
[00:16:02]                 │        (Driver info: chromedriver=80.0.3987.16 (320f6526c1632ad4f205ebce69b99a062ed78647-refs/branch-heads/3987@{#185}),platform=Linux 3.10.0-1062.12.1.el7.x86_64 x86_64)
[00:16:02]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:16:12]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:16:12]                 │      Wait timed out after 10057ms
[00:16:13]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:16:23]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:16:23]                 │      Wait timed out after 10013ms
[00:16:24]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:16:34]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:16:34]                 │      Wait timed out after 10038ms
[00:16:34]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:16:44]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:16:44]                 │      Wait timed out after 10020ms
[00:16:45]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:16:55]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:16:55]                 │      Wait timed out after 10030ms
[00:16:55]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:17:05]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:17:05]                 │      Wait timed out after 10028ms
[00:17:06]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:17:16]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:17:16]                 │      Wait timed out after 10037ms
[00:17:16]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:17:26]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:17:26]                 │      Wait timed out after 10043ms
[00:17:27]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:17:37]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:17:37]                 │      Wait timed out after 10019ms
[00:17:37]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:17:47]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:17:47]                 │      Wait timed out after 10018ms
[00:17:48]                 │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:17:58]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, .euiToast__closeButton)
[00:17:58]                 │      Wait timed out after 10060ms
[00:17:58]                 │ info Taking screenshot "/dev/shm/workspace/kibana/test/functional/screenshots/failure/dashboard app using current data dashboard snapshots compare TSVB snapshot.png"
[00:17:58]                 │ info Current URL is: http://localhost:6131/app/kibana#/dashboard?_g=(filters:!(),refreshInterval:(pause:!t,value:0),time:(from:%272018-04-09T00:00:00.000Z%27,to:%272018-04-13T00:00:00.000Z%27))&_a=(description:%27%27,filters:!(),fullScreenMode:!f,options:(hidePanelTitles:!f,useMargins:!t),panels:!((embeddableConfig:(),gridData:(h:15,i:%2723d6b940-ab1a-4ef8-80ca-bea0477e8542%27,w:24,x:0,y:0),id:c40f4d40-3dcc-11e8-8660-4d65aa086b3c,panelIndex:%2723d6b940-ab1a-4ef8-80ca-bea0477e8542%27,type:visualization,version:%278.0.0-SNAPSHOT%27)),query:(language:kuery,query:%27%27),timeRestore:!f,title:%27%27,viewMode:edit)
[00:17:58]                 │ info Saving page source to: /dev/shm/workspace/kibana/test/functional/failure_debug/html/dashboard app using current data dashboard snapshots compare TSVB snapshot.html
[00:17:58]                 └- ✖ fail: "dashboard app using current data dashboard snapshots compare TSVB snapshot"
[00:17:58]                 │

Stack Trace

Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, .euiToast__closeButton)
Wait timed out after 10060ms
    at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:841:17
    at process._tickCallback (internal/process/next_tick.js:68:7)
    at onFailure (test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (test/common/services/retry/retry_for_success.ts:68:13)

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@sebelga sebelga merged commit 8ccaa2e into elastic:master Mar 21, 2020
@sebelga sebelga added the backport:skip This PR does not require backporting label Mar 21, 2020
@sebelga sebelga deleted the fix/index_management_tests branch March 21, 2020 16:01
@sebelga sebelga mentioned this pull request Mar 23, 2020
Merged
gmmorris added a commit to gmmorris/kibana that referenced this pull request Mar 23, 2020
@gmmorris
Merge branch 'master' into alerting/tls-warning
6230180 
* master: (39 commits)
  [APM]Create custom link from Trace summary (elastic#59648)
  [ML] Fixing app clean up (elastic#60853)
  [SIEM] Use ECS categorisation for Authentication widgets (elastic#60734)
  [NP] Remove kbnUrl usage in discover/dashboard/visualize (elastic#60016)
  Skip failing test
  [Uptime]Update fetch effect failed action handling (elastic#60742)
  [npm] upgrade elastic/maki (elastic#60829)
  [Uptime] Add Settings Page (elastic#53550)
  [APM] service maps: avoid unnecesary `useDeepObjectIdentity` (elastic#60836)
  [Index management] Re-enable index template tests (elastic#60780)
  Fixed UI/UX issues: alerts delete confirmation, combobox behaviors (elastic#60703)
  [SIEM] Fix patching of ML Rules (elastic#60830)
  [APM] Service Map - Separate overlapping edges by rotating nodes (elastic#60477)
  [Alerting] fix flaky test for index threshold grouping (elastic#60792)
  [SIEM][Detection Engine] Adds test scripts for machine learning feature
  Flatten child api response for resolver (elastic#60810)
  Change "url" to "urls" in APM agent instructions (elastic#60790)
  [DOCS] Updates API requests and examples (elastic#60695)
  [SIEM] [Cases] Create case from timeline (elastic#60711)
  [Lens] Resetting a layer generates new suggestions (elastic#60674)
  ...
sebelga added a commit that referenced this pull request Mar 23, 2020
@sebelga
[7.x] [Index management] Re-enable index template tests (#60780) (#60891
4da7cd1 
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@alisonelizabeth alisonelizabeth alisonelizabeth approved these changes

Assignees

No one assigned

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more t// test-jest-integration v7.7.0 v8.0.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount review (step 5) tabs should navigate to the Request tab Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount form validation aliases (step 4) should set the correct page title Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateClone /> form payload should send the correct payload Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/public/application/components/mappings_editor/components/load_mappings - <LoadMappingsProvider /> it should forward valid mapping definition Failing test: X-Pack Jest Tests.x-pack/legacy/plugins/index_management/__jest__/client_integration - <TemplateEdit /> with mappings form payload should send the correct payload with changed values
Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount review (step 5) should render a warning message if a wildcard is used as an index pattern Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount review (step 5) tabs should have 2 tabs Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount form validation aliases (step 4) should not allow invalid json Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount form payload & api errors should surface the API errors from the put HTTP request Failing test: X-Pack Jest Tests.x-pack/plugins/index_management/__jest__/client_integration - <TemplateCreate /> on component mount review (step 5) should set the correct step title

4 participants

@sebelga @elasticmachine @kibanamachine @alisonelizabeth