[7.x] [baseline/capture] use high-memory nodes with ramDisks (#71894) #72209

spalger · 2020-07-17T00:14:13Z

Backports the following commits to 7.x:

[baseline/capture] use high-memory nodes with ramDisks ([baseline/capture] use high-memory nodes with ramDisks #71894)

Co-authored-by: spalger <spalger@users.noreply.github.com>

kibanamachine · 2020-07-17T02:09:06Z

💛 Build succeeded, but was flaky

continuous-integration/kibana-ci/pull-request
Commit: 77bf10a
Flaky suites:
- xpack-kibana-ciGroup6

Test Failures

Kibana Pipeline / kibana-xpack-agent / X-Pack API Integration Tests.x-pack/test/api_integration/apis/fleet/unenroll_agent·ts.apis Fleet Endpoints fleet_unenroll_agent allow to unenroll using a list of ids

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 8 times on tracked branches: https://github.com/elastic/kibana/issues/64696

[00:00:00]       │
[00:00:00]         └-: apis
[00:00:00]           │ proc [kibana]   log   [01:07:29.090] [warning][plugins][reporting] Enabling the Chromium sandbox provides an additional layer of protection.
[00:00:00]           └-> "before all" hook
[00:07:58]           └-: Fleet Endpoints
[00:07:58]             └-> "before all" hook
[00:08:02]             └-: fleet_unenroll_agent
[00:08:02]               └-> "before all" hook
[00:08:02]               └-> "before all" hook
[00:08:02]                 │ info [fleet/agents] Loading "mappings.json"
[00:08:02]                 │ info [fleet/agents] Loading "data.json"
[00:08:02]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/zpMcFbzmTAiE2t_o71N9Pw] deleting index
[00:08:02]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_1/54TDi2gwROqMvV58CrBsqA] deleting index
[00:08:02]                 │ info [fleet/agents] Deleted existing index [".kibana_2",".kibana_1"]
[00:08:02]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_1] creating index, cause [api], templates [], shards [1]/[0]
[00:08:02]                 │ info [fleet/agents] Created index ".kibana_1"
[00:08:02]                 │ debg [fleet/agents] ".kibana_1" settings {"index":{"auto_expand_replicas":"0-1","number_of_replicas":"0","number_of_shards":"1"}}
[00:08:02]                 │ info [fleet/agents] Indexed 12 docs into ".kibana"
[00:08:02]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_1/xw5DYaX-TTi0WGwNJ27Yow] update_mapping [_doc]
[00:08:02]                 │ debg Migrating saved objects
[00:08:02]                 │ proc [kibana]   log   [01:15:31.933] [info][savedobjects-service] Detected mapping change in "dynamic"
[00:08:02]                 │ proc [kibana]   log   [01:15:31.937] [info][savedobjects-service] Creating index .kibana_2.
[00:08:02]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:08:02]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] updating number_of_replicas to [0] for indices [.kibana_2]
[00:08:02]                 │ proc [kibana]   log   [01:15:32.048] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:08:02]                 │ proc [kibana]   log   [01:15:32.068] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:08:03]                 │ proc [kibana]   log   [01:15:32.153] [info][savedobjects-service] Finished in 219ms.
[00:08:03]               └-> "before all" hook
[00:08:03]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/uXR0zDzyT2S-v3wDXR1QHQ] update_mapping [_doc]
[00:08:03]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [events-index_pattern_placeholder] creating index, cause [api], templates [], shards [1]/[1]
[00:08:03]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [logs-index_pattern_placeholder] creating index, cause [api], templates [], shards [1]/[1]
[00:08:03]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [metrics-index_pattern_placeholder] creating index, cause [api], templates [], shards [1]/[1]
[00:08:05]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/uXR0zDzyT2S-v3wDXR1QHQ] update_mapping [_doc]
[00:08:05]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/uXR0zDzyT2S-v3wDXR1QHQ] update_mapping [_doc]
[00:08:05]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/uXR0zDzyT2S-v3wDXR1QHQ] update_mapping [_doc]
[00:08:05]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/uXR0zDzyT2S-v3wDXR1QHQ] update_mapping [_doc]
[00:08:06]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] [.kibana_2/uXR0zDzyT2S-v3wDXR1QHQ] update_mapping [_doc]
[00:08:06]                 │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [metrics-endpoint.metadata-mappings]
[00:08:06]                 │ proc [kibana]  error  [01:15:35.408] [warning][process] UnhandledPromiseRejectionWarning: Error: [epm-packages:system]: version conflict, required seqNo [16], primary term [1]. current document has seqNo [90] and primary term [1]: [version_conflict_engine_exception] [epm-packages:system]: version conflict, required seqNo [16], primary term [1]. current document has seqNo [90] and primary term [1], with { index_uuid="uXR0zDzyT2S-v3wDXR1QHQ" & shard="0" & index=".kibana_2" }
[00:08:06]                 │ proc [kibana]     at respond (/dev/shm/workspace/install/kibana-7/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:08:06]                 │ proc [kibana]     at checkRespForFailure (/dev/shm/workspace/install/kibana-7/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:08:06]                 │ proc [kibana]     at HttpConnector.<anonymous> (/dev/shm/workspace/install/kibana-7/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:08:06]                 │ proc [kibana]     at IncomingMessage.wrapper (/dev/shm/workspace/install/kibana-7/node_modules/lodash/lodash.js:4929:19)
[00:08:06]                 │ proc [kibana]     at IncomingMessage.emit (events.js:203:15)
[00:08:06]                 │ proc [kibana]     at endReadableNT (_stream_readable.js:1145:12)
[00:08:06]                 │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:63:19)
[00:08:06]                 │ proc [kibana]     at emitWarning (internal/process/promises.js:97:15)
[00:08:06]                 │ proc [kibana]     at emitPromiseRejectionWarnings (internal/process/promises.js:143:7)
[00:08:06]                 │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:69:34)
[00:08:06]                 │ proc [kibana]  error  [01:15:35.410] [warning][process] Error: [epm-packages:system]: version conflict, required seqNo [16], primary term [1]. current document has seqNo [90] and primary term [1]: [version_conflict_engine_exception] [epm-packages:system]: version conflict, required seqNo [16], primary term [1]. current document has seqNo [90] and primary term [1], with { index_uuid="uXR0zDzyT2S-v3wDXR1QHQ" & shard="0" & index=".kibana_2" }
[00:08:06]                 │ proc [kibana]     at respond (/dev/shm/workspace/install/kibana-7/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:08:06]                 │ proc [kibana]     at checkRespForFailure (/dev/shm/workspace/install/kibana-7/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:08:06]                 │ proc [kibana]     at HttpConnector.<anonymous> (/dev/shm/workspace/install/kibana-7/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:08:06]                 │ proc [kibana]     at IncomingMessage.wrapper (/dev/shm/workspace/install/kibana-7/node_modules/lodash/lodash.js:4929:19)
[00:08:06]                 │ proc [kibana]     at IncomingMessage.emit (events.js:203:15)
[00:08:06]                 │ proc [kibana]     at endReadableNT (_stream_readable.js:1145:12)
[00:08:06]                 │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:63:19)
[00:08:06]                 │ proc [kibana]  error  [01:15:35.456] [warning][process] PromiseRejectionHandledWarning: Promise rejection was handled asynchronously (rejection id: 111)
[00:08:06]                 │ proc [kibana]     at handledRejection (internal/process/promises.js:71:23)
[00:08:06]                 │ proc [kibana]     at promiseRejectHandler (internal/process/promises.js:36:14)
[00:08:06]                 │ proc [kibana]     at Promise.then (<anonymous>)
[00:08:06]                 │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:68:7)
[00:08:06]                 │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [metrics-endpoint.policy-mappings]
[00:08:06]               └-> allow to unenroll using a list of ids
[00:08:06]                 └-> "before each" hook: global before each
[00:08:06]                 └-> "before each" hook
[00:08:06]                   │ proc [kibana]  error  [01:15:35.412]  Error: Internal Server Error
[00:08:06]                   │ proc [kibana]     at HapiResponseAdapter.toError (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/response_adapter.js:132:19)
[00:08:06]                   │ proc [kibana]     at HapiResponseAdapter.toHapiResponse (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/response_adapter.js:86:19)
[00:08:06]                   │ proc [kibana]     at HapiResponseAdapter.handle (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/response_adapter.js:81:17)
[00:08:06]                   │ proc [kibana]     at Router.handle (/dev/shm/workspace/install/kibana-7/src/core/server/http/router/router.js:162:34)
[00:08:06]                   │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:68:7)
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.events.process-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.events.security-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.events.library-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.events.network-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.events.registry-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.alerts-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [metrics-endpoint.metrics-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding component template [logs-endpoint.events.file-mappings]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [metrics-endpoint.metadata] for index patterns [metrics-endpoint.metadata-*]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [metrics-endpoint.policy] for index patterns [metrics-endpoint.policy-*]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.events.process] for index patterns [logs-endpoint.events.process-*]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.events.security] for index patterns [logs-endpoint.events.security-*]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.events.library] for index patterns [logs-endpoint.events.library-*]
[00:08:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.events.network] for index patterns [logs-endpoint.events.network-*]
[00:08:07]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.events.registry] for index patterns [logs-endpoint.events.registry-*]
[00:08:07]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.alerts] for index patterns [logs-endpoint.alerts-*]
[00:08:07]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [metrics-endpoint.metrics] for index patterns [metrics-endpoint.metrics-*]
[00:08:07]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-debian-tests-xl-1594944896256663327] adding index template [logs-endpoint.events.file] for index patterns [logs-endpoint.events.file-*]
[00:08:08]                 └- ✖ fail: apis Fleet Endpoints fleet_unenroll_agent allow to unenroll using a list of ids
[00:08:08]                 │      Error: expected 200 "OK", got 500 "Internal Server Error"
[00:08:08]                 │       at Test._assertStatus (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:268:12)
[00:08:08]                 │       at Test._assertFunction (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:283:11)
[00:08:08]                 │       at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:173:18)
[00:08:08]                 │       at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
[00:08:08]                 │       at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
[00:08:08]                 │       at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/index.js:718:3)
[00:08:08]                 │       at parser (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/index.js:906:18)
[00:08:08]                 │       at IncomingMessage.res.on (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/parsers/json.js:19:7)
[00:08:08]                 │       at endReadableNT (_stream_readable.js:1145:12)
[00:08:08]                 │       at process._tickCallback (internal/process/next_tick.js:63:19)
[00:08:08]                 │ 
[00:08:08]                 │

Stack Trace

Error: expected 200 "OK", got 500 "Internal Server Error"
    at Test._assertStatus (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:268:12)
    at Test._assertFunction (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:283:11)
    at Test.assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:173:18)
    at assert (/dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/index.js:718:3)
    at parser (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/index.js:906:18)
    at IncomingMessage.res.on (/dev/shm/workspace/kibana/node_modules/superagent/lib/node/parsers/json.js:19:7)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19)

Build metrics

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[baseline/capture] use high-memory nodes with ramDisks (elastic#71894)

77bf10a

Co-authored-by: spalger <spalger@users.noreply.github.com>

spalger added the backport This PR is a backport of another PR label Jul 17, 2020

spalger merged commit bd38fe6 into elastic:7.x Jul 17, 2020

spalger deleted the backport/7.x/pr-71894 branch July 17, 2020 02:09

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[7.x] [baseline/capture] use high-memory nodes with ramDisks (#71894) #72209

[7.x] [baseline/capture] use high-memory nodes with ramDisks (#71894) #72209

Uh oh!

spalger commented Jul 17, 2020

Uh oh!

kibanamachine commented Jul 17, 2020

Standard Out

Stack Trace

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[7.x] [baseline/capture] use high-memory nodes with ramDisks (#71894) #72209

[7.x] [baseline/capture] use high-memory nodes with ramDisks (#71894) #72209

Uh oh!

Conversation

spalger commented Jul 17, 2020

Uh oh!

kibanamachine commented Jul 17, 2020

💛 Build succeeded, but was flaky

Test Failures

Standard Out

Stack Trace

Build metrics

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants