Skip to content

CoordinatorTests.testIncompatibleDiffResendsFullState failures #38867

New issue
New issue
Closed
#39345
Closed
CoordinatorTests.testIncompatibleDiffResendsFullState failures#38867
#39345
Assignees
ywelsch
Labels
:Distributed Coordination/Cluster CoordinationCluster formation and cluster state publication, including cluster membership and fault detection.>test-failureTriaged test failures from CIv7.0.0-rc2v8.0.0-alpha1
@talevy

Description

@talevy
talevy
opened on Feb 13, 2019

num occurrences: 5 times in February thus far

issue in CI:

"summary": "FAILURE CoordinatorTests testIncompatibleDiffResendsFullState",
"test": "testIncompatibleDiffResendsFullState",
"error-type": "failure", 
"type": "java.lang.AssertionError", 
"message": "node0 is a follower of node1 Expected: is <FOLLOWER>      but: was <CANDIDATE>",
"class": "org.elasticsearch.cluster.coordination.CoordinatorTests"

reproduce

./gradlew :server:unitTest \
  -Dtests.seed=B522B596F86A6D3A \
  -Dtests.class=org.elasticsearch.cluster.coordination.CoordinatorTests \
  -Dtests.method="testIncompatibleDiffResendsFullState" \
  -Dtests.security.manager=true \
  -Dtests.locale=en-IN \
  -Dtests.timezone=America/Knox_IN \
  -Dcompiler.java=11 \
  -Druntime.java=8
stacktrace

``` 1> [2019-02-13T03:33:17,729][INFO ][o.e.c.c.CoordinatorTests ] [testExpandsConfigurationWhenGrowingFromThreeToFiveNodesAndShrinksBackToThreeOnFailure] after test 1> [2019-02-13T03:33:17,730][INFO ][o.e.c.c.CoordinatorTests ] [testIncompatibleDiffResendsFullState] before test 1> [2019-02-13T03:33:17,744][INFO ][o.e.c.c.CoordinatorTests ] [testIncompatibleDiffResendsFullState] --> creating cluster of 3 nodes (master-eligible nodes: [node0, node1, node2]) with initial configuration VotingConfiguration{node1} 1> [2019-02-13T03:33:17,745][INFO ][o.e.c.c.CoordinatorTests ] [testIncompatibleDiffResendsFullState] --> start of safety phase of at least [4045] steps 1> [2019-02-13T03:33:17,746][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{oBGoTwAAQAC74oqB_____w}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,748][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node2}{lNn87f__T_-lTERQAAAAAA}}] Received response for a request that has timed out, sent [10667ms] ago, timed out [4568ms] ago, action [internal:discovery/request_peers], node [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}], id [3] 1> [2019-02-13T03:33:17,748][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{szBbWgAAQACrVZlKAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}, {node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node1}{szBbWgAAQACrVZlKAAAAAA}{0.0.0.0}{0.0.0.0:2}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,748][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{oBGoTwAAQAC74oqB_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,749][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{lNn87f__T_-lTERQAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}, {node1}{szBbWgAAQACrVZlKAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,750][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node2}{lNn87f__T_-lTERQAAAAAA}}] Received response for a request that has timed out, sent [19658ms] ago, timed out [799ms] ago, action [internal:discovery/request_peers], node [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}], id [4] 1> [2019-02-13T03:33:17,755][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{lNn87f__T_-lTERQAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}, {node1}{szBbWgAAQACrVZlKAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,757][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node0}{oBGoTwAAQAC74oqB_____w}}] Received response for a request that has timed out, sent [42607ms] ago, timed out [34658ms] ago, action [internal:discovery/request_peers], node [{node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}], id [7] 1> [2019-02-13T03:33:17,768][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{oBGoTwAAQAC74oqB_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{szBbWgAAQACrVZlKAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,775][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{9QpNiv__T_-LFXN_AAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{_lqZhf__T_-7vP72_____w}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node2}{9QpNiv__T_-LFXN_AAAAAA}{0.0.0.0}{0.0.0.0:3}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,775][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{oBGoTwAAQAC74oqB_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{szBbWgAAQACrVZlKAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node2}{lNn87f__T_-lTERQAAAAAA}{0.0.0.0}{0.0.0.0:3}]; discovery will continue using [0.0.0.0:1, 0.0.0.0:2, 0.0.0.0:3] from hosts providers and [{node0}{oBGoTwAAQAC74oqB_____w}{0.0.0.0}{0.0.0.0:1}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,780][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node2}{9QpNiv__T_-LFXN_AAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,796][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{P1W7MQAAQACspMYyAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,796][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{qjbGIwAAQACyqMe7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node0}{qjbGIwAAQACyqMe7_____w}{0.0.0.0}{0.0.0.0:4}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,796][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,797][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node0}{qjbGIwAAQACyqMe7_____w}}] Received response for a request that has timed out, sent [37977ms] ago, timed out [26457ms] ago, action [internal:discovery/request_peers], node [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}], id [3] 1> [2019-02-13T03:33:17,797][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,798][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{qjbGIwAAQACyqMe7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node0}{qjbGIwAAQACyqMe7_____w}{0.0.0.0}{0.0.0.0:4}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,798][INFO ][o.e.c.c.Coordinator ] [testIncompatibleDiffResendsFullState{nodeId={node1}{P1W7MQAAQACspMYyAAAAAA}}] setting initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,798][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{P1W7MQAAQACspMYyAAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,800][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{P1W7MQAAQACspMYyAAAAAA}}] Received response for a request that has timed out, sent [24761ms] ago, timed out [9851ms] ago, action [internal:discovery/request_peers], node [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}], id [3] 1> [2019-02-13T03:33:17,800][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{P1W7MQAAQACspMYyAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,800][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{qjbGIwAAQACyqMe7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node0}{qjbGIwAAQACyqMe7_____w}{0.0.0.0}{0.0.0.0:4}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,801][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,801][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{qjbGIwAAQACyqMe7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node0}{qjbGIwAAQACyqMe7_____w}{0.0.0.0}{0.0.0.0:4}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,807][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] Received response for a request that has timed out, sent [104230ms] ago, timed out [1256ms] ago, action [internal:discovery/request_peers], node [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}], id [4] 1> [2019-02-13T03:33:17,817][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,817][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:4, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,818][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:4, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,823][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,823][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:4, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,825][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,825][INFO ][o.e.c.c.JoinHelper ] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] failed to join {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6} with JoinRequest{sourceNode={node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}, targetNode={node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}}]} 1> org.elasticsearch.transport.ReceiveTimeoutTransportException: [][0.0.0.0:6][internal:cluster/coordination/join] request_id [11] timed out after [66986ms] 1> at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1020) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,826][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] Received response for a request that has timed out, sent [149882ms] ago, timed out [92278ms] ago, action [internal:discovery/request_peers], node [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}], id [6] 1> [2019-02-13T03:33:17,826][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,827][INFO ][o.e.c.c.JoinHelper ] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] failed to join {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6} with JoinRequest{sourceNode={node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, targetNode={node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}}]} 1> org.elasticsearch.transport.ReceiveTimeoutTransportException: [][0.0.0.0:6][internal:cluster/coordination/join] request_id [10] timed out after [84014ms] 1> at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1020) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,828][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] Received response for a request that has timed out, sent [89135ms] ago, timed out [5121ms] ago, action [internal:cluster/coordination/join], node [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}], id [10] 1> [2019-02-13T03:33:17,828][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,828][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] Received response for a request that has timed out, sent [191188ms] ago, timed out [181141ms] ago, action [internal:discovery/request_peers], node [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}], id [9] 1> [2019-02-13T03:33:17,828][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,828][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,829][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,829][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{P1W7MQAAQACspMYyAAAAAA}{0.0.0.0}{0.0.0.0:2}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:4, 0.0.0.0:2, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,830][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{RhhZ0P__T_-fwioTAAAAAA}}] Received response for a request that has timed out, sent [45777ms] ago, timed out [6943ms] ago, action [internal:discovery/request_peers], node [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}], id [11] 1> [2019-02-13T03:33:17,831][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,832][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:7, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,833][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,839][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,840][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,841][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,841][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, {node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,841][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,842][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{RhhZ0P__T_-fwioTAAAAAA}{0.0.0.0}{0.0.0.0:6}, {node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:6, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,842][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,843][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] Received response for a request that has timed out, sent [246056ms] ago, timed out [237751ms] ago, action [internal:discovery/request_peers], node [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}], id [4] 1> [2019-02-13T03:33:17,843][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,844][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] Received response for a request that has timed out, sent [51349ms] ago, timed out [906ms] ago, action [internal:discovery/request_peers], node [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}], id [17] 1> [2019-02-13T03:33:17,844][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,845][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,845][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,845][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,845][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{s-joEQAAQACXh-S7_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}, {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]; discovery will continue using [0.0.0.0:7, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,851][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{8WI0bQAAQACdJyDN_____w}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,854][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node0}{s-joEQAAQACXh-S7_____w}{0.0.0.0}{0.0.0.0:7}, {node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,854][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}, {node0}{8WI0bQAAQACdJyDN_____w}{0.0.0.0}{0.0.0.0:9}]; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,855][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] Received response for a request that has timed out, sent [267224ms] ago, timed out [223365ms] ago, action [internal:discovery/request_peers], node [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}], id [20] 1> [2019-02-13T03:33:17,856][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] Received response for a request that has timed out, sent [103265ms] ago, timed out [3066ms] ago, action [internal:discovery/request_peers], node [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}], id [12] 1> [2019-02-13T03:33:17,857][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{SZCthf__T_-QtQ6q_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}, {node0}{8WI0bQAAQACdJyDN_____w}{0.0.0.0}{0.0.0.0:9}]; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,858][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,868][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,868][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,869][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [{node2}{SZCthf__T_-QtQ6q_____w}{0.0.0.0}{0.0.0.0:5}] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,869][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,869][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,869][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{sTCuKgAAQACikclYAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{sTCuKgAAQACikclYAAAAAA}{0.0.0.0}{0.0.0.0:9}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,870][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,870][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,871][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{sTCuKgAAQACikclYAAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,873][INFO ][o.e.c.c.JoinHelper ] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] failed to join {node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8} with JoinRequest{sourceNode={node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}, optionalJoin=Optional[Join{term=2, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}, targetNode={node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}}]} 1> org.elasticsearch.transport.ReceiveTimeoutTransportException: [][0.0.0.0:8][internal:cluster/coordination/join] request_id [23] timed out after [86244ms] 1> at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1020) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,874][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,874][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{sTCuKgAAQACikclYAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{sTCuKgAAQACikclYAAAAAA}{0.0.0.0}{0.0.0.0:9}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,874][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,875][INFO ][o.e.c.s.MasterService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] elected-as-master ([1] nodes joined)[{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 2, version: 1, reason: master node changed {previous [], current [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]} 1> [2019-02-13T03:33:17,876][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{oROEEAAAQACn3ReG_____w}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,877][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{sTCuKgAAQACikclYAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{sTCuKgAAQACikclYAAAAAA}{0.0.0.0}{0.0.0.0:9}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,882][INFO ][o.e.c.s.ClusterApplierService] [testIncompatibleDiffResendsFullState] master node changed {previous [], current [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}]}, term: 2, version: 1, reason: Publication{term=2, version=1} 1> [2019-02-13T03:33:17,882][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState] Received response for a request that has timed out, sent [142746ms] ago, timed out [56502ms] ago, action [internal:cluster/coordination/join], node [{node1}{oROEEAAAQACn3ReG_____w}{0.0.0.0}{0.0.0.0:8}], id [23] 1> [2019-02-13T03:33:17,884][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,884][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 2, last-accepted version 1 in term 2 1> [2019-02-13T03:33:17,885][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{sTCuKgAAQACikclYAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{sTCuKgAAQACikclYAAAAAA}{0.0.0.0}{0.0.0.0:9}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,885][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,885][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{sTCuKgAAQACikclYAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{sTCuKgAAQACikclYAAAAAA}{0.0.0.0}{0.0.0.0:9}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,890][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{4awQg___T_-6frQxAAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,891][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,892][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 2, last-accepted version 1 in term 2 1> [2019-02-13T03:33:17,892][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{4awQg___T_-6frQxAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{4awQg___T_-6frQxAAAAAA}{0.0.0.0}{0.0.0.0:10}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,893][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,894][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 2, last-accepted version 1 in term 2 1> [2019-02-13T03:33:17,895][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{4awQg___T_-6frQxAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{4awQg___T_-6frQxAAAAAA}{0.0.0.0}{0.0.0.0:10}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,895][INFO ][o.e.c.c.JoinHelper ] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] failed to join {node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8} with JoinRequest{sourceNode={node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}, optionalJoin=Optional[Join{term=3, lastAcceptedTerm=2, lastAcceptedVersion=1, sourceNode={node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}, targetNode={node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}}]} 1> org.elasticsearch.transport.ReceiveTimeoutTransportException: [][0.0.0.0:8][internal:cluster/coordination/join] request_id [8] timed out after [70645ms] 1> at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1020) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,897][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:9, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,897][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}] from last-known cluster state; node term 3, last-accepted version 1 in term 2 1> [2019-02-13T03:33:17,897][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{4awQg___T_-6frQxAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{4awQg___T_-6frQxAAAAAA}{0.0.0.0}{0.0.0.0:10}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,898][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{4awQg___T_-6frQxAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{4awQg___T_-6frQxAAAAAA}{0.0.0.0}{0.0.0.0:10}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,898][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,904][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{xn20OgAAQACy_wPz_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node0}{xn20OgAAQACy_wPz_____w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,905][INFO ][o.e.c.s.MasterService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{9ZT0iP__T_-zT0ZSAAAAAA}}] elected-as-master ([1] nodes joined)[{node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 3, version: 2, reason: master node changed {previous [], current [{node1}{9ZT0iP__T_-zT0ZSAAAAAA}{0.0.0.0}{0.0.0.0:8}]} 1> [2019-02-13T03:33:17,905][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{xn20OgAAQACy_wPz_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{xn20OgAAQACy_wPz_____w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,905][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,906][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:10, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,906][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{xn20OgAAQACy_wPz_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:8, 0.0.0.0:5] from hosts providers and [{node0}{xn20OgAAQACy_wPz_____w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,917][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,918][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{re15JAAAQAC6MiCL_____w}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,919][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{07nv____T_-puZH______w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,919][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,920][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{re15JAAAQAC6MiCL_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node1}{re15JAAAQAC6MiCL_____w}{0.0.0.0}{0.0.0.0:12}] from last-known cluster state; node term 3, last-accepted version 2 in term 3 1> [2019-02-13T03:33:17,930][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,930][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{07nv____T_-puZH______w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,931][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}] from last-known cluster state; node term 3, last-accepted version 2 in term 3 1> [2019-02-13T03:33:17,932][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,932][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,933][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{07nv____T_-puZH______w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,933][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{07nv____T_-puZH______w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,933][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,933][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{07nv____T_-puZH______w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,934][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{07nv____T_-puZH______w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{07nv____T_-puZH______w}{0.0.0.0}{0.0.0.0:11}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,935][INFO ][o.e.c.c.JoinHelper ] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] failed to join {node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12} with JoinRequest{sourceNode={node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}, optionalJoin=Optional[Join{term=4, lastAcceptedTerm=3, lastAcceptedVersion=2, sourceNode={node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}, targetNode={node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}}]} 1> org.elasticsearch.transport.ReceiveTimeoutTransportException: [][0.0.0.0:12][internal:cluster/coordination/join] request_id [6] timed out after [76257ms] 1> at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1020) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,936][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,952][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,952][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:11, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}] from last-known cluster state; node term 4, last-accepted version 2 in term 3 1> [2019-02-13T03:33:17,952][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,953][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:17,954][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,955][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,955][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,956][INFO ][o.e.c.s.MasterService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] elected-as-master ([1] nodes joined)[{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 4, version: 3, reason: master node changed {previous [], current [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}]} 1> [2019-02-13T03:33:17,957][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,957][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,957][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,958][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,958][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}]; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,959][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,960][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}]; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,961][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{AB3uOAAAQACACjwgAAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:17,962][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Bn_bGQAAQACCyNENAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}]; discovery will continue using [0.0.0.0:13, 0.0.0.0:12, 0.0.0.0:5] from hosts providers and [{node2}{Bn_bGQAAQACCyNENAAAAAA}{0.0.0.0}{0.0.0.0:5}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,963][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState] Received response for a request that has timed out, sent [362872ms] ago, timed out [286615ms] ago, action [internal:cluster/coordination/join], node [{node1}{AB3uOAAAQACACjwgAAAAAA}{0.0.0.0}{0.0.0.0:12}], id [6] 1> [2019-02-13T03:33:17,983][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,984][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{K7ceMwAAQACrDYhTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node1}{K7ceMwAAQACrDYhTAAAAAA}{0.0.0.0}{0.0.0.0:14}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:17,985][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,985][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,985][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,986][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,987][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{aSQxIwAAQACp5usOAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{aSQxIwAAQACp5usOAAAAAA}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:17,998][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{K7ceMwAAQACrDYhTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node1}{K7ceMwAAQACrDYhTAAAAAA}{0.0.0.0}{0.0.0.0:14}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,000][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{K7ceMwAAQACrDYhTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node1}{K7ceMwAAQACrDYhTAAAAAA}{0.0.0.0}{0.0.0.0:14}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,001][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{K7ceMwAAQACrDYhTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node1}{K7ceMwAAQACrDYhTAAAAAA}{0.0.0.0}{0.0.0.0:14}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,001][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,001][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,001][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{K7ceMwAAQACrDYhTAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node1}{K7ceMwAAQACrDYhTAAAAAA}{0.0.0.0}{0.0.0.0:14}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,001][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,002][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,002][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,008][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:14, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,009][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{xSj4OQAAQACH3MoVAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [] from hosts providers and [{node1}{xSj4OQAAQACH3MoVAAAAAA}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,010][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{xSj4OQAAQACH3MoVAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [] from hosts providers and [{node1}{xSj4OQAAQACH3MoVAAAAAA}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,010][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:18,011][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{xSj4OQAAQACH3MoVAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node1}{xSj4OQAAQACH3MoVAAAAAA}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,012][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,012][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,012][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{xSj4OQAAQACH3MoVAAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node1}{xSj4OQAAQACH3MoVAAAAAA}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,017][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,018][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,018][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,018][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{tSuViv__T_-aipu7_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [] from hosts providers and [{node1}{tSuViv__T_-aipu7_____w}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,019][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{tSuViv__T_-aipu7_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [] from hosts providers and [{node1}{tSuViv__T_-aipu7_____w}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,019][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,020][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,020][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{tSuViv__T_-aipu7_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node1}{tSuViv__T_-aipu7_____w}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,021][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{tSuViv__T_-aipu7_____w}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node1}{tSuViv__T_-aipu7_____w}{0.0.0.0}{0.0.0.0:17}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,021][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,026][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:17, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,026][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,027][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,027][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,028][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:18,028][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{wDaCbQAAQAC2J1PJ_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node0}{wDaCbQAAQAC2J1PJ_____w}{0.0.0.0}{0.0.0.0:13}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,028][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:13, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 4, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,034][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{Yepjov__T_-BIPia_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:13, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node2}{Yepjov__T_-BIPia_____w}{0.0.0.0}{0.0.0.0:16}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,039][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 5, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,040][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 5, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,040][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,040][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 5, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,040][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,040][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{VafL6P__T_-gIiFFAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node2}{VafL6P__T_-gIiFFAAAAAA}{0.0.0.0}{0.0.0.0:20}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,041][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{VafL6P__T_-gIiFFAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [] from hosts providers and [{node2}{VafL6P__T_-gIiFFAAAAAA}{0.0.0.0}{0.0.0.0:20}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,041][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:16] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,041][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,041][INFO ][o.e.c.c.JoinHelper ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] failed to join {node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18} with JoinRequest{sourceNode={node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}, optionalJoin=Optional[Join{term=5, lastAcceptedTerm=4, lastAcceptedVersion=3, sourceNode={node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}, targetNode={node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}}]} 1> org.elasticsearch.transport.ReceiveTimeoutTransportException: [][0.0.0.0:18][internal:cluster/coordination/join] request_id [4] timed out after [150232ms] 1> at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1020) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:18,042][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,043][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,043][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:18,043][INFO ][o.e.c.s.MasterService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] elected-as-master ([1] nodes joined)[{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 5, version: 4, reason: master node changed {previous [], current [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}]} 1> [2019-02-13T03:33:18,044][WARN ][o.e.c.s.MasterService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] failing [elected-as-master ([1] nodes joined)[{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_]]: failed to commit cluster state version [4] 1> org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: publication failed 1> at org.elasticsearch.cluster.coordination.Coordinator$CoordinatorPublication$2.onFailure(Coordinator.java:1276) [main/:?] 1> at org.elasticsearch.common.util.concurrent.ListenableFuture$1.run(ListenableFuture.java:101) [main/:7.0.0-SNAPSHOT] 1> at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:192) [main/:7.0.0-SNAPSHOT] 1> at org.elasticsearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:92) [main/:7.0.0-SNAPSHOT] 1> at org.elasticsearch.common.util.concurrent.ListenableFuture.addListener(ListenableFuture.java:54) [main/:7.0.0-SNAPSHOT] 1> at org.elasticsearch.cluster.coordination.Coordinator$CoordinatorPublication.onCompletion(Coordinator.java:1219) [main/:?] 1> at org.elasticsearch.cluster.coordination.Publication.onPossibleCompletion(Publication.java:124) [main/:?] 1> at org.elasticsearch.cluster.coordination.Publication.cancel(Publication.java:88) [main/:?] 1> at org.elasticsearch.cluster.coordination.Coordinator$5.run(Coordinator.java:982) [main/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue$2$2.run(DeterministicTaskQueue.java:357) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runTask(DeterministicTaskQueue.java:131) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.DeterministicTaskQueue.runRandomTask(DeterministicTaskQueue.java:125) [framework-7.0.0-SNAPSHOT.jar:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1313) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> Caused by: org.elasticsearch.ElasticsearchException: publication cancelled before committing: timed out after 30s 1> at org.elasticsearch.cluster.coordination.Publication.cancel(Publication.java:85) ~[main/:?] 1> ... 46 more 1> [2019-02-13T03:33:18,045][WARN ][o.e.t.TransportService ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] Received response for a request that has timed out, sent [227844ms] ago, timed out [77612ms] ago, action [internal:cluster/coordination/join], node [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}], id [4] 1> [2019-02-13T03:33:18,046][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node0}{G6rZtf__T_-3kSPF_____w}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node0}{G6rZtf__T_-3kSPF_____w}{0.0.0.0}{0.0.0.0:19}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,046][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{VafL6P__T_-gIiFFAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node2}{VafL6P__T_-gIiFFAAAAAA}{0.0.0.0}{0.0.0.0:20}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,047][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 5, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,047][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{VafL6P__T_-gIiFFAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node2}{VafL6P__T_-gIiFFAAAAAA}{0.0.0.0}{0.0.0.0:20}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,048][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 5, last-accepted version 3 in term 4 1> [2019-02-13T03:33:18,054][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node0}{Y8h6lf__T_-ON-ZjAAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:18,055][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] successfully set initial configuration to VotingConfiguration{node1} 1> [2019-02-13T03:33:18,056][INFO ][o.e.c.c.C.C.ClusterNode ] [testIncompatibleDiffResendsFullState{nodeId={node2}{VafL6P__T_-gIiFFAAAAAA}}] failed to set initial configuration to VotingConfiguration{node1} 1> org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: local node is not part of initial configuration 1> at org.elasticsearch.cluster.coordination.Coordinator.setInitialConfiguration(Coordinator.java:781) ~[main/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.lambda$applyInitialConfiguration$11(CoordinatorTests.java:1892) ~[test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$1.run(CoordinatorTests.java:1918) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode$3.run(CoordinatorTests.java:1785) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster$ClusterNode.applyInitialConfiguration(CoordinatorTests.java:1898) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1308) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests$Cluster.runRandomly(CoordinatorTests.java:1208) [test/:?] 1> at org.elasticsearch.cluster.coordination.CoordinatorTests.testIncompatibleDiffResendsFullState(CoordinatorTests.java:875) [test/:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.0.0-snapshot-83f9835.jar:8.0.0-snapshot-83f9835 83f9835a47a00a2ec58a4cf5fc0d492497cf7898 - jpountz - 2019-01-21 13:06:00] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202] 1> [2019-02-13T03:33:18,057][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node2}{VafL6P__T_-gIiFFAAAAAA}}] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and [cluster.initial_master_nodes] is empty on this node: have discovered []; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node2}{VafL6P__T_-gIiFFAAAAAA}{0.0.0.0}{0.0.0.0:20}] from last-known cluster state; node term 1, last-accepted version 0 in term 0 1> [2019-02-13T03:33:18,058][WARN ][o.e.c.c.ClusterFormationFailureHelper] [testIncompatibleDiffResendsFullState{nodeId={node1}{-injNwAAQACMry15AAAAAA}}] master not discovered or elected yet, an election requires a node with id [node1], have discovered [] which is not a quorum; discovery will continue using [0.0.0.0:19, 0.0.0.0:18, 0.0.0.0:20] from hosts providers and [{node1}{-injNwAAQACMry15AAAAAA}{0.0.0.0}{0.0.0.0:18}] from last-known cluster state; node term 5, last-accepted version 3 in term 4 ```

Metadata

Metadata

Assignees

Labels

:Distributed Coordination/Cluster CoordinationCluster formation and cluster state publication, including cluster membership and fault detection.>test-failureTriaged test failures from CIv7.0.0-rc2v8.0.0-alpha1

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions