Skip to content

Conversation

@mtannous
Copy link
Contributor

We weren't able to see the catalog LLDP information of all the hosts and switches connected to a host and that is because not all interfaces on the host are enabled in the micro kernel. Hence, this task will run the python script set_interfaces.py on the microkernel. This script will enable all interfaces on the host, and once enable we can send/receive LLDP and see the attached hosts in LLDP catalog information. Another pull request will be created for the script in on-http and for the discovery graph on-taskgraph.

@brianparry
Copy link
Contributor

ok to test

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1695 : FAILURE

]
},
properties: {
os: {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can probably just remove all this (irrelevant/inappropriate metadata).

commands: [
{
command: 'sudo python set_interfaces.py',
downloadUrl: '/api/1.1/templates/set_interfaces.py'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use /api/2.0?

@benbp
Copy link
Contributor

benbp commented Oct 25, 2016

Please squash and rebase the commits.

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1710 : FAILURE

@anhou
Copy link
Member

anhou commented Oct 27, 2016

@mtannous it looks that two commits are still the same title and not squashed

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1713 : FAILURE

@anhou
Copy link
Member

anhou commented Nov 1, 2016

Jenkins: test this please.

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1715 : UNSTABLE

BUILD smoke-test #3687 Error Logs ▼

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-01 02:36:27.607614
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-01 02:36:27.607614\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: redfish_discovery_test
Error Details: Missing Redfish Enclosures
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for Graph.Redfish.Discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 189, in redfish_discovery_test
assert_not_equal(len(self.__nodes), 0, message='Missing Redfish Enclosures')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
"Missing Redfish Enclosures\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for Graph.Redfish.Discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 581837f57c4f070309d8ea0d!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 581837f57c4f070309d8ea0d!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-E7AujIZeo2VCdQ4hd54wlQ"', 'Date': 'Tue, 01 Nov 2016 07:06:40 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"f70a1550-ca77-41af-944e-ef2b5c4f4df6"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-E7AujIZeo2VCdQ4hd54wlQ"', 'Date': 'Tue, 01 Nov 2016 07:06:40 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"f70a1550-ca77-41af-944e-ef2b5c4f4df6"}

Test Name: test_node_workflows_post
Error Details: status should be 404
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 581837f57c4f070309d8ea0d
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 198, in test_node_workflows_post
assert_equal(404,e.status, message='status should be 404')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
raise ASSERTION_ERROR(message)
"status should be 404\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 581837f57c4f070309d8ea0d\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-yWAf4QgDtMiQY2yiHJO2jQ"', 'Date': 'Tue, 01 Nov 2016 07:06:46 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"59a4a881-30e8-4b38-9a4c-d004e384cfbb"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-yWAf4QgDtMiQY2yiHJO2jQ"', 'Date': 'Tue, 01 Nov 2016 07:06:46 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"59a4a881-30e8-4b38-9a4c-d004e384cfbb"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-9aX/YWncrrHdRP6z0/vSvQ"', 'Date': 'Tue, 01 Nov 2016 07:06:47 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"49231aa7-dd0d-461f-a95d-ec39b08d42c1"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-9aX/YWncrrHdRP6z0/vSvQ"', 'Date': 'Tue, 01 Nov 2016 07:06:47 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"49231aa7-dd0d-461f-a95d-ec39b08d42c1"}

@tannoa2
Copy link
Contributor

tannoa2 commented Nov 1, 2016

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1716 : UNSTABLE

BUILD smoke-test #3688 Error Logs ▼

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-01 09:15:10.215370
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-01 09:15:10.215370\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: redfish_discovery_test
Error Details: Missing Redfish Enclosures
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for Graph.Redfish.Discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 189, in redfish_discovery_test
assert_not_equal(len(self.__nodes), 0, message='Missing Redfish Enclosures')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
"Missing Redfish Enclosures\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for Graph.Redfish.Discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 58189566dfb6011709b75bac!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 58189566dfb6011709b75bac!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-Y3mwGn2HIHH49ckGwzB5wg"', 'Date': 'Tue, 01 Nov 2016 13:45:24 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"75e2fd34-48a7-4591-81a2-0d2ba5633f0c"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-Y3mwGn2HIHH49ckGwzB5wg"', 'Date': 'Tue, 01 Nov 2016 13:45:24 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"75e2fd34-48a7-4591-81a2-0d2ba5633f0c"}

Test Name: test_node_workflows_post
Error Details: status should be 404
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58189566dfb6011709b75bac
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 198, in test_node_workflows_post
assert_equal(404,e.status, message='status should be 404')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
raise ASSERTION_ERROR(message)
"status should be 404\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58189566dfb6011709b75bac\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-cs/O0AbXIReBhPhoDF7FuQ"', 'Date': 'Tue, 01 Nov 2016 13:45:30 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"855d78dd-7903-4ebd-b91c-598cbd588c1c"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-cs/O0AbXIReBhPhoDF7FuQ"', 'Date': 'Tue, 01 Nov 2016 13:45:30 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"855d78dd-7903-4ebd-b91c-598cbd588c1c"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-DSylLMISGvMdHD0SOW7htQ"', 'Date': 'Tue, 01 Nov 2016 13:45:31 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"a88bb09f-689f-4bac-ba5b-1f33c2e5cd77"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-DSylLMISGvMdHD0SOW7htQ"', 'Date': 'Tue, 01 Nov 2016 13:45:31 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"a88bb09f-689f-4bac-ba5b-1f33c2e5cd77"}

@tannoa2
Copy link
Contributor

tannoa2 commented Nov 1, 2016

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1717 : UNSTABLE

BUILD smoke-test #3690 Error Logs ▼

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-01 10:10:01.408854
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-01 10:10:01.408854\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: redfish_discovery_test
Error Details: Missing Redfish Enclosures
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for Graph.Redfish.Discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 189, in redfish_discovery_test
assert_not_equal(len(self.__nodes), 0, message='Missing Redfish Enclosures')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
"Missing Redfish Enclosures\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for Graph.Redfish.Discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 5818a242326ba70d09370dc8!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 5818a242326ba70d09370dc8!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-UZHheRVkMTvrMcP7PZq6SQ"', 'Date': 'Tue, 01 Nov 2016 14:40:15 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"5a2f7dd3-8911-4c64-b11d-bdf511f00a3d"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-UZHheRVkMTvrMcP7PZq6SQ"', 'Date': 'Tue, 01 Nov 2016 14:40:15 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"5a2f7dd3-8911-4c64-b11d-bdf511f00a3d"}

Test Name: test_node_workflows_post
Error Details: status should be 404
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 5818a242326ba70d09370dc8
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 198, in test_node_workflows_post
assert_equal(404,e.status, message='status should be 404')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
raise ASSERTION_ERROR(message)
"status should be 404\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 5818a242326ba70d09370dc8\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-rcaw7kBh34eSwh8DPjuURQ"', 'Date': 'Tue, 01 Nov 2016 14:40:21 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"5158da0a-69f8-4fc9-ba8d-d75c2a4d6436"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-rcaw7kBh34eSwh8DPjuURQ"', 'Date': 'Tue, 01 Nov 2016 14:40:21 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"5158da0a-69f8-4fc9-ba8d-d75c2a4d6436"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-eJaw6ELUgdrghYOk7edJ1Q"', 'Date': 'Tue, 01 Nov 2016 14:40:21 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"cd3cb412-5fec-4f8a-a6cb-a688637cff7d"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-eJaw6ELUgdrghYOk7edJ1Q"', 'Date': 'Tue, 01 Nov 2016 14:40:21 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"cd3cb412-5fec-4f8a-a6cb-a688637cff7d"}

@nucklehead
Copy link
Contributor

test this please

@tannoa2
Copy link
Contributor

tannoa2 commented Nov 3, 2016

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1733 : UNSTABLE

BUILD smoke-test #3726 Error Logs ▼

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-03 09:52:41.154377
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-03 09:52:41.154377\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: redfish_discovery_test
Error Details: Missing Redfish Enclosures
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for Graph.Redfish.Discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 189, in redfish_discovery_test
assert_not_equal(len(self.__nodes), 0, message='Missing Redfish Enclosures')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
"Missing Redfish Enclosures\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for Graph.Redfish.Discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 581b413065980e04090d3e98!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 581b413065980e04090d3e98!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-nysm0qRwDZbeRfiXO2mAig"', 'Date': 'Thu, 03 Nov 2016 14:22:57 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"b3806b20-b593-4810-8306-4158914ca943"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-nysm0qRwDZbeRfiXO2mAig"', 'Date': 'Thu, 03 Nov 2016 14:22:57 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"b3806b20-b593-4810-8306-4158914ca943"}

Test Name: test_node_workflows_post
Error Details: status should be 404
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 581b413065980e04090d3e98
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 198, in test_node_workflows_post
assert_equal(404,e.status, message='status should be 404')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
raise ASSERTION_ERROR(message)
"status should be 404\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 581b413065980e04090d3e98\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-oR2lVjkvqQRLYvS118vrmQ"', 'Date': 'Thu, 03 Nov 2016 14:23:03 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"d3a0230d-31cd-47bf-9a33-8f6fa293a5aa"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-oR2lVjkvqQRLYvS118vrmQ"', 'Date': 'Thu, 03 Nov 2016 14:23:03 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"d3a0230d-31cd-47bf-9a33-8f6fa293a5aa"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-T47TImmcZh7zgul1ZAQ1cw"', 'Date': 'Thu, 03 Nov 2016 14:23:03 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"cb398f5b-ed52-498b-bb08-978d5479b8a1"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-T47TImmcZh7zgul1ZAQ1cw"', 'Date': 'Thu, 03 Nov 2016 14:23:03 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"cb398f5b-ed52-498b-bb08-978d5479b8a1"}

@anhou
Copy link
Member

anhou commented Nov 8, 2016

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1738 : UNSTABLE

BUILD smoke-test #3751 Error Logs ▼

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-08 04:53:16.225101
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-08 04:53:16.225101\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: redfish_discovery_test
Error Details: Missing Redfish Enclosures
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for Graph.Redfish.Discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 189, in redfish_discovery_test
assert_not_equal(len(self.__nodes), 0, message='Missing Redfish Enclosures')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
"Missing Redfish Enclosures\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for Graph.Redfish.Discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 5821a096d5aae50809662a27!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 5821a096d5aae50809662a27!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-udqtHTtzbcixbodEynAKyQ"', 'Date': 'Tue, 08 Nov 2016 10:23:30 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"e7483fe3-7d20-4b9b-a140-5f82139bdbbe"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-udqtHTtzbcixbodEynAKyQ"', 'Date': 'Tue, 08 Nov 2016 10:23:30 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"e7483fe3-7d20-4b9b-a140-5f82139bdbbe"}

Test Name: test_node_workflows_post
Error Details: status should be 404
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 5821a096d5aae50809662a27
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 198, in test_node_workflows_post
assert_equal(404,e.status, message='status should be 404')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
raise ASSERTION_ERROR(message)
"status should be 404\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 5821a096d5aae50809662a27\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-tZw5c3n8cJVJEJbt1IQafg"', 'Date': 'Tue, 08 Nov 2016 10:23:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"efd96f08-006c-41b5-8456-468b50c02abb"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-tZw5c3n8cJVJEJbt1IQafg"', 'Date': 'Tue, 08 Nov 2016 10:23:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"efd96f08-006c-41b5-8456-468b50c02abb"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-YVnEe1KM8EYfEGkUv2LSRA"', 'Date': 'Tue, 08 Nov 2016 10:23:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"9703a9a3-00b8-4d5e-a5a4-c22b5df2caf8"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-YVnEe1KM8EYfEGkUv2LSRA"', 'Date': 'Tue, 08 Nov 2016 10:23:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"9703a9a3-00b8-4d5e-a5a4-c22b5df2caf8"}

@yyscamper
Copy link
Contributor

From the Jenkins error log, its failure has no relation with this PR.

jenkins: test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1741 : UNSTABLE

BUILD smoke-test #3764 Error Logs ▼

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-11 05:29:53.016363
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-11-11 05:29:53.016363\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: redfish_discovery_test
Error Details: Missing Redfish Enclosures
-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for Graph.Redfish.Discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self.testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 189, in redfish_discovery_test
assert_not_equal(len(self.__nodes), 0, message='Missing Redfish Enclosures')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
"Missing Redfish Enclosures\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:__@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=Graph.Redfish.Discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished._>\nmodules.worker: INFO: stopping subtask for Graph.Redfish.Discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 58259da6b4b7acfe087d7521!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 58259da6b4b7acfe087d7521!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-GwReKQLpwQF1ms3I8tpgJg"', 'Date': 'Fri, 11 Nov 2016 11:00:04 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"c9214b17-d38a-46d0-aaa1-57c89aba914d"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-GwReKQLpwQF1ms3I8tpgJg"', 'Date': 'Fri, 11 Nov 2016 11:00:04 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"c9214b17-d38a-46d0-aaa1-57c89aba914d"}

Test Name: test_node_workflows_post
Error Details: status should be 404
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58259da6b4b7acfe087d7521
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 198, in test_node_workflows_post
assert_equal(404,e.status, message='status should be 404')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
raise ASSERTION_ERROR(message)
"status should be 404\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58259da6b4b7acfe087d7521\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-McsIs1aGTzzEBQ1xpcs5Mw"', 'Date': 'Fri, 11 Nov 2016 11:00:09 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"c46ee152-94b3-4109-8331-515df68e883c"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-McsIs1aGTzzEBQ1xpcs5Mw"', 'Date': 'Fri, 11 Nov 2016 11:00:09 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"c46ee152-94b3-4109-8331-515df68e883c"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-XwrqIbtJqgBv505ZIb3wrw"', 'Date': 'Fri, 11 Nov 2016 11:00:10 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"e80c26ea-15c2-4df9-905b-9c9fcce3d474"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-XwrqIbtJqgBv505ZIb3wrw"', 'Date': 'Fri, 11 Nov 2016 11:00:10 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"e80c26ea-15c2-4df9-905b-9c9fcce3d474"}

@amymullins
Copy link
Member

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1785 : FAILURE

@yyscamper
Copy link
Contributor

@mtannous I will trigger the Jenkins build again, if the build still fails, I suggest you rebase your code.

@yyscamper
Copy link
Contributor

jenkins: test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1809 : UNSTABLE

BUILD smoke-test #3936 Error Logs ▼Test Name: test_nodes_discovery Error Details: timeout waiting for task discovery -------------------- >> begin captured logging << -------------------- tests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-12-20 05:36:02.030101 amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] amqp: DEBUG: Open OK! kombu: INFO: Starting AMQP worker -> graph.finished.*> amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] amqp: DEBUG: Open OK! kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091// amqp: DEBUG: using channel_id: 1 amqp: DEBUG: Channel open modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping.. kombu: INFO: Stopping AMQP worker -> graph.finished.*> modules.worker: INFO: stopping subtask for discovery amqp: DEBUG: Closed channel #1 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run testMethod() File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest self._testFunc() File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func compatability.capture_type_error(s_func) File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error func() File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func func(test_case.state.get_state()) File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/nodes_tests.py", line 123, in test_nodes_discovery message='timeout waiting for task {0}'.format(self.__task.id)) File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false raise ASSERTION_ERROR(message) "timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.nodes_tests: INFO: Wait start time: 2016-12-20 05:36:02.030101\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker -> graph.finished.*>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker -> graph.finished.*>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/session_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: teardown
Error Details: 'X-Auth-Token'
-------------------- >> begin captured logging << --------------------
modules.redfish_auth: INFO: auth already disabled.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/account_service_tests.py", line 38, in teardown
Auth.disable()
File "/home/jenkins/workspace/on-tasks/RackHD/test/modules/redfish_auth.py", line 67, in disable
del config.api_client.default_headers['X-Auth-Token']
"'X-Auth-Token'\n-------------------- >> begin captured logging << --------------------\nmodules.redfish_auth: INFO: auth already disabled.\n--------------------- >> end captured logging << ---------------------"

Test Name: test_node_workflows_post
Error Details: (500)
Reason: Internal Server Error
HTTP response headers: HTTPHeaderDict({'Content-Length': '61', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"3d-gPVQKeJsssqovuKWcmZi8w"', 'Date': 'Tue, 20 Dec 2016 10:56:04 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function"}

-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for node 5859099ab792ff1609c60142
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
urllib3.connectionpool: WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine("''",))': /api/1.1/nodes/5859099ab792ff1609c60142/workflows/active
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/workflows_tests.py", line 243, in test_node_workflows_post
self.post_workflows("Graph.noop-example")
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/workflows_tests.py", line 172, in post_workflows
Nodes().nodes_identifier_workflows_post(node, name=graph_name, body=data)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/apis/nodes_api.py", line 1427, in nodes_identifier_workflows_post
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/api_client.py", line 358, in request
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/rest.py", line 208, in POST
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/rest.py", line 177, in request
raise ApiException(http_resp=r)
'(500)\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Content-Length': '61', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"3d-gPVQKeJsssqovuKWcmZi8w"', 'Date': 'Tue, 20 Dec 2016 10:56:04 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})\nHTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function"}\n\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for node 5859099ab792ff1609c60142\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/\', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nurllib3.connectionpool: WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine("''",))': /api/1.1/nodes/5859099ab792ff1609c60142/workflows/active\n--------------------- >> end captured logging << ---------------------'

Test Name: redfish_discovery_test
Error Details: (500)
Reason: Internal Server Error
HTTP response headers: HTTPHeaderDict({'Content-Length': '61', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"3d-gPVQKeJsssqovuKWcmZi8w"', 'Date': 'Tue, 20 Dec 2016 10:56:07 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function"}

-------------------- >> begin captured logging << --------------------
tests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 176, in redfish_discovery_test
self.__post_unbound_workflow('Graph.Redfish.Discovery', body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/redfish_endpoint_tests.py", line 88, in __post_unbound_workflow
workflow.post_unbound_workflow(graph_name, data=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v1_1/workflows_tests.py", line 190, in post_unbound_workflow
Workflows().workflows_post(graph_name, body=data)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/apis/workflow_api.py", line 601, in workflows_post
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/api_client.py", line 358, in request
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/rest.py", line 208, in POST
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api1_1/rest.py", line 177, in request
raise ApiException(http_resp=r)
'(500)\nReason: Internal Server Error\nHTTP response headers: HTTPHeaderDict({'Content-Length': '61', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"3d-gPVQKeJsssqovuKWcmZi8w"', 'Date': 'Tue, 20 Dec 2016 10:56:07 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})\nHTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function"}\n\n-------------------- >> begin captured logging << --------------------\ntests.api.v1_1.workflows_tests: INFO: Starting AMQP listener for Graph.Redfish.Discovery\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/\', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------'

Test Name: test_node_catalogs
Error Details: Node catalog is empty!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 264, in test_node_catalogs
assert_not_equal(0, len(resp), message='Node catalog is empty!')
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 151, in assert_not_equal
raise ASSERTION_ERROR(message)
AssertionError: Node catalog is empty!

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 5859099ab792ff1609c60142!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 5859099ab792ff1609c60142!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-aAAyfY1GJ/aC/i+GsLZLcA"', 'Date': 'Tue, 20 Dec 2016 10:56:09 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"1db62015-44bb-4176-bbda-0ef455cef0ef"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-aAAyfY1GJ/aC/i+GsLZLcA"', 'Date': 'Tue, 20 Dec 2016 10:56:09 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"1db62015-44bb-4176-bbda-0ef455cef0ef"}

Test Name: test_workflows_post
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-WIwtMG0Ed4dzYHWJg1sIVg"', 'Date': 'Tue, 20 Dec 2016 10:56:10 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"382fa796-fb5e-424f-be8c-1d5fef9bdc83"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 74, in test_workflows_post
Api().workflows_post(body={"name": 'Graph.noop-example'})
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 8154, in workflows_post
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 358, in request
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 208, in POST
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-WIwtMG0Ed4dzYHWJg1sIVg"', 'Date': 'Tue, 20 Dec 2016 10:56:10 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"382fa796-fb5e-424f-be8c-1d5fef9bdc83"}

Test Name: test_node_workflows_post
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-76UT/LOdYi+C/VGhiCwh3w"', 'Date': 'Tue, 20 Dec 2016 10:56:11 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"761be838-d599-404f-baf6-6e5759e37ccc"}

-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 5859099ab792ff1609c60142
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 199, in test_node_workflows_post
Api().nodes_post_workflow_by_id(id, name='Graph.noop-example', body={})
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 2934, in nodes_post_workflow_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 358, in request
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 208, in POST
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
'(400)\nReason: Bad Request\nHTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-76UT/LOdYi+C/VGhiCwh3w"', 'Date': 'Tue, 20 Dec 2016 10:56:11 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})\nHTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"761be838-d599-404f-baf6-6e5759e37ccc"}\n\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 5859099ab792ff1609c60142\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/\', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------'

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-XgCXUfPW5KgI0kD9MKaKnw"', 'Date': 'Tue, 20 Dec 2016 10:56:11 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"5e62a65f-dceb-43ce-8bae-b9016680b4ee"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-XgCXUfPW5KgI0kD9MKaKnw"', 'Date': 'Tue, 20 Dec 2016 10:56:11 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"5e62a65f-dceb-43ce-8bae-b9016680b4ee"}

Test Name: post_sku
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-YauYqE8sxbjfZXtA/t/JmA"', 'Date': 'Tue, 20 Dec 2016 10:56:11 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"443180c2-f1e0-4f00-b0d4-87586b9de235"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 69, in post_sku
Api().skus_post(sku)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 5462, in skus_post
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 358, in request
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 208, in POST
body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-YauYqE8sxbjfZXtA/t/JmA"', 'Date': 'Tue, 20 Dec 2016 10:56:11 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"443180c2-f1e0-4f00-b0d4-87586b9de235"}

Test Name: post_skupacks
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-FZfvcm76w1w8PXQeJvOnew"', 'Date': 'Tue, 20 Dec 2016 10:56:12 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"8225d340-3d8f-4a0a-be86-304c262c7857"}

-------------------- >> begin captured logging << --------------------
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/tmp/.venv/local/lib/python2.7/site-packages/proboscis/case.py", line 333, in get_state
self.instance = self.entry.home()
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/sel_alert_poller_tests.py", line 36, in init
self.delete_skus()# clear any skus
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/sel_alert_poller_tests.py", line 306, in delete_skus
Api().skus_id_delete(item.get("id"))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 5693, in skus_id_delete
callback=params.get('callback'))
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 374, in request
headers=headers)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 201, in DELETE
query_params=query_params)
File "/tmp/.venv/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
'(400)\nReason: Bad Request\nHTTP response headers: HTTPHeaderDict({'Content-Length': '122', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"7a-FZfvcm76w1w8PXQeJvOnew"', 'Date': 'Tue, 20 Dec 2016 10:56:12 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})\nHTTP response body: {"message":"TaskGraph.updateGraphProgress is not a function","status":"400","UUID":"8225d340-3d8f-4a0a-be86-304c262c7857"}\n\n-------------------- >> begin captured logging << --------------------\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/\', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\n--------------------- >> end captured logging << ---------------------'

@panpan0000
Copy link
Contributor

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1831 : ABORTED

@brianparry
Copy link
Contributor

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #1962 : ABORTED

@PengTian0
Copy link
Contributor

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks-pipeline #2 : FAILURE

BUILD on-tasks-pipeline #2 Error Logs ▼Test Name: ServerTechObmService base "before all" hook: ServerTechObmService before Error Details: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test. Stack Trace: Error: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.

Test Name: SNMP PDU Sensor Metric "before all" hook: SNMP PDU Sensor Metric before
Error Details: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.
Stack Trace: Error: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.

Test Name: poweroff-node-spec.js "before all" hook
Error Details: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.
Stack Trace: Error: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.

Test Name: Job.Local.Catalog "before all" hook
Error Details: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.
Stack Trace: Error: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.

Test Name: Http.Api.Ibms /api/2.0/ibms/definitions should return a list of IBM schemas
Error Details: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.
Stack Trace: Error: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks-pipeline #3 : FAILURE

BUILD on-tasks-pipeline #3 Error Logs ▼Test Name: Http.Server "before all" hook: helper.before Error Details: timeout of 10000ms exceeded. Ensure the done() callback is being called in this test. Stack Trace: Error: timeout of 10000ms exceeded. Ensure the done() callback is being called in this test.

Test Name: Http.Services.Api.Obms "before all" hook: Http.Services.Api.Obms before
Error Details: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.
Stack Trace: Error: timeout of 2000ms exceeded. Ensure the done() callback is being called in this test.

Test Name: Ssh Serializable V1 "before all" hook: helper.before
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Obm Serializable V1 "before all" hook: helper.before
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Snmp Serializable V1 "before all" hook: helper.before
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Node Serializable V1 "before all" hook: helper.before
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Registries "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Registries "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/registry-spec.js:51:18)

Test Name: Redfish Chassis Root "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Chassis Root "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Managers "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Managers "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/managers-spec.js:87:18)

Test Name: Redfish Schemas "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Schemas "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/schemas-spec.js:36:18)

Test Name: Redfish Session Service "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Session Service "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/session-service-spec.js:97:18)

Test Name: Redfish Account Service "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Account Service "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Systems Root "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Systems Root "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/system-spec.js:108:18)

Test Name: Redfish Endpoint "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Endpoint "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/service-root-spec.js:55:18)

Test Name: Redfish Roles "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Roles "after all" hook: stop HTTP server
Error Details: Cannot read property 'render' of undefined
Stack Trace: TypeError: Cannot read property 'render' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/roles-spec.js:22:16)

Test Name: Redfish TaskService "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish TaskService "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/task-service-spec.js:86:18)

Test Name: Redfish Event Service "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Redfish Event Service "after all" hook: stop HTTP server
Error Details: Cannot read property 'validate' of undefined
Stack Trace: TypeError: Cannot read property 'validate' of undefined
at Context.<anonymous> (spec/lib/api/redfish-1.0/event-service-spec.js:86:18)

Test Name: Http.Api.Roles "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Roles "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Workflows.2.0 "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Workflows.2.0 "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Skus.2.0 "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Skus.2.0 "after all" hook: stop HTTP server
Error Details: Cannot read property 'getSkus' of undefined
Stack Trace: TypeError: Cannot read property 'getSkus' of undefined
at Context.<anonymous> (spec/lib/api/2.0/skus-spec.js:53:22)

Test Name: Http.Api.Views "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Views "after all" hook: stop HTTP server
Error Details: _ is not a function
Stack Trace: TypeError: _ is not a function
at Context.<anonymous> (spec/lib/api/2.0/views-spec.js:37:9)

Test Name: 2.0 Http.Api.Nodes "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: 2.0 Http.Api.Nodes "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Tags "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Tags "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Ibms "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Ibms "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Schemas "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Schemas "after all" hook: stop HTTP server
Error Details: Cannot read property 'getSchema' of undefined
Stack Trace: TypeError: Cannot read property 'getSchema' of undefined
at Context.<anonymous> (spec/lib/api/2.0/schemas-spec.js:28:22)

Test Name: Http.Api.Tasks "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Tasks "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Pollers "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Pollers "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Profiles "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Profiles "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Workflows.2.0 "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Workflows.2.0 "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Obms "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Obms "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Internal.Files "before all" hook: start HTTP server and add file
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Internal.Files "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Lookup 2.0 "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Lookup 2.0 "after all" hook: stop HTTP server
Error Details: Cannot read property 'restore' of undefined
Stack Trace: TypeError: Cannot read property 'restore' of undefined
at Context.<anonymous> (spec/lib/api/2.0/lookups-spec.js:80:19)

Test Name: Http.Api.Users "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Users "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: 2.0 Http.Api.Catalogs "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: 2.0 Http.Api.Catalogs "after all" hook: stop HTTP server
Error Details: Cannot read property 'restore' of undefined
Stack Trace: TypeError: Cannot read property 'restore' of undefined
at Context.<anonymous> (spec/lib/api/2.0/catalogs-spec.js:34:17)

Test Name: Http.Api.Templates "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Templates "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Config v2.0 "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Config v2.0 "after all" hook: stop HTTP server
Error Details: Cannot read property 'set' of undefined
Stack Trace: TypeError: Cannot read property 'set' of undefined
at Context.<anonymous> (spec/lib/api/2.0/config-spec.js:23:22)

Test Name: Http.Api.Notification "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Notification "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Hooks v2.0 "before all" hook: start HTTP server
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Hooks v2.0 "after all" hook: stop HTTP server
Error Details: Cannot read property 'send' of undefined
Stack Trace: TypeError: Cannot read property 'send' of undefined
at StatsDService.Client.send (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:221:16)
at StatsDService.Client.sendAll (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:181:10)
at StatsDService.Client.increment (node_modules/on-core/node_modules/node-statsd/lib/statsd.js:76:8)
at StatsDService.stop (node_modules/on-core/lib/services/statsd.js:52:14)
at node_modules/on-core/lib/services/core.js:47:28
at arrayMap (node_modules/lodash/index.js:1406:25)
at Function.map (node_modules/lodash/index.js:6710:14)
at CoreService.stop (node_modules/on-core/lib/services/core.js:46:26)
at app.js:9:2859
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromises (node_modules/on-core/node_modules/bluebird/js/main/promise.js:700:14)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:123:16)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Login "before all" hook: helper.before
Error Details: Connection is already registered
Stack Trace: AdapterError: Connection is already registered
at Object.module.exports.adapter.registerConnection (node_modules/on-core/node_modules/sails-mongo/lib/adapter.js:86:60)
at node_modules/on-core/node_modules/waterline/lib/waterline.js:203:29
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:162:20
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:230:13
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at _each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:72:13)
at Object.async.forEachOf.async.eachOf (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:229:9)
at Object.async.forEach.async.each (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:206:22)
at Array.async.auto.registerConnections (node_modules/on-core/node_modules/waterline/lib/waterline.js:176:13)
at node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:590:38
at _arrayEach (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:81:9)
at Object.async.auto (node_modules/on-core/node_modules/waterline/node_modules/async/lib/async.js:552:9)
at Waterline.initialize (node_modules/on-core/node_modules/waterline/lib/waterline.js:121:9)
at node_modules/on-core/lib/services/waterline.js:96:26
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._resolveFromResolver (node_modules/on-core/node_modules/bluebird/js/main/promise.js:483:31)
at new Promise (node_modules/on-core/node_modules/bluebird/js/main/promise.js:71:37)
at WaterlineServiceFactory.WaterlineService.initService (node_modules/on-core/lib/services/waterline.js:42:16)
at node_modules/on-core/lib/services/waterline.js:120:29
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Promise._settlePromiseAtPostResolution (node_modules/on-core/node_modules/bluebird/js/main/promise.js:248:10)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

Test Name: Http.Api.Login "after all" hook: remove waterline definition
Error Details: Cannot convert undefined or null to object
Stack Trace: TypeError: Cannot convert undefined or null to object
at Context.<anonymous> (spec/lib/api/login/login-spec.js:94:16)
at tryCatcher (node_modules/on-core/node_modules/bluebird/js/main/util.js:26:23)
at Promise._settlePromiseFromHandler (node_modules/on-core/node_modules/bluebird/js/main/promise.js:510:31)
at Promise._settlePromiseAt (node_modules/on-core/node_modules/bluebird/js/main/promise.js:584:18)
at Async._drainQueue (node_modules/on-core/node_modules/bluebird/js/main/async.js:128:12)
at Async._drainQueues (node_modules/on-core/node_modules/bluebird/js/main/async.js:133:10)
at Immediate.Async.drainQueues [as _onImmediate] (node_modules/on-core/node_modules/bluebird/js/main/async.js:15:14)

@PengTian0
Copy link
Contributor

test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #24 : FAILURE

BUILD on-tasks #24 Error Logs ▼Test Name: test_nodes_discovery Error Details: timeout waiting for task discovery -------------------- >> begin captured logging << -------------------- tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:32:05.704925 amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] amqp: DEBUG: Open OK! kombu: INFO: Starting AMQP worker -> graph.finished.*> amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] amqp: DEBUG: Open OK! kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091// amqp: DEBUG: using channel_id: 1 amqp: DEBUG: Channel open modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping.. kombu: INFO: Stopping AMQP worker -> graph.finished.*> modules.worker: INFO: stopping subtask for discovery amqp: DEBUG: Closed channel #1 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run testMethod() File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest self._testFunc() File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func compatability.capture_type_error(s_func) File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error func() File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func func(test_case.state.get_state()) File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery message='timeout waiting for task {0}'.format(self.__task.id)) File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false raise ASSERTION_ERROR(message) "timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:32:05.704925\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker -> graph.finished.*>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker -> graph.finished.*>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:39:53.401628
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:39:53.401628\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:41:58.067103
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:41:58.067103\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:44:27.662088
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-03-23 04:44:27.662088\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 58d38b0023a8a9c10a1ab1ee!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 58d38b0023a8a9c10a1ab1ee!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-m2XyuJSrPXqOUSgsxOonwSs8fwo"', 'Date': 'Thu, 23 Mar 2017 09:04:30 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"4391de2d-eef9-498c-83fe-d748fb2c516b"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '137', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"89-m2XyuJSrPXqOUSgsxOonwSs8fwo"', 'Date': 'Thu, 23 Mar 2017 09:04:30 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object).","status":"400","UUID":"4391de2d-eef9-498c-83fe-d748fb2c516b"}

Test Name: test_node_workflows_post
Error Details: Failure running Graph.noop-example
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58d38b0023a8a9c10a1ab1ee
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58d38b0723a8a9c10a1ab1fa
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
tests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58d38b0b23a8a9c10a1ab211
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:
@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Channel open
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 300 seconds, (id=58d38b0023a8a9c10a1ab1ee), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for 58d38b0023a8a9c10a1ab1ee
amqp: DEBUG: Closed channel #1
modules.worker: ERROR: subtask timeout after 300 seconds, (id=58d38b0723a8a9c10a1ab1fa), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
modules.worker: INFO: stopping subtask for 58d38b0723a8a9c10a1ab1fa
amqp: DEBUG: Closed channel #1
modules.worker: ERROR: subtask timeout after 301 seconds, (id=58d38b0b23a8a9c10a1ab211), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for 58d38b0b23a8a9c10a1ab211
amqp: DEBUG: Closed channel #1
tests.api.v2_0.workflows_tests: ERROR: Timeout for Graph.noop-example, node 58d38b0023a8a9c10a1ab1ee
tests.api.v2_0.workflows_tests: ERROR: Timeout for Graph.noop-example, node 58d38b0723a8a9c10a1ab1fa
tests.api.v2_0.workflows_tests: ERROR: Timeout for Graph.noop-example, node 58d38b0b23a8a9c10a1ab211
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 276, in test_node_workflows_post
self.post_workflows("Graph.noop-example")
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 216, in post_workflows
self.run_workflow_tasks(self.__tasks, timeout_sec)
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 270, in run_workflow_tasks
fail('Failure running {0}'.format(self.__graph_name))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
"Failure running Graph.noop-example\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58d38b0023a8a9c10a1ab1ee\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58d38b0723a8a9c10a1ab1fa\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\ntests.api.v2_0.workflows_tests: INFO: starting amqp listener for node 58d38b0b23a8a9c10a1ab211\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Channel open\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=58d38b0023a8a9c10a1ab1ee), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for 58d38b0023a8a9c10a1ab1ee\namqp: DEBUG: Closed channel #1\nmodules.worker: ERROR: subtask timeout after 300 seconds, (id=58d38b0723a8a9c10a1ab1fa), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for 58d38b0723a8a9c10a1ab1fa\namqp: DEBUG: Closed channel #1\nmodules.worker: ERROR: subtask timeout after 301 seconds, (id=58d38b0b23a8a9c10a1ab211), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for 58d38b0b23a8a9c10a1ab211\namqp: DEBUG: Closed channel #1\ntests.api.v2_0.workflows_tests: ERROR: Timeout for Graph.noop-example, node 58d38b0023a8a9c10a1ab1ee\ntests.api.v2_0.workflows_tests: ERROR: Timeout for Graph.noop-example, node 58d38b0723a8a9c10a1ab1fa\ntests.api.v2_0.workflows_tests: ERROR: Timeout for Graph.noop-example, node 58d38b0b23a8a9c10a1ab211\n--------------------- >> end captured logging << ---------------------"

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-oIs3FRcWuIr88Hi4YpkqoIirkV0"', 'Date': 'Thu, 23 Mar 2017 09:09:42 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"325d8093-9c25-4230-a031-8a320a2a9048"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-oIs3FRcWuIr88Hi4YpkqoIirkV0"', 'Date': 'Thu, 23 Mar 2017 09:09:42 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"325d8093-9c25-4230-a031-8a320a2a9048"}

Test Name: get_sku_nodes
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-pmRLHfj/FlajMUQgCYyt7bWXe6w"', 'Date': 'Thu, 23 Mar 2017 09:09:43 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"e8fc79ef-f29d-4647-82a5-eeac91949215"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 148, in get_sku_nodes
Api().nodes_get_catalog_source_by_id(identifier=node_id,source='dmi')
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-pmRLHfj/FlajMUQgCYyt7bWXe6w"', 'Date': 'Thu, 23 Mar 2017 09:09:43 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"e8fc79ef-f29d-4647-82a5-eeac91949215"}

Test Name: post_skupacks
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-fHNXyPcv0HBMW1sSdootaOGLcVk"', 'Date': 'Thu, 23 Mar 2017 09:09:48 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"bebc9322-6591-4d07-93cc-33eb5530a5d2"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/sel_alert_poller_tests.py", line 54, in post_skupacks
Api().nodes_get_catalog_source_by_id(identifier=node_id, source='dmi')
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-fHNXyPcv0HBMW1sSdootaOGLcVk"', 'Date': 'Thu, 23 Mar 2017 09:09:48 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"bebc9322-6591-4d07-93cc-33eb5530a5d2"}

Test Name: test_get_systems
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '740', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"2e4-oTd3izUq4h7V7ZASJ2lbUE9ZPFs"', 'Date': 'Thu, 23 Mar 2017 09:09:51 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"error":{"code":"Base.1.0.GeneralError","message":"A general error has occurred. See ExtendedInfo for more information.","@Message.ExtendedInfo":[{"@odata.type":"#Message.1.0.0.Message","MessageId":"Base.1.0.Messages.InvalidObject","Description":"Indicates that the object in question is invalid according to the implementation. Examples include a firmware update malformed URI.","Message":"The object at %1 is invalid.","Resolution":"Either the object is malformed or the URI is not correct. Correct the condition and resubmit the request if it failed.","Severity":"Critical"},{"MessageId":"RackHD.1.0.DetailedErrorMessage","Message":"No Catalogs Found for Source (dmi).","Description":"Contains the detailed error message contents"}]}}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/redfish_1_0/systems_tests.py", line 55, in test_get_systems
redfish().get_system(dataId)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_redfish_1_0/apis/redfishv_api.py", line 2990, in get_system
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_redfish_1_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_redfish_1_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_redfish_1_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_redfish_1_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_redfish_1_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '740', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"2e4-oTd3izUq4h7V7ZASJ2lbUE9ZPFs"', 'Date': 'Thu, 23 Mar 2017 09:09:51 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"error":{"code":"Base.1.0.GeneralError","message":"A general error has occurred. See ExtendedInfo for more information.","@Message.ExtendedInfo":[{"@odata.type":"#Message.1.0.0.Message","MessageId":"Base.1.0.Messages.InvalidObject","Description":"Indicates that the object in question is invalid according to the implementation. Examples include a firmware update malformed URI.","Message":"The object at %1 is invalid.","Resolution":"Either the object is malformed or the URI is not correct. Correct the condition and resubmit the request if it failed.","Severity":"Critical"},{"MessageId":"RackHD.1.0.DetailedErrorMessage","Message":"No Catalogs Found for Source (dmi).","Description":"Contains the detailed error message contents"}]}}

Test Name: test10_apply_obm_settings
Error Details: OBM settings failed.
-------------------- >> begin captured stdout << ---------------------
restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 201

restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 201

restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 201

restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 201

restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
restful: Action = get , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a
restful: Status code = 200

**** Node(s) OBM status:
{
"58d38829a7720aaf0ae6e22c": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d3882ca7720aaf0ae6e238": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
},
"58d38834a7720aaf0ae6e25a": {
"instanceId": "",
"retry": 0,
"sku": "unknown",
"status": "pending"
}
}
**** Node(s) OBM settings failed.

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
root: INFO: +1.19 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]
test.run: INFO_5: **** Apply OBM setting to compute nodes.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 207, in test10_apply_obm_settings
self.assertTrue(fit_common.apply_obm_settings(), "OBM settings failed.")
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'OBM settings failed.\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 201 \n\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 201 \n\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 201 \n\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 201 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\nrestful: Action = get , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38829a7720aaf0ae6e22c\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d3882ca7720aaf0ae6e238\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/58d38834a7720aaf0ae6e25a\nrestful: Status code = 200 \n\n**** Node(s) OBM status:\n{\n "58d38829a7720aaf0ae6e22c": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d3882ca7720aaf0ae6e238": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }, \n "58d38834a7720aaf0ae6e25a": {\n "instanceId": "", \n "retry": 0, \n "sku": "unknown", \n "status": "pending"\n }\n}\n**** Node(s) OBM settings failed.\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\nroot: INFO: +1.19 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ntest.run: INFO_5: **** Apply OBM setting to compute nodes.\n--------------------- >> end captured logging << ---------------------'

Test Name: test12_check_pollers
Error Details: No pollers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
root: INFO: +1.23 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]
test.run: INFO_5: **** Waiting for pollers.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 242, in test12_check_pollers
self.assertTrue(self.check_for_active_pollers(MAX_CYCLES), 'No pollers')
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'No pollers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\nroot: INFO: +1.23 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ntest.run: INFO_5: **** Waiting for pollers.\n--------------------- >> end captured logging << ---------------------'

@geoff-reid
Copy link
Contributor

jenkins: test this please

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #107 : FAILURE

BUILD on-tasks #107 Error Logs ▼Test Name: test_nodes_discovery Error Details: timeout waiting for task discovery -------------------- >> begin captured logging << -------------------- tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 16:59:40.130007 amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] amqp: DEBUG: Open OK! kombu: INFO: Starting AMQP worker -> graph.finished.*> amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] amqp: DEBUG: Open OK! kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091// amqp: DEBUG: using channel_id: 1 amqp: DEBUG: Channel open modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping.. kombu: INFO: Stopping AMQP worker -> graph.finished.*> modules.worker: INFO: stopping subtask for discovery amqp: DEBUG: Closed channel #1 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run testMethod() File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest self._testFunc() File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func compatability.capture_type_error(s_func) File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error func() File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func func(test_case.state.get_state()) File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery message='timeout waiting for task {0}'.format(self.__task.id)) File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false raise ASSERTION_ERROR(message) "timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 16:59:40.130007\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker -> graph.finished.*>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker -> graph.finished.*>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 16:56:08.751457
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 16:56:08.751457\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_catalogs
Error Details: Catalog dmi not found in node 5931d102cf7f2a4d0a35fcb5!
Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/catalogs_tests.py", line 48, in test_catalogs
fail('Catalog {0} not found in node {1}!'.format(source,node.get('id')))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 220, in fail
raise ASSERTION_ERROR(message)
AssertionError: Catalog dmi not found in node 5931d102cf7f2a4d0a35fcb5!

Test Name: pollers_data_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '145', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"91-/VdRAA+DrNuFhIEymD3zZ3cTe8Q"', 'Date': 'Fri, 02 Jun 2017 21:16:12 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object). 1000 ms","status":"400","UUID":"a7a78716-6b8d-405f-b420-23af97febda7"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/pollers_tests.py", line 151, in pollers_data_get
Api().pollers_data_get(poller['id'])
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 4280, in pollers_data_get
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '145', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"91-/VdRAA+DrNuFhIEymD3zZ3cTe8Q"', 'Date': 'Fri, 02 Jun 2017 21:16:12 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Request Timed Out (on.task:methods.requestPollerCache:Object). 1000 ms","status":"400","UUID":"a7a78716-6b8d-405f-b420-23af97febda7"}

Test Name: test_workflows_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-Sg96Mfuccf9Z5AIbzjlpcced47A"', 'Date': 'Fri, 02 Jun 2017 21:22:19 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"efaccf6c-00c9-47cb-bacd-b9d89e357e95"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 69, in test_workflows_get
Api().workflows_get()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 8075, in workflows_get
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-Sg96Mfuccf9Z5AIbzjlpcced47A"', 'Date': 'Fri, 02 Jun 2017 21:22:19 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"efaccf6c-00c9-47cb-bacd-b9d89e357e95"}

Test Name: test_workflows_post
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-9oJwkZdAOXoRE/CML5WV7s7jVEM"', 'Date': 'Fri, 02 Jun 2017 21:24:42 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"c865b1f8-e87e-4f19-8df0-bc4cab41a520"}

-------------------- >> begin captured logging << --------------------
urllib3.connectionpool: WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine("''",))': /api/2.0/workflows
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 77, in test_workflows_post
Api().workflows_post(body={"name": 'Graph.noop-example'})
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 8154, in workflows_post
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 358, in request
body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 208, in POST
body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
'(400)\nReason: Bad Request\nHTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-9oJwkZdAOXoRE/CML5WV7s7jVEM"', 'Date': 'Fri, 02 Jun 2017 21:24:42 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})\nHTTP response body: {"message":"Connect Failed","status":"400","UUID":"c865b1f8-e87e-4f19-8df0-bc4cab41a520"}\n\n-------------------- >> begin captured logging << --------------------\nurllib3.connectionpool: WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine("''",))': /api/2.0/workflows\n--------------------- >> end captured logging << ---------------------'

Test Name: test_workflows_graphs_get
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-CxDF6R9ECsxw0lqdEovUWOB9Qd4"', 'Date': 'Fri, 02 Jun 2017 21:26:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"acc097a7-659a-41cd-a585-e1eaa956ba96"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 110, in test_workflows_graphs_get
Api().workflows_get_graphs()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 8227, in workflows_get_graphs
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-CxDF6R9ECsxw0lqdEovUWOB9Qd4"', 'Date': 'Fri, 02 Jun 2017 21:26:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"acc097a7-659a-41cd-a585-e1eaa956ba96"}

Test Name: test_workflows_graphs_put
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-E1Ie1gv6NOKJSSe8I/NS7jWEak0"', 'Date': 'Fri, 02 Jun 2017 21:28:37 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"b481be65-ac4e-46e8-86fb-3c8e3f3e63a7"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/workflows_tests.py", line 120, in test_workflows_graphs_put
Api().workflows_get_graphs_by_name('')
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 8382, in workflows_get_graphs_by_name
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-E1Ie1gv6NOKJSSe8I/NS7jWEak0"', 'Date': 'Fri, 02 Jun 2017 21:28:37 GMT', 'Access-Control-Allow-Origin': '
', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"b481be65-ac4e-46e8-86fb-3c8e3f3e63a7"}

Test Name: test_tag_create
Error Details: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-H45c/FighqOuWNB5ku+XHycvSw4"', 'Date': 'Fri, 02 Jun 2017 21:28:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"215aa225-e356-4127-9f4b-c6af323e03aa"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 45, in test_tag_create
tagsWithRules = self.__create_tag_rule(n.get('id'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/tags_tests.py", line 26, in __create_tag_rule
Api().nodes_get_catalog_source_by_id(identifier=id,source='dmi')
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 1862, in nodes_get_catalog_source_by_id
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 342, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 184, in GET
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Content-Length': '110', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"6e-H45c/FighqOuWNB5ku+XHycvSw4"', 'Date': 'Fri, 02 Jun 2017 21:28:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"No Catalogs Found for Source (dmi).","status":"404","UUID":"215aa225-e356-4127-9f4b-c6af323e03aa"}

Test Name: post_sku
Error Details: (409)
Reason: Conflict
HTTP response headers: HTTPHeaderDict({'Content-Length': '95', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"5f-FHPMzZ79SIelo6VEA8duT7yXEdY"', 'Date': 'Fri, 02 Jun 2017 21:30:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"duplicate name found","status":"409","UUID":"097df638-3c95-40c4-b5ae-9c5ddccc598a"}

-------------------- >> begin captured logging << --------------------
urllib3.connectionpool: WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine("''",))': /api/2.0/skus
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/skupack_tests.py", line 69, in post_sku
Api().skus_post(sku)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 5462, in skus_post
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 358, in request
body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 208, in POST
body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
'(409)\nReason: Conflict\nHTTP response headers: HTTPHeaderDict({'Content-Length': '95', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"5f-FHPMzZ79SIelo6VEA8duT7yXEdY"', 'Date': 'Fri, 02 Jun 2017 21:30:38 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})\nHTTP response body: {"message":"duplicate name found","status":"409","UUID":"097df638-3c95-40c4-b5ae-9c5ddccc598a"}\n\n-------------------- >> begin captured logging << --------------------\nurllib3.connectionpool: WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'ProtocolError('Connection aborted.', BadStatusLine("''",))': /api/2.0/skus\n--------------------- >> end captured logging << ---------------------'

Test Name: post_skupacks
Error Details: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-qL/pyaD0i/2qZwJ987BPsucNAvI"', 'Date': 'Fri, 02 Jun 2017 21:32:35 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"23f5bf92-7db2-4526-836c-15514233005c"}

Stack Trace: Traceback (most recent call last):
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 333, in get_state
self.instance = self.entry.home()
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/sel_alert_poller_tests.py", line 38, in init
self.delete_skus()# clear any skus
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/sel_alert_poller_tests.py", line 307, in delete_skus
Api().skus_id_delete(item.get("id"))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/apis/api_api.py", line 5693, in skus_id_delete
callback=params.get('callback'))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 322, in call_api
response_type, auth_settings, callback)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 149, in __call_api
post_params=post_params, body=body)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/api_client.py", line 374, in request
headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 201, in DELETE
query_params=query_params)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/on_http_api2_0/rest.py", line 177, in request
raise ApiException(http_resp=r)
ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'Content-Length': '89', 'X-Powered-By': 'Express', 'Connection': 'keep-alive', 'ETag': 'W/"59-qL/pyaD0i/2qZwJ987BPsucNAvI"', 'Date': 'Fri, 02 Jun 2017 21:32:35 GMT', 'Access-Control-Allow-Origin': '*', 'Content-Type': 'application/json; charset=utf-8'})
HTTP response body: {"message":"Connect Failed","status":"400","UUID":"23f5bf92-7db2-4526-836c-15514233005c"}

Test Name: test02_preload_sku_packs
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = https://localhost:9093/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:9093/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:9093/redfish/v1/SessionService/Sessions
restful: Status code = 200

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Downloading SKU packs from GitHub
test.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack
test.run: INFO_5: **** Loading SKU Packs to server
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-1u_quanta-d51-1u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r740_dell-r740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730xd_dell-r730xd.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-dss-9500M_dell-dss-9500M.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740T_brocade-VDX-6740T.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 87, in test02_preload_sku_packs
fit_common.rackhdapi("/api/2.0/skus/pack", action="binary-post", payload=file.read())
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 627, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 721, in restful
verify=sslverify
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 107, in post
return request('post', url, data=data, json=json, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = https://localhost:9093/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:9093/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:9093/redfish/v1/SessionService/Sessions\nrestful: Status code = 200 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Downloading SKU packs from GitHub\ntest.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack\ntest.run: INFO_5: **** Loading SKU Packs to server\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-1u_quanta-d51-1u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r740_dell-r740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730xd_dell-r730xd.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-dss-9500M_dell-dss-9500M.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740T_brocade-VDX-6740T.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz\n--------------------- >> end captured logging << ---------------------'

Test Name: test03_preload_default_sku
Error Details: Incorrect HTTP return code, expecting 201 or 409, got 400
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 115, in test03_preload_default_sku
'Incorrect HTTP return code, expecting 201 or 409, got ' + str(api_data['status']))
File "/usr/lib/python2.7/unittest/case.py", line 805, in assertIn
self.fail(self._formatMessage(msg, standardMsg))
File "/usr/lib/python2.7/unittest/case.py", line 412, in fail
raise self.failureException(msg)
'Incorrect HTTP return code, expecting 201 or 409, got 400\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\n--------------------- >> end captured logging << ---------------------'

Test Name: test09_check_discovery
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/5931d053aedb15390a666329/workflows

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for node Discovery to complete.

--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 194, in test09_check_discovery
self.assertTrue(self.check_for_active_workflows(MAX_CYCLES), "Node discovery not completed")
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 213, in check_for_active_workflows
if fit_common.check_active_workflows(node_id):
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 950, in check_active_workflows
workflows = rackhdapi('/api/2.0/nodes/' + nodeid + '/workflows')['json']
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 627, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 678, in restful
headers=rest_headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 67, in get
return request('get', url, params=params, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/5931d053aedb15390a666329/workflows\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for node Discovery to complete.\n\n--------------------- >> end captured logging << ---------------------'

Test Name: test10_apply_obm_settings
Error Details: OBM settings failed.
-------------------- >> begin captured stdout << ---------------------
restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 400

**** OBM workflow failed to load!

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Apply OBM setting to compute nodes.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 223, in test10_apply_obm_settings
self.assertTrue(fit_common.apply_obm_settings(), "OBM settings failed.")
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'OBM settings failed.\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 400 \n\n**** OBM workflow failed to load!\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Apply OBM setting to compute nodes.\n--------------------- >> end captured logging << ---------------------'

Test Name: test12_check_pollers
Error Details: No pollers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for pollers.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 258, in test12_check_pollers
self.assertTrue(self.check_for_active_pollers(MAX_CYCLES), 'No pollers')
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'No pollers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fa45d7f1710> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fa45d7c2390> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for pollers.\n--------------------- >> end captured logging << ---------------------'

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 17:28:02.783859
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 17:28:02.783859\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

Test Name: test_nodes_discovery
Error Details: timeout waiting for task discovery
-------------------- >> begin captured logging << --------------------
tests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 17:38:54.794346
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>
amqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']
amqp: DEBUG: Open OK!
kombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//
amqp: DEBUG: using channel_id: 1
amqp: DEBUG: Channel open
modules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..
kombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.
>
modules.worker: INFO: stopping subtask for discovery
amqp: DEBUG: Closed channel #1
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
self._testFunc()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
compatability.capture_type_error(s_func)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
func()
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
func(test_case.state.get_state())
File "/home/jenkins/workspace/on-tasks/RackHD/test/tests/api/v2_0/nodes_tests.py", line 126, in test_nodes_discovery
message='timeout waiting for task {0}'.format(self.__task.id))
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/proboscis/asserts.py", line 67, in assert_false
raise ASSERTION_ERROR(message)
"timeout waiting for task discovery\n-------------------- >> begin captured logging << --------------------\ntests.api.v2_0.nodes_tests: INFO: Wait start time: 2017-06-02 17:38:54.794346\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu: INFO: Starting AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\namqp: DEBUG: Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US']\namqp: DEBUG: Open OK!\nkombu.mixins: INFO: Connected to amqp://guest:**@127.0.0.1:9091//\namqp: DEBUG: using channel_id: 1\namqp: DEBUG: Channel open\nmodules.worker: ERROR: subtask timeout after 1200 seconds, (id=discovery), stopping..\nkombu: INFO: Stopping AMQP worker <unbound Queue graph.finished -> <unbound Exchange on.events(topic)> -> graph.finished.>\nmodules.worker: INFO: stopping subtask for discovery\namqp: DEBUG: Closed channel #1\n--------------------- >> end captured logging << ---------------------"

@JenkinsRHD
Copy link
Contributor

BUILD on-tasks #148 : UNSTABLE

BUILD on-tasks #148 Error Logs ▼Test Name: test02_preload_sku_packs Error Details: ('Connection aborted.', BadStatusLine("''",)) -------------------- >> begin captured stdout << --------------------- restful: Action = post , URL = https://localhost:8443/login restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions
restful: Status code = 200

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Downloading SKU packs from GitHub
test.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack
test.run: INFO_5: **** Loading SKU Packs to server
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-1u_quanta-d51-1u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r740_dell-r740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730xd_dell-r730xd.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-dss-9500M_dell-dss-9500M.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740T_brocade-VDX-6740T.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz
test.run: INFO_5: **** Loading SKU Pack for arista-dcs-7124S_arista-dcs-7124S.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-3172T_cisco-nexus-3172T.tar.gz
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 85, in test02_preload_sku_packs
fit_common.rackhdapi("/api/2.0/skus/pack", action="binary-post", payload=file.read())
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 629, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 723, in restful
verify=sslverify
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 107, in post
return request('post', url, data=data, json=json, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions\nrestful: Status code = 200 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Downloading SKU packs from GitHub\ntest.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack\ntest.run: INFO_5: **** Loading SKU Packs to server\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-1u_quanta-d51-1u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r740_dell-r740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730xd_dell-r730xd.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-dss-9500M_dell-dss-9500M.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740T_brocade-VDX-6740T.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for arista-dcs-7124S_arista-dcs-7124S.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-3172T_cisco-nexus-3172T.tar.gz\n--------------------- >> end captured logging << ---------------------'

Test Name: test03_preload_default_sku
Error Details: Incorrect HTTP return code, expecting 201 or 409, got 400
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 113, in test03_preload_default_sku
'Incorrect HTTP return code, expecting 201 or 409, got ' + str(api_data['status']))
File "/usr/lib/python2.7/unittest/case.py", line 805, in assertIn
self.fail(self._formatMessage(msg, standardMsg))
File "/usr/lib/python2.7/unittest/case.py", line 412, in fail
raise self.failureException(msg)
'Incorrect HTTP return code, expecting 201 or 409, got 400\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\n--------------------- >> end captured logging << ---------------------'

Test Name: test09_check_discovery
Error Details: string indices must be integers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac21c768970ad000938da/workflows
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for node Discovery to complete.

--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 192, in test09_check_discovery
self.assertTrue(self.check_for_active_workflows(MAX_CYCLES), "Node discovery not completed")
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 211, in check_for_active_workflows
if fit_common.check_active_workflows(node_id):
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 973, in check_active_workflows
if item['status'] in ['running', 'pending']:
'string indices must be integers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac21c768970ad000938da/workflows\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for node Discovery to complete.\n\n--------------------- >> end captured logging << ---------------------'

Test Name: test10_apply_obm_settings
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Apply OBM setting to compute nodes.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 221, in test10_apply_obm_settings
self.assertTrue(fit_common.apply_obm_settings(), "OBM settings failed.")
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 1011, in apply_obm_settings
api_data = rackhdapi("/api/2.0/workflows/graphs", action="put", payload=payload)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 629, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 692, in restful
verify=sslverify,
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 120, in put
return request('put', url, data=data, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Apply OBM setting to compute nodes.\n--------------------- >> end captured logging << ---------------------'

Test Name: test12_check_pollers
Error Details: No pollers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for pollers.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 256, in test12_check_pollers
self.assertTrue(self.check_for_active_pollers(MAX_CYCLES), 'No pollers')
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'No pollers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fb98587f950> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fb9858c75d0> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for pollers.\n--------------------- >> end captured logging << ---------------------'

Test Name: test02_preload_sku_packs
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions
restful: Status code = 200

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Downloading SKU packs from GitHub
test.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack
test.run: INFO_5: **** Loading SKU Packs to server
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3164PQ_cisco-nexus-C3164PQ.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r630_dell-r630.tar.gz
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-c6320_dell-c6320.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r640_dell-r640.tar.gz
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 85, in test02_preload_sku_packs
fit_common.rackhdapi("/api/2.0/skus/pack", action="binary-post", payload=file.read())
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 629, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 723, in restful
verify=sslverify
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 107, in post
return request('post', url, data=data, json=json, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions\nrestful: Status code = 200 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Downloading SKU packs from GitHub\ntest.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack\ntest.run: INFO_5: **** Loading SKU Packs to server\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3164PQ_cisco-nexus-C3164PQ.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r630_dell-r630.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-c6320_dell-c6320.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r640_dell-r640.tar.gz\n--------------------- >> end captured logging << ---------------------'

Test Name: test03_preload_default_sku
Error Details: Incorrect HTTP return code, expecting 201 or 409, got 400
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 113, in test03_preload_default_sku
'Incorrect HTTP return code, expecting 201 or 409, got ' + str(api_data['status']))
File "/usr/lib/python2.7/unittest/case.py", line 805, in assertIn
self.fail(self._formatMessage(msg, standardMsg))
File "/usr/lib/python2.7/unittest/case.py", line 412, in fail
raise self.failureException(msg)
'Incorrect HTTP return code, expecting 201 or 409, got 400\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\n--------------------- >> end captured logging << ---------------------'

Test Name: test09_check_discovery
Error Details: string indices must be integers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac28bbbdbfbac002e943d/workflows
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for node Discovery to complete.

--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 192, in test09_check_discovery
self.assertTrue(self.check_for_active_workflows(MAX_CYCLES), "Node discovery not completed")
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 211, in check_for_active_workflows
if fit_common.check_active_workflows(node_id):
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 973, in check_active_workflows
if item['status'] in ['running', 'pending']:
'string indices must be integers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac28bbbdbfbac002e943d/workflows\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for node Discovery to complete.\n\n--------------------- >> end captured logging << ---------------------'

Test Name: test10_apply_obm_settings
Error Details: OBM settings failed.
-------------------- >> begin captured stdout << ---------------------
restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 400

**** OBM workflow failed to load!

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Apply OBM setting to compute nodes.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 221, in test10_apply_obm_settings
self.assertTrue(fit_common.apply_obm_settings(), "OBM settings failed.")
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'OBM settings failed.\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 400 \n\n**** OBM workflow failed to load!\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Apply OBM setting to compute nodes.\n--------------------- >> end captured logging << ---------------------'

Test Name: test12_check_pollers
Error Details: No pollers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for pollers.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 256, in test12_check_pollers
self.assertTrue(self.check_for_active_pollers(MAX_CYCLES), 'No pollers')
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'No pollers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f6c85f1aa10> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f6c85eed690> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for pollers.\n--------------------- >> end captured logging << ---------------------'

Test Name: test02_preload_sku_packs
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions
restful: Status code = 200

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Downloading SKU packs from GitHub
test.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack
test.run: INFO_5: **** Loading SKU Packs to server
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3164PQ_cisco-nexus-C3164PQ.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r630_dell-r630.tar.gz
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-c6320_dell-c6320.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r640_dell-r640.tar.gz
test.run: INFO_5: **** Loading SKU Pack for sinetica-hawk-i2_sinetica-hawk-i2.tar.gz
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 85, in test02_preload_sku_packs
fit_common.rackhdapi("/api/2.0/skus/pack", action="binary-post", payload=file.read())
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 629, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 723, in restful
verify=sslverify
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 107, in post
return request('post', url, data=data, json=json, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions\nrestful: Status code = 200 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Downloading SKU packs from GitHub\ntest.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack\ntest.run: INFO_5: **** Loading SKU Packs to server\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3164PQ_cisco-nexus-C3164PQ.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r630_dell-r630.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-c6320_dell-c6320.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r640_dell-r640.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for sinetica-hawk-i2_sinetica-hawk-i2.tar.gz\n--------------------- >> end captured logging << ---------------------'

Test Name: test03_preload_default_sku
Error Details: Incorrect HTTP return code, expecting 201 or 409, got 400
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 113, in test03_preload_default_sku
'Incorrect HTTP return code, expecting 201 or 409, got ' + str(api_data['status']))
File "/usr/lib/python2.7/unittest/case.py", line 805, in assertIn
self.fail(self._formatMessage(msg, standardMsg))
File "/usr/lib/python2.7/unittest/case.py", line 412, in fail
raise self.failureException(msg)
'Incorrect HTTP return code, expecting 201 or 409, got 400\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\n--------------------- >> end captured logging << ---------------------'

Test Name: test09_check_discovery
Error Details: string indices must be integers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac2c477aaa7a5008ca450/workflows
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for node Discovery to complete.

--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 192, in test09_check_discovery
self.assertTrue(self.check_for_active_workflows(MAX_CYCLES), "Node discovery not completed")
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 211, in check_for_active_workflows
if fit_common.check_active_workflows(node_id):
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 973, in check_active_workflows
if item['status'] in ['running', 'pending']:
'string indices must be integers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac2c477aaa7a5008ca450/workflows\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for node Discovery to complete.\n\n--------------------- >> end captured logging << ---------------------'

Test Name: test10_apply_obm_settings
Error Details: OBM settings failed.
-------------------- >> begin captured stdout << ---------------------
restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs
restful: Status code = 400

**** OBM workflow failed to load!

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Apply OBM setting to compute nodes.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 221, in test10_apply_obm_settings
self.assertTrue(fit_common.apply_obm_settings(), "OBM settings failed.")
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'OBM settings failed.\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\nrestful: Status code = 400 \n\n**** OBM workflow failed to load!\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Apply OBM setting to compute nodes.\n--------------------- >> end captured logging << ---------------------'

Test Name: test12_check_pollers
Error Details: No pollers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for pollers.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 256, in test12_check_pollers
self.assertTrue(self.check_for_active_pollers(MAX_CYCLES), 'No pollers')
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'No pollers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7fd6bf401a10> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7fd6bf3d4690> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for pollers.\n--------------------- >> end captured logging << ---------------------'

Test Name: test02_preload_sku_packs
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/login
restful: Status code = 200

restful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions
restful: Status code = 200

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack
restful: Status code = 400

restful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Downloading SKU packs from GitHub
test.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack
test.run: INFO_5: **** Loading SKU Packs to server
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for quanta-d51-1u_quanta-d51-1u.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r740_dell-r740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-r730xd_dell-r730xd.tar.gz
test.run: INFO_5: **** Loading SKU Pack for dell-dss-9500M_dell-dss-9500M.tar.gz
test.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740T_brocade-VDX-6740T.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz
test.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz
test.run: INFO_5: **** Loading SKU Pack for arista-dcs-7124S_arista-dcs-7124S.tar.gz
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 85, in test02_preload_sku_packs
fit_common.rackhdapi("/api/2.0/skus/pack", action="binary-post", payload=file.read())
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 629, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 723, in restful
verify=sslverify
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 107, in post
return request('post', url, data=data, json=json, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/login\nrestful: Status code = 200 \n\nrestful: Action = post , URL = https://localhost:8443/redfish/v1/SessionService/Sessions\nrestful: Status code = 200 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\nrestful: Status code = 400 \n\nrestful: Action = binary-post , URL = http://localhost:9090/api/2.0/skus/pack\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test01_set_auth_user (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.02 - STARTING TEST: [test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test02_preload_sku_packs>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Downloading SKU packs from GitHub\ntest.run: INFO_5: **** Cloning SKU Packs from https://github.com/RackHD/on-skupack\ntest.run: INFO_5: **** Loading SKU Packs to server\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-2u_quanta-d51-2u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for quanta-d51-1u_quanta-d51-1u.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730_dell-r730.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r740_dell-r740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740_brocade-VDX-6740.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-r730xd_dell-r730xd.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for dell-dss-9500M_dell-dss-9500M.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for brocade-VDX-6740T_brocade-VDX-6740T.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C3132_cisco-nexus-C3132.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9372PX-E_cisco-nexus-C9372PX-E.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for cisco-nexus-C9332PQ_cisco-nexus-C9332PQ.tar.gz\ntest.run: INFO_5: **** Loading SKU Pack for arista-dcs-7124S_arista-dcs-7124S.tar.gz\n--------------------- >> end captured logging << ---------------------'

Test Name: test03_preload_default_sku
Error Details: Incorrect HTTP return code, expecting 201 or 409, got 400
-------------------- >> begin captured stdout << ---------------------
restful: Action = post , URL = http://localhost:9090/api/2.0/skus
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 113, in test03_preload_default_sku
'Incorrect HTTP return code, expecting 201 or 409, got ' + str(api_data['status']))
File "/usr/lib/python2.7/unittest/case.py", line 805, in assertIn
self.fail(self._formatMessage(msg, standardMsg))
File "/usr/lib/python2.7/unittest/case.py", line 412, in fail
raise self.failureException(msg)
'Incorrect HTTP return code, expecting 201 or 409, got 400\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = post , URL = http://localhost:9090/api/2.0/skus\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test02_preload_sku_packs (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.03 - STARTING TEST: [test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test03_preload_default_sku>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test03_preload_default_sku (test.deploy.rackhd_stack_init.rackhd_stack_init)\n--------------------- >> end captured logging << ---------------------'

Test Name: test09_check_discovery
Error Details: string indices must be integers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/nodes
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac2ae39631ea7005e1070/workflows
restful: Status code = 400

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for node Discovery to complete.

--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 192, in test09_check_discovery
self.assertTrue(self.check_for_active_workflows(MAX_CYCLES), "Node discovery not completed")
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 211, in check_for_active_workflows
if fit_common.check_active_workflows(node_id):
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 973, in check_active_workflows
if item['status'] in ['running', 'pending']:
'string indices must be integers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/nodes/595ac2ae39631ea7005e1070/workflows\nrestful: Status code = 400 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test08_check_compute_nodes (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.09 - STARTING TEST: [test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test09_check_discovery>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for node Discovery to complete.\n\n--------------------- >> end captured logging << ---------------------'

Test Name: test10_apply_obm_settings
Error Details: ('Connection aborted.', BadStatusLine("''",))
-------------------- >> begin captured stdout << ---------------------
restful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Apply OBM setting to compute nodes.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 221, in test10_apply_obm_settings
self.assertTrue(fit_common.apply_obm_settings(), "OBM settings failed.")
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 1011, in apply_obm_settings
api_data = rackhdapi("/api/2.0/workflows/graphs", action="put", payload=payload)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 629, in rackhdapi
rest_action=action, rest_payload=payload, rest_timeout=timeout, rest_headers=headers)
File "/home/jenkins/workspace/on-tasks/RackHD/test/common/fit_common.py", line 692, in restful
verify=sslverify,
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 120, in put
return request('put', url, data=data, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/api.py", line 53, in request
return session.request(method=method, url=url, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/home/jenkins/workspace/on-tasks/RackHD/test/.venv/on-build-config/local/lib/python2.7/site-packages/requests/adapters.py", line 426, in send
raise ConnectionError(err, request=request)
'('Connection aborted.', BadStatusLine("''",))\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = put , URL = http://localhost:9090/api/2.0/workflows/graphs\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test09_check_discovery (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.10 - STARTING TEST: [test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test10_apply_obm_settings>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test10_apply_obm_settings (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Apply OBM setting to compute nodes.\n--------------------- >> end captured logging << ---------------------'

Test Name: test12_check_pollers
Error Details: No pollers
-------------------- >> begin captured stdout << ---------------------
restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

restful: Action = get , URL = http://localhost:9090/api/2.0/pollers
restful: Status code = 200

--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
infra.run: DEBUG: relaying set_test((None,)) to all trackers {}
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)
root: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]
infra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)
test.run: INFO_5: **** Waiting for pollers.
--------------------- >> end captured logging << ---------------------
Stack Trace: File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "/home/jenkins/workspace/on-tasks/RackHD/test/deploy/rackhd_stack_init.py", line 256, in test12_check_pollers
self.assertTrue(self.check_for_active_pollers(MAX_CYCLES), 'No pollers')
File "/usr/lib/python2.7/unittest/case.py", line 424, in assertTrue
raise self.failureException(msg)
'No pollers\n-------------------- >> begin captured stdout << ---------------------\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\nrestful: Action = get , URL = http://localhost:9090/api/2.0/pollers\nrestful: Status code = 200 \n\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\ninfra.run: DEBUG: relaying set_test((None,)) to all trackers {}\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_after_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test11_add_management_server (test.deploy.rackhd_stack_init.rackhd_stack_init)\nroot: INFO: +1.12 - STARTING TEST: [test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)]\ninfra.run: DEBUG: relaying set_test((Test(<test.deploy.rackhd_stack_init.rackhd_stack_init testMethod=test12_check_pollers>),)) to all trackers {}\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.amqp_source.AMQPStreamMonitor object at 0x7f12686b7950> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: DEBUG: handle_start_test pluggin progression for <stream_sources.self_test_source.SelfTestStreamMonitor object at 0x7f12686ff5d0> test=test12_check_pollers (test.deploy.rackhd_stack_init.rackhd_stack_init)\ntest.run: INFO_5: **** Waiting for pollers.\n--------------------- >> end captured logging << ---------------------'

@keedya keedya merged commit 4f63216 into RackHD:master Jul 10, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.