Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] MacOS CI failing in RPC tests #13185

Closed
driazati opened this issue Oct 24, 2022 · 1 comment
Closed

[ci] MacOS CI failing in RPC tests #13185

driazati opened this issue Oct 24, 2022 · 1 comment
Labels
type:ci Relates to TVM CI infrastructure

Comments

@driazati
Copy link
Member

driazati commented Oct 24, 2022

``` ============================= test session starts ============================== platform darwin -- Python 3.7.13, pytest-7.1.2, pluggy-1.0.0 -- /usr/local/miniconda/envs/tvm-build/bin/python cachedir: .pytest_cache rootdir: /Users/runner/work/tvm/tvm collecting ... collected 12 items

tests/python/contrib/test_rpc_server_device.py::test_basic_functionality_of_rpc_session FAILED [ 8%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_standalone PASSED [ 16%]
tests/python/contrib/test_rpc_server_device.py::test_cleanup_workspace_after_session_end XFAIL [ 25%]
tests/python/contrib/test_rpc_server_device.py::test_graph_executor_remote_run FAILED [ 33%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_standalone PASSED [ 41%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_proxy PASSED [ 50%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_proxy PASSED [ 58%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_tracker PASSED [ 66%]
tests/python/contrib/test_rpc_server_device.py::test_check_auto_schedule_tuning XFAIL [ 75%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_tracker PASSED [ 83%]
tests/python/contrib/test_rpc_server_device.py::test_can_call_remote_function_with_rpc_tracker_via_proxy PASSED [ 91%]
tests/python/contrib/test_rpc_server_device.py::test_rpc_tracker_via_proxy PASSED [100%]

=================================== FAILURES ===================================
___________________ test_basic_functionality_of_rpc_session ____________________

def wrapper():
    with server_ios_launcher.ServerIOSContextManager(
        mode=server_ios_launcher.RPCServerMode.standalone.value,
        host=HOST_URL,
        port=HOST_PORT,
        key=DEVICE_KEY,
    ) as ios_server:
      f(host=ios_server.host, port=ios_server.port)

tests/python/contrib/test_rpc_server_device.py:81:


tests/python/contrib/test_rpc_server_device.py:320: in test_basic_functionality_of_rpc_session
lib = remote_session.load_module(DSO_NAME)
/usr/local/miniconda/envs/tvm-build/lib/python3.7/site-packages/tvm/rpc/client.py:159: in load_module
return _ffi_api.LoadRemoteModule(self._sess, path)
tvm/_ffi/_cython/./packed_func.pxi:331: in tvm._ffi._cy3.core.PackedFuncBase.call
???
tvm/_ffi/_cython/./packed_func.pxi:262: in tvm._ffi._cy3.core.FuncCall
???
tvm/_ffi/_cython/./packed_func.pxi:251: in tvm._ffi._cy3.core.FuncCall3
???


???
E tvm.error.RPCError: Traceback (most recent call last):
E [bt] (8) 9 libtvm.dylib 0x0000000122160577 tvm::runtime::RPCWrappedFunc::operator()(tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*) const + 1431
E [bt] (7) 8 libtvm.dylib 0x00000001221598ac tvm::runtime::RPCClientSession::CallFunc(void*, TVMValue const*, int const*, int, std::__1::function<void (tvm::runtime::TVMArgs)> const&) + 124
E [bt] (6) 7 libtvm.dylib 0x00000001221513d7 tvm::runtime::RPCEndpoint::CallFunc(void*, TVMValue const*, int const*, int, std::__1::function<void (tvm::runtime::TVMArgs)>) + 327
E [bt] (5) 6 libtvm.dylib 0x000000012214fcfe tvm::runtime::RPCEndpoint::HandleUntilReturnEvent(bool, std::__1::function<void (tvm::runtime::TVMArgs)>) + 814
E [bt] (4) 5 libtvm.dylib 0x000000012214ffae tvm::runtime::RPCEndpoint::EventHandler::HandleNextEvent(bool, bool, std::__1::function<void (tvm::runtime::TVMArgs)>) + 494
E [bt] (3) 4 libtvm.dylib 0x0000000122154162 tvm::runtime::RPCEndpoint::EventHandler::HandleProcessPacket(std::__1::function<void (tvm::runtime::TVMArgs)>) + 386
E [bt] (2) 3 libtvm.dylib 0x0000000122156235 tvm::runtime::RPCEndpoint::EventHandler::HandleReturn(tvm::runtime::RPCCode, std::__1::function<void (tvm::runtime::TVMArgs)>) + 213
E [bt] (1) 2 libtvm.dylib 0x000000012038fff9 tvm::runtime::detail::LogFatal::Entry::Finalize() + 89
E [bt] (0) 1 libtvm.dylib 0x00000001220cba18 tvm::runtime::Backtrace() + 24
E [bt] (8) 9 libtvm_runtime.dylib 0x000000010db74d0d tvm::runtime::LocalSession::CallFunc(void*, TVMValue const*, int const*, int, std::__1::function<void (tvm::runtime::TVMArgs)> const&) + 61
E [bt] (7) 8 tvmrpc 0x000000010d5449ca tvm::runtime::PackedFuncObj::Extractor<tvm::runtime::PackedFuncSubObjtvm::runtime::$_1 >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*) + 356
E [bt] (6) 7 libtvm_runtime.dylib 0x000000010dadc820 tvm::runtime::Module::LoadFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) + 1024
E [bt] (5) 6 tvmrpc 0x000000010d544de4 tvm::runtime::PackedFuncObj::Extractor<tvm::runtime::PackedFuncSubObjtvm::runtime::$_2 >::Call(tvm::runtime::PackedFuncObj const*, tvm::runtime::TVMArgs, tvm::runtime::TVMRetValue*) + 162
E [bt] (4) 5 tvmrpc 0x000000010d545028 tvm::runtime::UnsignedDSOLoader::Init(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) + 312
E [bt] (3) 4 tvmrpc 0x000000010d53cd99 tvm::runtime::detail::LogFatal::~LogFatal() + 9
E [bt] (2) 3 tvmrpc 0x000000010d542d87 tvm::runtime::detail::LogFatal::~LogFatal() + 63
E [bt] (1) 2 tvmrpc 0x000000010d541982 tvm::runtime::detail::LogFatalImpl(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, std::__1::basic_string<char, std::__1::char_traits, std::_1::allocator > const&) + 82
E [bt] (0) 1 libtvm_runtime.dylib 0x000000010dad45a8 tvm::runtime::Backtrace() + 24
E File "/usr/local/miniconda/envs/tvm-build/conda-bld/tvm-package_1666630917786/work/src/runtime/rpc/rpc_endpoint.cc", line 376
E RPCError: Error caught from RPC call:
E [18:25:04] /Users/runner/work/tvm/tvm/apps/ios_rpc/tvmrpc/TVMRuntime.mm:98:
E ---------------------------------------------------------------
E An error occurred during the execution of TVM.
E For more information, please see: https://tvm.apache.org/docs/errors.html
E ---------------------------------------------------------------
E Check failed: (lib_handle
!= nullptr) is false: Failed to load dynamic shared library /Users/runner/Library/Developer/CoreSimulator/Devices/7EDC75D2-89BC-4138-88C2-F5538F273DFF/data/Containers/Data/Application/EB676A89-0020-4F67-9A5C-1F4DAD337B23/tmp/lib.dylib Error happens during dlopen execution. Unimplemented

tvm/_ffi/_cython/./base.pxi:181: RPCError
________________________ test_graph_executor_remote_run ________________________

def wrapper():
    with server_ios_launcher.ServerIOSContextManager(
        mode=server_ios_launcher.RPCServerMode.standalone.value,
        host=HOST_URL,
        port=HOST_PORT,

=============================== warnings summary ===============================
tests/python/contrib/test_rpc_server_device.py:224
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:224: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:232
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:232: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:242
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:242: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:252
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:252: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency()

tests/python/contrib/test_rpc_server_device.py:262
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:262: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:271
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:271: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_proxy"])

tests/python/contrib/test_rpc_server_device.py:280
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:280: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_tracker"])

tests/python/contrib/test_rpc_server_device.py:289
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:289: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_tracker_via_proxy"])

tests/python/contrib/test_rpc_server_device.py:298
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:298: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:332
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:332: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:357
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:357: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_standalone"])

tests/python/contrib/test_rpc_server_device.py:393
/Users/runner/work/tvm/tvm/tests/python/contrib/test_rpc_server_device.py:393: PytestUnknownMarkWarning: Unknown pytest.mark.dependency - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
@pytest.mark.dependency(depends=["test_rpc_tracker"])

tests/python/contrib/test_rpc_server_device.py::test_basic_functionality_of_rpc_session
tests/python/contrib/test_rpc_server_device.py::test_cleanup_workspace_after_session_end
/usr/local/miniconda/envs/tvm-build/lib/python3.7/site-packages/tvm/driver/build_module.py:265: UserWarning: target_host parameter is going to be deprecated. Please pass in tvm.target.Target(target, host=target_host) instead.
"target_host parameter is going to be deprecated. "

tests/python/contrib/test_rpc_server_device.py::test_graph_executor_remote_run
/usr/local/miniconda/envs/tvm-build/lib/python3.7/site-packages/tvm/target/target.py:323: UserWarning: target_host parameter is going to be deprecated. Please pass in tvm.target.Target(target, host=target_host) instead.
"target_host parameter is going to be deprecated. "

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
FAILED tests/python/contrib/test_rpc_server_device.py::test_basic_functionality_of_rpc_session
FAILED tests/python/contrib/test_rpc_server_device.py::test_graph_executor_remote_run
======= 2 failed, 8 passed, 2 xfailed, 15 warnings in 398.49s (0:06:38) ========

</details>



cc @Mousius @areusch @gigiblender
@driazati driazati added needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it type:ci Relates to TVM CI infrastructure labels Oct 24, 2022
driazati added a commit to driazati/tvm that referenced this issue Oct 24, 2022
AndrewZhaoLuo pushed a commit that referenced this issue Oct 25, 2022
See #13185

Co-authored-by: driazati <driazati@users.noreply.github.com>
driazati pushed a commit that referenced this issue Oct 28, 2022
These tests were previously disabled (see #13185). The error was related to updating `MacOS` to version `12.6` and `XCode` update.
This PR fixes the error and re-enables tests for `iOS RPC`.
@driazati driazati removed the needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it label Oct 28, 2022
@driazati
Copy link
Member Author

should be fixed by #13229, closing

xinetzone pushed a commit to daobook/tvm that referenced this issue Nov 10, 2022
See apache#13185

Co-authored-by: driazati <driazati@users.noreply.github.com>
xinetzone pushed a commit to daobook/tvm that referenced this issue Nov 10, 2022
These tests were previously disabled (see apache#13185). The error was related to updating `MacOS` to version `12.6` and `XCode` update.
This PR fixes the error and re-enables tests for `iOS RPC`.
xinetzone pushed a commit to daobook/tvm that referenced this issue Nov 25, 2022
See apache#13185

Co-authored-by: driazati <driazati@users.noreply.github.com>
xinetzone pushed a commit to daobook/tvm that referenced this issue Nov 25, 2022
These tests were previously disabled (see apache#13185). The error was related to updating `MacOS` to version `12.6` and `XCode` update.
This PR fixes the error and re-enables tests for `iOS RPC`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:ci Relates to TVM CI infrastructure
Projects
None yet
Development

No branches or pull requests

1 participant