App Center Test Task failed with 'Cannot find test-cloud.exe'

[omanuke]

Environment

- If using VSTS, provide the account name, team project name, build definition name/build number: 

　　account name: miyasaka_masahiko@tworks.co.jp
　　team project name: TestAppCenter
　　build definition name/build number: TestAppCenter-Xamarin.Android-CI (1) / Build 20180404.1

• Agent - Hosted or Private:

  • If using Hosted agent, provide agent queue name:
    Hosted VS2017

Issue Description

'Test with Visual Studio App Center' failed on Prepare Tests.
The log said test-cloud.exe couldn't be found.
My settings for App Center Test is like below.
I tried to add Addition option "--uitest-tools-dir" which the log says about with the value
'$(APPCENTER_SOURCE_DIRECTORY)/packages/Xamarin.UITest./tools' or
'$APPCENTER_SOURCE_DIRECTORY/packages/Xamarin.UITest./tools'.
But it doesn't work.
'$APPCENTER_SOURCE_DIRECTORY/packages/Xamarin.UITest.*/tools' is written here

Error logs

******************************************************************************

Starting: Test with Visual Studio App Center

******************************************************************************
==============================================================================
Task : App Center Test
Description : Test app packages with Visual Studio App Center.
Version : 1.131.0
Author : Microsoft Corporation
Help : For help with this task, visit the Visual Studio App Center support site.
==============================================================================

C:\Windows\system32\cmd.exe /D /S /C "D:\a_tasks\AppCenterTest_ad5cd22a-be4e-48bb-adce-181a32432da5\1.131.0\node_modules.bin\appcenter.cmd test prepare uitest --artifacts-dir D:\a\1\a\AppCenterTest --app-path D:/a/1/b/Release/com.companyname.TestAppCenter.apk --build-dir D:\a\1\b/Release/test-assembly/test.dll --quiet"
Preparing tests... failed.
Error: Cannot find test-cloud.exe, which is required to prepare UI tests.
We have searched for directory "packages\Xamarin.UITest.*\tools" inside "D:\a\1\b/Release/test-assembly/test.dll" and all of its parent directories.
Please use option "--uitest-tools-dir" to manually specify location of this tool.
Minimum required version is "2.2.0".

Error: D:\a_tasks\AppCenterTest_ad5cd22a-be4e-48bb-adce-181a32432da5\1.131.0\node_modules.bin\appcenter.cmd failed with return code: 3

[omanuke]

I set "$(build.sourcesdirectory)/packages/Xamarin.UITest.2.2.3/tools" on 'Test tools directory'.
Now, test-cloud.exe could be found successfully.
But specifying Xamarin.UITest.X.X.X is fragile. Is there a good configuration way?

[owenniblock]

Thanks @omanuke - I think you're the second person to request this feature (to my knowledge). I'll pass it on to my PM and get it recorded as a feature request.

[hubertusgr]

I also believe this is very fragile
+1

[kumarpun]

I spent 2 days figuring out testcloud.dll but got no success please make a easy way to do UI test from app center for xamarin.forms it's really very important to me.

[gsstudio]

This is annoying, I can not find information.
appcenter throw me this error ... Cannot find test-cloud.exe, which is required to prepare UI tests.

[Abdul-waseem123]

@omanuke you can use "$(build.sourcesdirectory)/packages/Xamarin.UITest.*/tools" to take any version

[vtkumaresan]

do we have solution?
what is the correct build directory path?

iOS:
Error: /usr/local/bin/appcenter failed with return code: 3

Android:
Error: D:\a_tasks\AppCenterTest_ad5cd22a-be4e-48bb-adce-181a32432da5\1.137.0\node_modules.bin\appcenter.cmd failed with return code: 3

[kumarpun]

Kumaresan P you can use "$(build.sourcesdirectory)/ packages/Xamarin.UITest.*/tools" to take any version

…

On Mon, Aug 6, 2018 at 6:08 PM, Kumaresan P ***@***.***> wrote: do we have solution? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#6868 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AjYshox6FZy4Yji5kT_hXGRaDkP5VUl7ks5uODVWgaJpZM4TGJoY> .

[vtkumaresan]

packages folder not found in finder but showing in project. so how do we set above path.

[owenniblock]

You need to set this ($(build.sourcesdirectory)/
packages/Xamarin.UITest.*/tools) in your Test tools directory on the App Center Test task.

[kumarpun]

You need to set this ($(build.sourcesdirectory)/ packages/Xamarin.UITest.*/tools) in your Test tools directory on the App Center Test task.

…

On Tue, Aug 7, 2018 at 12:41 PM, Kumaresan P ***@***.***> wrote: packages folder not found in finder but showing in project. so how do we set above path. [image: screen shot 2018-08-07 at 12 24 42 pm] <https://user-images.githubusercontent.com/3971168/43759487-06dbbd26-9a3d-11e8-8c2c-0befe24d60ad.png> — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#6868 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AjYshh_3GVoprUTkKhwdwLXfWbw-sKhhks5uOToGgaJpZM4TGJoY> .

[vtkumaresan]

Getting same error,

`2018-08-07T10:54:11.5087690Z Error: Cannot find test-cloud.exe, the path specified by "--uitest-tools-dir" was not found.

2018-08-07T10:54:11.5107630Z Please check that "/Users/vsts/agent/2.136.1/work/1/s/packages/Xamarin.UITest.*/tools" is a valid directory and contains test-cloud.exe.

2018-08-07T10:54:11.5124110Z Minimum required version is "2.2.0".

2018-08-07T10:54:11.5277090Z ##[error]Error: /usr/local/bin/appcenter failed with return code: 3
`

[vtkumaresan]

Today tried different types of url but still getting same error,
$(build.sourcesdirectory)/packages/Xamarin.UITest.2.2.4/tools
$(build.sourcesdirectory)/packages/xamarin.uitest/2.2.2/tools
$(build.sourcesdirectory)/packages/Xamarin.UITest.*/tools
$(build.sourcesdirectory)/packages/Xamarin.UITest.2.2.2/tools
$(build.sourcesdirectory)/packages/Xamarin.UITest.2.2.3/tools