Windows: Test Suite failing on AWS. Single Test takes hours to complete #94
Comments
|
Looks like your sylph.yaml is using an absolute path to test_driver/onboarding/OpenAccountWithoutBvn.dart instead of the relative path which it expects. Sylph usually completes in less than 15 minutes or times out. This is how it is expected to run on windows: |
|
Still more less the same response after I changed it to relative path. Also the test suite still fails [+3139528 ms] results=[{result: false}] [DEVICEFARM] Setting up your device. This usually takes 2-3 minutes. [DEVICEFARM] ########### Entering phase install ########### [DeviceFarm] cd flutter_app This is free software; you are free to change and redistribute it. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 ╔════════════════════════════════════════════════════════════════════════════╗ [✓] Flutter (Channel stable, v1.12.13+hotfix.8, on Linux, locale en_US.UTF-8) [!] Android toolchain - develop for Android devices (Android SDK version 21.1.1) [!] Android Studio (not installed) [✓] Connected device (1 available) ! Doctor found issues in 2 categories. [DEVICEFARM] ########### Entering phase pre_test ########### [DEVICEFARM] ########### Entering phase test ########### [DeviceFarm] TEST_PHASE_STATUS=0 [DEVICEFARM] ########### Entering phase post_test ########### [DEVICEFARM] ########### Finish executing testspec ########### [DEVICEFARM] ########### Setting upload permissions ########### chmod: cannot access ‘/tmp/customer_log_directoryVIbKws/*’: No such file or directory [DEVICEFARM] Tearing down your device. Your tests report will come shortly. |
|
As a sanity test, try running the example/default_app. Also, try running |
|
Test suite still failed and slyph run took about 20 min to complete. Also target not found response received when I ran the flutter driver cmd you sent. Meanwhile the file is on my tmp directory. Below are screenshots of the file and out as well as the log from AWS. Please not I am not running sylph from CI.
[DEVICEFARM] Setting up your device. This usually takes 2-3 minutes. [DEVICEFARM] ########### Entering phase install ########### [DeviceFarm] cd flutter_app This is free software; you are free to change and redistribute it. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 ╔════════════════════════════════════════════════════════════════════════════╗ [✓] Flutter (Channel stable, v1.12.13+hotfix.8, on Linux, locale en_US.UTF-8) [!] Android toolchain - develop for Android devices (Android SDK version 21.1.1) [!] Android Studio (not installed) [✓] Connected device (1 available) ! Doctor found issues in 2 categories. [DEVICEFARM] ########### Entering phase pre_test ########### [DEVICEFARM] ########### Entering phase test ########### [DeviceFarm] TEST_PHASE_STATUS=0 [DEVICEFARM] ########### Entering phase post_test ########### [DEVICEFARM] ########### Finish executing testspec ########### [DEVICEFARM] ########### Setting upload permissions ########### chmod: cannot access ‘/tmp/customer_log_directory75qM3z/*’: No such file or directory [DEVICEFARM] Tearing down your device. Your tests report will come shortly. |
|
For some reason example/default_app does not run on Device Farm from your specific windows desktop. If you can reproduce the problem on appveyor, it's may be easier to resolve. PS: Device Farm Log for Sylph run 'sylph run 2020-02-29 20:46:58.786'[DEVICEFARM] Setting up your device. This usually takes 2-3 minutes. [DEVICEFARM] ########### Start executing testspec ###########[DEVICEFARM] ########### Entering phase install ########### [DeviceFarm] cd flutter_app This is free software; you are free to change and redistribute it. 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 ╔════════════════════════════════════════════════════════════════════════════╗ [✓] Flutter (Channel stable, v1.12.13+hotfix.8, on Linux, locale en_US.UTF-8) [!] Android toolchain - develop for Android devices (Android SDK version 21.1.1) [!] Android Studio (not installed) [✓] Connected device (1 available) ! Doctor found issues in 2 categories. [DEVICEFARM] ########### Entering phase pre_test ########### [DEVICEFARM] ########### Entering phase test ########### [DeviceFarm] TEST_PHASE_STATUS=0 [info ] FlutterDriver: Connecting to Flutter application at http://127.0.0.1:4723/_fXo5k5Ym-8=/ 00:04 �[32m+1�[0m: end-to-end test (tearDownAll)�[0m 00:04 �[32m+1�[0m: All tests passed!�[0m Starting Flutter app com.example.default_app in debug mode... [info ] FlutterDriver: Connecting to Flutter application at http://127.0.0.1:4723/ZjpTaFMKq_g=/ 00:03 �[32m+1�[0m: end-to-end test (tearDownAll)�[0m 00:03 �[32m+1�[0m: All tests passed!�[0m [DeviceFarm] for f in flutter_*.log; do [DEVICEFARM] ########### Entering phase post_test ########### [DEVICEFARM] ########### Finish executing testspec ########### [DEVICEFARM] ########### Setting upload permissions ########### chmod: cannot access ‘/tmp/customer_log_directorylm3utz/*’: No such file or directory [DEVICEFARM] Tearing down your device. Your tests report will come shortly. |
mmcc007
changed the title
My test were all failing on AWS Device farm and it takes hours before the whole process completes. On my local its dont in minutes. Please find below the logs and AWS logs
[+4201761 ms] results=[{result: false}]
[ +4 ms] Concurrent runs completed.
[ +13 ms] Sylph run completed in 1h:11m:19s:566ms.
[ +2 ms] Sylph run 'sylph run 2020-03-09 13:39:49.676' failed.
[DEVICEFARM] Setting up your device. This usually takes 2-3 minutes.
[DEVICEFARM] ########### Start executing testspec ###########
[DEVICEFARM] ########### Entering phase install ###########
[DeviceFarm] cd flutter_app
[DeviceFarm] ls -la
total 128
drwxrwxrwx 16 rwx rwx 4096 Mar 9 13:40 .
drwxrwxrwx 9 rwx rwx 4096 Mar 9 13:40 ..
drwxrwxrwx 5 rwx rwx 4096 Mar 9 13:40 android
drwxrwxrwx 3 rwx rwx 4096 Mar 9 13:40 assets
-rwxrwxrwx 1 rwx rwx 51 Mar 9 13:40 build_to_os.txt
drwxrwxrwx 5 rwx rwx 4096 Mar 9 13:40 country_code_picker
drwxrwxrwx 3 rwx rwx 4096 Mar 9 13:40 .dart_tool
-rwxrwxrwx 1 rwx rwx 502 Mar 9 13:40 .flutter-plugins
-rwxrwxrwx 1 rwx rwx 305 Mar 9 13:40 .flutter-plugins-dependencies
drwxrwxrwx 7 rwx rwx 4096 Mar 9 13:40 .git
-rwxrwxrwx 1 rwx rwx 1613 Mar 9 13:40 .gitignore
drwxrwxrwx 4 rwx rwx 4096 Mar 9 13:40 .idea
drwxrwxrwx 3 rwx rwx 4096 Mar 9 13:40 images
drwxrwxrwx 6 rwx rwx 4096 Mar 9 13:40 ios
drwxrwxrwx 9 rwx rwx 4096 Mar 9 13:40 lib
-rwxrwxrwx 1 rwx rwx 315 Mar 9 13:40 .metadata
-rwxrwxrwx 1 rwx rwx 9542 Mar 9 13:40 .packages
-rwxrwxrwx 1 rwx rwx 16717 Mar 9 13:40 pubspec.lock
-rwxrwxrwx 1 rwx rwx 1414 Mar 9 13:40 pubspec.yaml
-rwxrwxrwx 1 rwx rwx 571 Mar 9 13:40 README.md
drwxrwxrwx 2 rwx rwx 4096 Mar 9 13:40 screenshots
drwxrwxrwx 2 rwx rwx 4096 Mar 9 13:40 script
-rwxrwxrwx 1 rwx rwx 1182 Mar 9 13:40 sylph.yaml
drwxrwxrwx 3 rwx rwx 4096 Mar 9 13:40 test
drwxrwxrwx 3 rwx rwx 4096 Mar 9 13:40 test_driver
drwxrwxrwx 3 rwx rwx 4096 Mar 9 13:40 thirdparty
[DeviceFarm] bash --version
GNU bash, version 4.3.11(1)-release (x86_64-pc-linux-gnu)
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html
This is free software; you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
[DeviceFarm] echo "DEVICEFARM_APP_PATH=$DEVICEFARM_APP_PATH"
DEVICEFARM_APP_PATH=/tmp/scratchAZfnSI.scratch/share-R0D9nC.scratch/app-Qwt8gN.apk
[DeviceFarm] echo "Install flutter"
Install flutter
[DeviceFarm] FLUTTER_VERSION=v1.12.13+hotfix.8-stable
[DeviceFarm] if [ $DEVICEFARM_DEVICE_PLATFORM_NAME = "Android" ]; then
# Install Flutter
curl https://storage.googleapis.com/flutter_infra/releases/stable/linux/flutter_linux_$FLUTTER_VERSION.tar.xz -o flutter_linux.tar.xz
tar xf flutter_linux.tar.xz
fi
if [ $DEVICEFARM_DEVICE_PLATFORM_NAME = "iOS" ]; then
# Install Flutter
curl https://storage.googleapis.com/flutter_infra/releases/stable/macos/flutter_macos_$FLUTTER_VERSION.zip -o flutter_macos.zip
unzip -qq flutter_macos.zip
fi
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 485M 0 412 0 0 663 0 8d 21h --:--:-- 8d 21h 663
1 485M 1 5216k 0 0 3334k 0 0:02:29 0:00:01 0:02:28 3332k
9 485M 9 44.7M 0 0 17.4M 0 0:00:27 0:00:02 0:00:25 17.4M
15 485M 15 74.3M 0 0 20.8M 0 0:00:23 0:00:03 0:00:20 20.8M
21 485M 21 105M 0 0 23.0M 0 0:00:21 0:00:04 0:00:17 23.0M
28 485M 28 136M 0 0 22.8M 0 0:00:21 0:00:05 0:00:16 25.4M
29 485M 29 144M 0 0 20.3M 0 0:00:23 0:00:07 0:00:16 25.1M
31 485M 31 153M 0 0 20.2M 0 0:00:23 0:00:07 0:00:16 21.7M
34 485M 34 168M 0 0 19.2M 0 0:00:25 0:00:08 0:00:17 18.2M
37 485M 37 184M 0 0 19.0M 0 0:00:25 0:00:09 0:00:16 15.4M
39 485M 39 194M 0 0 18.3M 0 0:00:26 0:00:10 0:00:16 12.5M
46 485M 46 224M 0 0 18.4M 0 0:00:26 0:00:12 0:00:14 15.7M
47 485M 47 230M 0 0 18.3M 0 0:00:26 0:00:12 0:00:14 15.3M
53 485M 53 258M 0 0 19.0M 0 0:00:25 0:00:13 0:00:12 18.7M
57 485M 57 280M 0 0 18.3M 0 0:00:26 0:00:15 0:00:11 17.0M
60 485M 60 293M 0 0 18.8M 0 0:00:25 0:00:15 0:00:10 19.9M
62 485M 62 302M 0 0 18.2M 0 0:00:26 0:00:16 0:00:10 17.8M
69 485M 69 336M 0 0 19.1M 0 0:00:25 0:00:17 0:00:08 21.0M
72 485M 72 352M 0 0 18.8M 0 0:00:25 0:00:18 0:00:07 18.2M
78 485M 78 382M 0 0 19.5M 0 0:00:24 0:00:19 0:00:05 23.7M
82 485M 82 400M 0 0 19.4M 0 0:00:24 0:00:20 0:00:04 21.3M
87 485M 87 424M 0 0 19.6M 0 0:00:24 0:00:21 0:00:03 24.3M
94 485M 94 459M 0 0 20.3M 0 0:00:23 0:00:22 0:00:01 24.8M
100 485M 100 485M 0 0 20.7M 0 0:00:23 0:00:23 --:--:-- 28.4M
[DeviceFarm] mv flutter $HOME/flutter
[DeviceFarm] export PATH=$PATH:$HOME/flutter/bin:$HOME/flutter/bin/cache/dart-sdk/bin
[DeviceFarm] export PATH="$PATH":"$HOME/.pub-cache/bin"
[DeviceFarm] flutter doctor -v
Warning! This package referenced a Flutter repository via the .packages file that is no longer available. The repository from which the 'flutter' tool is currently executing will be used instead.
running Flutter tool: /home/device-farm/flutter
previous reference : /C:/src/flutter
This can happen if you deleted or moved your copy of the Flutter repository, or if it was on a volume that is no longer mounted or has been mounted at a different location. Please check your system path to verify that you are running the expected version (run 'flutter --version' to see which flutter is on your path).
╔════════════════════════════════════════════════════════════════════════════╗
║ Welcome to Flutter! - https://flutter.dev ║
║ ║
║ The Flutter tool uses Google Analytics to anonymously report feature usage ║
║ statistics and basic crash reports. This data is used to help improve ║
║ Flutter tools over time. ║
║ ║
║ Flutter tool analytics are not sent on the very first run. To disable ║
║ reporting, type 'flutter config --no-analytics'. To display the current ║
║ setting, type 'flutter config'. If you opt out of analytics, an opt-out ║
║ event will be sent, and then no further information will be sent by the ║
║ Flutter tool. ║
║ ║
║ By downloading the Flutter SDK, you agree to the Google Terms of Service. ║
║ Note: The Google Privacy Policy describes how data is handled in this ║
║ service. ║
║ ║
║ Moreover, Flutter includes the Dart SDK, which may send usage metrics and ║
║ crash reports to Google. ║
║ ║
║ Read about data we send with crash reports: ║
║ https://github.com/flutter/flutter/wiki/Flutter-CLI-crash-reporting ║
║ ║
║ See Google's privacy policy: ║
║ https://www.google.com/intl/en/policies/privacy/ ║
╚════════════════════════════════════════════════════════════════════════════╝
[✓] Flutter (Channel stable, v1.12.13+hotfix.8, on Linux, locale en_US.UTF-8)
• Flutter version 1.12.13+hotfix.8 at /home/device-farm/flutter
• Framework revision 0b8abb4724 (4 weeks ago), 2020-02-11 11:44:36 -0800
• Engine revision e1e6ced81d
• Dart version 2.7.0
[!] Android toolchain - develop for Android devices (Android SDK version 21.1.1)
• Android SDK at /opt/dev/android-sdk-linux
• Android NDK location not configured (optional; useful for native profiling support)
✗ Flutter requires Android SDK 28 and the Android BuildTools 28.0.3
To update using sdkmanager, run:
"/opt/dev/android-sdk-linux/tools/bin/sdkmanager" "platforms;android-28" "build-tools;28.0.3"
or visit https://flutter.dev/setup/#android-setup for detailed instructions.
✗ Android license status unknown.
Try re-installing or updating your Android SDK Manager.
See https://developer.android.com/studio/#downloads or visit https://flutter.dev/setup/#android-setup for detailed instructions.
[!] Android Studio (not installed)
• Android Studio not found; download from https://developer.android.com/studio/index.html
(or visit https://flutter.dev/setup/#android-setup for detailed instructions).
[✓] Connected device (1 available)
• SM G975U1 • R38M60AN7YR • android-arm64 • Android 9 (API 28)
! Doctor found issues in 2 categories.
[DEVICEFARM] ########### Entering phase pre_test ###########
[DEVICEFARM] ########### Entering phase test ###########
[DeviceFarm] TEST_PHASE_STATUS=0
[DeviceFarm] track_test_phase_status() {
local command_exit_code=$?
if [ "$command_exit_code" != "0" ]; then
echo "Most recent command failed with error code: $command_exit_code"
TEST_PHASE_STATUS=$command_exit_code
fi
}
set_test_phase_exit_code() {
return $TEST_PHASE_STATUS
}
[DeviceFarm] echo "Navigate to test package directory"
Navigate to test package directory
[DeviceFarm] cd $DEVICEFARM_TEST_PACKAGE_PATH
[DeviceFarm] echo "Start Flutter integration test"
Start Flutter integration test
[DeviceFarm] cd flutter_app
[DeviceFarm] rm -f .packages
[DeviceFarm] MAIN=C:/Users/penedeh/Desktop/Digital Bank Mobile/test_driver/onboarding/OpenAccountWithoutBvn.dart
/tmp/scratchAZfnSI.scratch/shell-script-DrClsH/shell_script.sh: 132: /tmp/scratchAZfnSI.scratch/shell-script-DrClsH/shell_script.sh: Bank: not found
[DEVICEFARM] ########### Entering phase post_test ###########
[DEVICEFARM] ########### Finish executing testspec ###########
[DEVICEFARM] ########### Setting upload permissions ###########
chmod: cannot access ‘/tmp/customer_log_directory0vut2Y/*’: No such file or directory
[DEVICEFARM] Tearing down your device. Your tests report will come shortly.
The text was updated successfully, but these errors were encountered: