Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

improve: enable collect logs before login #16392

Merged
merged 1 commit into from
Jun 26, 2023
Merged

improve: enable collect logs before login #16392

merged 1 commit into from
Jun 26, 2023

Conversation

qfrank
Copy link
Contributor

@qfrank qfrank commented Jun 26, 2023

after this PR, we should be able to shake phone > Share logs before logging in.

relate comment

cc @churik

Platforms

  • iOS

status: ready

@qfrank qfrank self-assigned this Jun 26, 2023
@status-im-auto
Copy link
Member

status-im-auto commented Jun 26, 2023 •
edited
Loading

Jenkins Builds

Click to see older builds (4)
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 723fad4 #2 2023-06-26 11:22:14 ~5 min ios 📱ipa 📲
✔️ 723fad4 #2 2023-06-26 11:22:40 ~6 min android 🤖apk 📲
✔️ 723fad4 #2 2023-06-26 11:23:36 ~7 min android-e2e 🤖apk 📲
✔️ 723fad4 #2 2023-06-26 11:24:07 ~7 min tests 📄log
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 3b0a31d #3 2023-06-26 15:10:52 ~6 min android 🤖apk 📲
✔️ 3b0a31d #3 2023-06-26 15:12:13 ~7 min android-e2e 🤖apk 📲
✔️ 3b0a31d #3 2023-06-26 15:12:55 ~8 min ios 📱ipa 📲
✔️ 3b0a31d #3 2023-06-26 15:13:14 ~8 min tests 📄log
✔️ 4464975 #4 2023-06-26 23:33:46 ~5 min android-e2e 🤖apk 📲
✔️ 4464975 #4 2023-06-26 23:34:21 ~6 min android 🤖apk 📲
✔️ 4464975 #4 2023-06-26 23:35:48 ~7 min ios 📱ipa 📲
✔️ 4464975 #4 2023-06-26 23:36:06 ~7 min tests 📄log

@churik churik self-assigned this Jun 26, 2023
@status-im-auto
Copy link
Member

70% of end-end tests have passed

Total executed tests: 33
Failed tests: 10
Passed tests: 23

IDs of failed tests: 702782,702732,703133,702957,702894,702783,702936,702947,702731,702958

Failed tests (10)

Click to expand
  • Rerun failed tests

    • Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782

    Device 1: Find `SendMessageButton` by `accessibility id`: `send-message-button`
    Device 1: Tap on found: SendMessageButton 

    critical/chats/test_1_1_public_chats.py:938: in test_1_1_chat_emoji_send_reply_and_open_link
    self.errors.verify_no_errors()
base_test_case.py:182: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Message with URL was not received



    Device sessions

    2. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783

    # STEP: Device1 goes back online and checks that 1-1 chat will be fetched
    Device 1: Looking for a message by text: test message 

    critical/chats/test_1_1_public_chats.py:1253: in test_1_1_chat_is_shown_message_sent_delivered_from_offline
    self.errors.verify_no_errors()
base_test_case.py:182: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Message status was not delivered after back up online, it is "Sending"!

    [[Issue with messages not being sent for a long time]]

    Device sessions

    3. test_1_1_chat_pin_messages, id: 702731 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestActivityMultipleDevicePR:

    1. test_activity_center_mentions, id: 702957 

    Test setup failed: medium/test_activity_center.py:154: in prepare_devices
    self.channel_1.send_message(self.text_message)
../views/chat_view.py:960: in send_message
    self.send_message_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:80: in click
    self._execute(Command.CLICK_ELEMENT)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:633: in _execute
    return self._parent.execute(command, params)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py:321: in execute
    self.error_handler.check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:31: in check_response
    raise wde
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:26: in check_response
    super().check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/errorhandler.py:242: in check_response
    raise exception_class(message, screen, stacktrace)
 The element 'By.accessibilityId: send-message-button' does not exist in DOM anymore



    2. test_navigation_jump_to, id: 702936

    Device 1: Type hello to ChatMessageInput
    Device 1: Find SendMessageButton by accessibility id: send-message-button 

    Test setup failed: medium/test_activity_center.py:154: in prepare_devices
    self.channel_1.send_message(self.text_message)
../views/chat_view.py:960: in send_message
    self.send_message_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:80: in click
    self._execute(Command.CLICK_ELEMENT)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:633: in _execute
    return self._parent.execute(command, params)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py:321: in execute
    self.error_handler.check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:31: in check_response
    raise wde
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:26: in check_response
    super().check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/errorhandler.py:242: in check_response
    raise exception_class(message, screen, stacktrace)
 The element 'By.accessibilityId: send-message-button' does not exist in DOM anymore



    Device sessions

    3. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947 

    Test setup failed: medium/test_activity_center.py:154: in prepare_devices
    self.channel_1.send_message(self.text_message)
../views/chat_view.py:960: in send_message
    self.send_message_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:80: in click
    self._execute(Command.CLICK_ELEMENT)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:633: in _execute
    return self._parent.execute(command, params)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py:321: in execute
    self.error_handler.check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:31: in check_response
    raise wde
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:26: in check_response
    super().check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/errorhandler.py:242: in check_response
    raise exception_class(message, screen, stacktrace)
 The element 'By.accessibilityId: send-message-button' does not exist in DOM anymore



    4. test_activity_center_admin_notification_accept_swipe, id: 702958 

    Test setup failed: medium/test_activity_center.py:154: in prepare_devices
    self.channel_1.send_message(self.text_message)
../views/chat_view.py:960: in send_message
    self.send_message_button.click()
../views/base_element.py:91: in click
    self.find_element().click()
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:80: in click
    self._execute(Command.CLICK_ELEMENT)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py:633: in _execute
    return self._parent.execute(command, params)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py:321: in execute
    self.error_handler.check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:31: in check_response
    raise wde
/home/jenkins/.local/lib/python3.10/site-packages/appium/webdriver/errorhandler.py:26: in check_response
    super().check_response(response)
/home/jenkins/.local/lib/python3.10/site-packages/selenium/webdriver/remote/errorhandler.py:242: in check_response
    raise exception_class(message, screen, stacktrace)
 The element 'By.accessibilityId: send-message-button' does not exist in DOM anymore



    Class TestCommunityOneDeviceMerged:

    1. test_restore_multiaccount_with_waku_backup_remove_switch, id: 703133

    Device 1: Find Button by accessibility id: show-profiles
    Device 1: Tap on found: Button 

    critical/test_public_chat_browsing.py:406: in test_restore_multiaccount_with_waku_backup_remove_switch
    self.errors.verify_no_errors()
base_test_case.py:182: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Contact my-custom-nickname was not restored from backup!



    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_pin_messages, id: 702732 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_contact_block_unblock_offline, id: 702894

    Device 1: Find ChatElementByText by xpath: //*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']
    Device 1: Find MemberPhoto by xpath: //*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']//*[@content-desc='user-avatar'] 

    critical/test_public_chat_browsing.py:759: in test_community_contact_block_unblock_offline
    chat_element.member_photo.click()
../views/base_element.py:91: in click
    self.find_element().click()
../views/base_element.py:80: in find_element
    raise NoSuchElementException(
 Device 1: MemberPhoto by xpath: `//*[starts-with(@text,'Hurray! unblocked')]/ancestor::android.view.ViewGroup[@content-desc='chat-item']//*[@content-desc='user-avatar']` is not found on the screen



    Device sessions

    Passed tests (23)

    Click to expand

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_text_message_delete_push_disappear, id: 702733
    Device sessions

    2. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    3. test_1_1_chat_push_emoji, id: 702813
    Device sessions

    4. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    5. test_1_1_chat_edit_message, id: 702855
    Device sessions

    6. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_activity_center_contact_request_accept_swipe_mark_all_as_read, id: 702851
    Device sessions

    2. test_activity_center_contact_request_decline, id: 702850
    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_copy_and_paste_message_in_chat_input, id: 702742
    Device sessions

    2. test_community_navigate_to_channel_when_relaunch, id: 702846
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_join_send_text_messages_push, id: 702807
    Device sessions

    2. test_group_chat_offline_pn, id: 702808
    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_several_images_send_reply, id: 703194
    Device sessions

    2. test_community_one_image_send_reply, id: 702859
    Device sessions

    3. test_community_emoji_send_copy_paste_reply, id: 702840
    Device sessions

    4. test_community_mark_all_messages_as_read, id: 703086
    Device sessions

    5. test_community_mentions_push_notification, id: 702786
    Device sessions

    6. test_community_message_delete, id: 702839
    Device sessions

    7. test_community_message_send_check_timestamps_sender_username, id: 702838
    Device sessions

    8. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    Device sessions

    9. test_community_message_edit, id: 702843
    Device sessions

    10. test_community_leave, id: 702845
    Device sessions

    11. test_community_unread_messages_badge, id: 702841
    Device sessions

    @churik
    Copy link
    Member

    churik commented Jun 26, 2023 •
    edited
    Loading

    Thanks for your amazing work!
    e2e failures are known not related to PR.
    Tested basic flows, LGTM!

    Devices:

    • IPhone 12 Mini (IOS 16)
    • BlackView BV5200 Pro (Android 12)

    @qfrank qfrank merged commit ab16ca3 into develop Jun 26, 2023
    @qfrank qfrank deleted the improve/collect-logs branch June 26, 2023 23:42
    codemaster115 pushed a commit that referenced this pull request Jul 7, 2023
    @qfrank @codemaster115
    improve: enable collect logs before login (#16392)
    d3622b0
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Reviewers

    @siddarthkay siddarthkay siddarthkay approved these changes

    @cammellos cammellos Awaiting requested review from cammellos

    @rasom rasom Awaiting requested review from rasom

    @flexsurfer flexsurfer Awaiting requested review from flexsurfer

    @yqrashawn yqrashawn Awaiting requested review from yqrashawn

    Assignees

    @churik churik

    @qfrank qfrank

    Labels
    request-manual-qa Tested - OK
    Projects
    No open projects
    Legacy QA Automation Project
    Archived in project
    Milestone
    No milestone
    Development

    Successfully merging this pull request may close these issues.
    4 participants
    @qfrank @status-im-auto @churik @siddarthkay