Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: wallet tests added #19477

Merged
merged 1 commit into from
Apr 4, 2024
Merged

e2e: wallet tests added #19477

merged 1 commit into from
Apr 4, 2024

Conversation

yevh-berdnyk
Copy link
Contributor

No description provided.

@yevh-berdnyk yevh-berdnyk requested a review from churik as a code owner April 2, 2024 15:00
@yevh-berdnyk yevh-berdnyk self-assigned this Apr 2, 2024
@status-im-auto
Copy link
Member

status-im-auto commented Apr 2, 2024

Jenkins Builds

Click to see older builds (18)
Commit #️⃣ Finished (UTC) Duration Platform Result
396bf71 #1 2024-04-02 15:08:50 ~7 min ios 📄log
✔️ d303ece #2 2024-04-02 17:34:11 ~6 min android-e2e 🤖apk 📲
✔️ d303ece #2 2024-04-02 17:34:21 ~7 min android 🤖apk 📲
✔️ d303ece #2 2024-04-02 17:36:36 ~9 min ios 📱ipa 📲
✔️ c6c8622 #3 2024-04-02 18:46:18 ~3 min tests 📄log
✔️ c6c8622 #3 2024-04-02 18:50:13 ~7 min android-e2e 🤖apk 📲
✔️ c6c8622 #3 2024-04-02 18:50:15 ~7 min android 🤖apk 📲
✔️ 23f1b1a #4 2024-04-03 21:19:32 ~4 min tests 📄log
✔️ 23f1b1a #4 2024-04-03 21:21:42 ~6 min android 🤖apk 📲
✔️ 23f1b1a #4 2024-04-03 21:22:35 ~7 min android-e2e 🤖apk 📲
✔️ 23f1b1a #4 2024-04-03 21:24:43 ~9 min ios 📱ipa 📲
✔️ ef6d1e2 #5 2024-04-04 11:30:02 ~5 min tests 📄log
✔️ ef6d1e2 #5 2024-04-04 11:33:12 ~8 min android-e2e 🤖apk 📲
✔️ ef6d1e2 #5 2024-04-04 11:33:19 ~8 min android 🤖apk 📲
✔️ ef6d1e2 #5 2024-04-04 11:34:32 ~9 min ios 📱ipa 📲
✔️ e532d7d #6 2024-04-04 14:49:06 ~6 min android-e2e 🤖apk 📲
✔️ e532d7d #6 2024-04-04 14:50:00 ~7 min android 🤖apk 📲
✔️ e532d7d #6 2024-04-04 14:53:59 ~11 min ios 📱ipa 📲
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 918b98e #7 2024-04-04 16:06:59 ~8 min tests 📄log
✔️ 918b98e #7 2024-04-04 16:08:31 ~10 min android 🤖apk 📲
✔️ 918b98e #7 2024-04-04 16:09:05 ~10 min android-e2e 🤖apk 📲
✔️ 918b98e #7 2024-04-04 16:14:46 ~16 min ios 📱ipa 📲
✔️ 5bff89a #8 2024-04-04 16:57:52 ~6 min android 🤖apk 📲
✔️ 5bff89a #8 2024-04-04 16:58:10 ~6 min android-e2e 🤖apk 📲
✔️ 5bff89a #8 2024-04-04 17:01:04 ~9 min ios 📱ipa 📲
✔️ 5bff89a #9 2024-04-04 17:16:53 ~4 min tests 📄log

@status-im-auto
Copy link
Member

90% of end-end tests have passed

Total executed tests: 52
Failed tests: 2
Expected to fail tests: 3
Passed tests: 47
IDs of failed tests: 727231,703629 
IDs of expected to fail tests: 727230,703503,727229 

Failed tests (2)

Click to expand
  • Rerun failed tests

  • Class TestWalletOneDevice:

    1. test_wallet_add_remove_regular_account, id: 727231

    Device 1: Find `Button` by `accessibility id`: `button-one`
    Device 1: Tap on found: Button

    critical/test_wallet.py:155: in test_wallet_add_remove_regular_account
        self.errors.verify_no_errors()
    base_test_case.py:190: in verify_no_errors
        pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
     Can't swipe between accounts, newly added account is not shown
    



    Device sessions

    Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_join_when_node_owner_offline, id: 703629

    Device 2: Looking for community: 'open community'
    Device 2: Click until Text by accessibility id: community-description-text will be presented

    critical/chats/test_public_chat_browsing.py:1180: in test_community_join_when_node_owner_offline
        self.errors.verify_no_errors()
    base_test_case.py:190: in verify_no_errors
        pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
     Text "You joined “closed community”" in shown toast element doesn't match expected "You joined “open community”"
    



    Device sessions

    Expected to fail tests (3)

    Click to expand

    Class TestCommunityOneDeviceMerged:

    1. test_community_discovery, id: 703503

    Test is not run, e2e blocker  
    

    [[reason: [NOTRUN] Curated communities not loading, https://github.com//issues/17852]]

    Class TestWalletMultipleDevice:

    1. test_wallet_send_asset_from_drawer, id: 727230

    Test is not run, e2e blocker  
    

    [[reason: [NOTRUN] Can't find routes on Sepolia https://github.com//issues/19473]]

    2. test_wallet_send_eth, id: 727229

    Test is not run, e2e blocker  
    

    [[reason: [NOTRUN] Can't find routes on Sepolia https://github.com//issues/19473]]

    Passed tests (47)

    Click to expand

    Class TestDeepLinksOneDevice:

    1. test_links_open_universal_links_from_chat, id: 704613
    Device sessions

    2. test_links_deep_links, id: 702775
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_pin_messages, id: 702732
    Device sessions

    2. test_group_chat_mute_chat, id: 703495
    Device sessions

    3. test_group_chat_send_image_save_and_share, id: 703297
    Device sessions

    4. test_group_chat_reactions, id: 703202
    Device sessions

    5. test_group_chat_join_send_text_messages_push, id: 702807
    Device sessions

    6. test_group_chat_offline_pn, id: 702808
    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_restore_multiaccount_with_waku_backup_remove_switch, id: 703133
    Device sessions

    2. test_community_copy_and_paste_message_in_chat_input, id: 702742
    Device sessions

    3. test_community_undo_delete_message, id: 702869
    Device sessions

    4. test_community_navigate_to_channel_when_relaunch, id: 702846
    Device sessions

    5. test_community_mute_community_and_channel, id: 703382
    Device sessions

    Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_markdown_support, id: 702809
    Device sessions

    2. test_community_hashtag_links_to_community_channels, id: 702948
    Device sessions

    3. test_community_mentions_push_notification, id: 702786
    Device sessions

    4. test_community_leave, id: 702845
    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_add_contact_field_validation, id: 702777
    Device sessions

    2. test_activity_center_contact_request_accept_swipe_mark_all_as_read, id: 702851
    Device sessions

    3. test_activity_center_contact_request_decline, id: 702850
    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782
    Device sessions

    2. test_1_1_chat_text_message_delete_push_disappear, id: 702733
    Device sessions

    3. test_1_1_chat_push_emoji, id: 702813
    Device sessions

    4. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    5. test_1_1_chat_edit_message, id: 702855
    Device sessions

    6. test_1_1_chat_send_image_save_and_share, id: 703391
    Device sessions

    7. test_1_1_chat_pin_messages, id: 702731
    Device sessions

    8. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUiTwo:

    1. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    2. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783
    Device sessions

    3. test_1_1_chat_mute_chat, id: 703496
    Device sessions

    Class TestWalletOneDevice:

    1. test_wallet_add_remove_watch_only_account, id: 727232
    Device sessions

    Class TestActivityMultipleDevicePRTwo:

    1. test_activity_center_mentions, id: 702957
    Device sessions

    2. test_activity_center_admin_notification_accept_swipe, id: 702958
    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_several_images_send_reply, id: 703194
    Device sessions

    2. test_community_one_image_send_reply, id: 702859
    Device sessions

    3. test_community_emoji_send_copy_paste_reply, id: 702840
    Device sessions

    4. test_community_mark_all_messages_as_read, id: 703086
    Device sessions

    5. test_community_contact_block_unblock_offline, id: 702894
    Device sessions

    6. test_community_edit_delete_message_when_offline, id: 704615
    Device sessions

    7. test_community_message_delete, id: 702839
    Device sessions

    8. test_community_message_send_check_timestamps_sender_username, id: 702838
    Device sessions

    9. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    Device sessions

    10. test_community_message_edit, id: 702843
    Device sessions

    11. test_community_unread_messages_badge, id: 702841
    Device sessions

    Class TestActivityMultipleDevicePR:

    1. test_navigation_jump_to, id: 702936
    Device sessions

    2. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947
    Device sessions

    @status-im-auto
    Copy link
    Member

    50% of end-end tests have passed

    Total executed tests: 4
    Failed tests: 0
    Expected to fail tests: 2
    Passed tests: 2
    Not executed tests: 48
    
    IDs of not executed tests: 702730,702782,702731,702745,702813,702855,702733,702783,702784,703391,703496,702807,702732,702808,703202,703297,703495,702838,702843,702839,702859,703194,702840,702841,702844,702894,702845,703086,702786,702809,702948,703629,704615,703503,702846,702742,703133,703382,702869,702850,702851,702777,702936,702947,702957,702958,702775,704613 
    
    IDs of expected to fail tests: 727230,727229 
    

    Not executed tests (48)

    Click to expand
  • Rerun not executed tests
  • Expected to fail tests (2)

    Click to expand

    Class TestWalletMultipleDevice:

    1. test_wallet_send_asset_from_drawer, id: 727230
    Test is not run, e2e blocker  
    

    [[reason: [NOTRUN] Can't find routes on Sepolia https://github.com//issues/19473]]

    2. test_wallet_send_eth, id: 727229

    Test is not run, e2e blocker  
    

    [[reason: [NOTRUN] Can't find routes on Sepolia https://github.com//issues/19473]]

    Passed tests (2)

    Click to expand

    Class TestWalletOneDevice:

    1. test_wallet_add_remove_watch_only_account, id: 727232
    Device sessions

    2. test_wallet_add_remove_regular_account, id: 727231
    Device sessions


    # ToDo: Add verification of Activity tabs when the feature is ready in the next 2 tests:

    def _get_balances_before_tx(self):
    Copy link
    Member

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    are you sure it is worth having it here, not in a separate file?

    I believe it might be used in subsequent tests too?

    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    I'd rather leave as it is for now as it's needed only here. If we'll use in other files we can move it later

    self.home_2.wallet_tab.click()
    new_eth_amount_receiver = self.wallet_2.get_asset(asset_name='Ether').get_amount()
    exp_amount_sender = eth_amount_sender - amount_to_send
    if new_eth_amount_sender > exp_amount_sender:
    Copy link
    Member

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    are we cure that in this place cannot be delay in updating the balance inside the app?

    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    Not yet, I'll add it later

    new_eth_amount_receiver, exp_amount_receiver))
    self.errors.verify_no_errors()

    @marks.xfail(reason="Can't find routes on Sepolia https://github.com/status-im/status-mobile/issues/19473",
    Copy link
    Member

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    would be nice to check if it passed on #19483, thanks!

    self.errors.verify_no_errors()

    @marks.testrail_id(727232)
    def test_wallet_add_remove_watch_only_account(self):
    Copy link
    Member

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    may be we can add some interesting account here and check collectibles, some unusual assets etc.

    Can be done later I believe

    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    Totally agree, but it seems that not all the functionality is ready yet.

    except JSONDecodeError as e:
    self.log("No valid JSON response from Etherscan: %s " % str(e))
    pass
    time.sleep(30)
    Copy link
    Member

    @churik churik Apr 3, 2024

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    I do not exactly remember why we had it here, it might be due to some limitation on etherscan API. Are you sure that we need to remove it?

    Copy link
    Contributor Author

    Choose a reason for hiding this comment

    The reason will be displayed to describe this comment to others. Learn more.

    We can add it anytime. For now I decided not to use it because of the time limits. Current api key limits should be enough for current amount of requests

    @yevh-berdnyk yevh-berdnyk force-pushed the tests/wallet-tests branch 2 times, most recently from 23f1b1a to ef6d1e2 Compare April 4, 2024 11:24
    @status-im-auto
    Copy link
    Member

    75% of end-end tests have passed

    Total executed tests: 4
    Failed tests: 1
    Expected to fail tests: 0
    Passed tests: 3
    
    IDs of failed tests: 727229 
    

    Failed tests (1)

    Click to expand
  • Rerun failed tests

  • Class TestWalletMultipleDevice:

    1. test_wallet_send_eth, id: 727229

    Device 1: Find `Text` by `xpath`: `//android.view.ViewGroup[@content-desc='container']/android.widget.TextView[@text='Ether']/../android.widget.TextView[3]`
    Device 1: `Text` is `0.05931 ETH`

    critical/test_wallet.py:111: in test_wallet_send_eth
        self._check_balances_after_tx(amount_to_send, sender_balance, receiver_balance, eth_amount_sender,
    critical/test_wallet.py:97: in _check_balances_after_tx
        self.errors.verify_no_errors()
    base_test_case.py:190: in verify_no_errors
        pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
     Eth amount in the senders wallet is 0.05931 but should be 0.0593
    



    Device sessions

    Passed tests (3)

    Click to expand

    Class TestWalletOneDevice:

    1. test_wallet_add_remove_regular_account, id: 727231
    Device sessions

    2. test_wallet_add_remove_watch_only_account, id: 727232
    Device sessions

    Class TestWalletMultipleDevice:

    1. test_wallet_send_asset_from_drawer, id: 727230
    Device sessions

    @status-im-auto
    Copy link
    Member

    100% of end-end tests have passed

    Total executed tests: 4
    Failed tests: 0
    Expected to fail tests: 0
    Passed tests: 4
    

    Passed tests (4)

    Click to expand

    Class TestWalletMultipleDevice:

    1. test_wallet_send_asset_from_drawer, id: 727230
    Device sessions

    2. test_wallet_send_eth, id: 727229
    Device sessions

    Class TestWalletOneDevice:

    1. test_wallet_add_remove_regular_account, id: 727231
    Device sessions

    2. test_wallet_add_remove_watch_only_account, id: 727232
    Device sessions

    @yevh-berdnyk yevh-berdnyk merged commit 5bff89a into develop Apr 4, 2024
    6 checks passed
    @yevh-berdnyk yevh-berdnyk deleted the tests/wallet-tests branch April 4, 2024 17:17
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    Projects
    Archived in project
    Archived in project
    Development

    Successfully merging this pull request may close these issues.

    3 participants