Skip to content
This repository was archived by the owner on Feb 25, 2025. It is now read-only.

Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script #50735

Merged
merged 2 commits into from
Feb 17, 2024

Conversation

jason-simmons
Copy link
Member

This test had been temporarily moved to an API 33 device as a workaround for an FTL infrastructure issue (see #50721)

This PR resumes use of a Pixel 8/API 34 device for the FTL tests. It also retries the test if FTL returns an error code that is known to represent an FTL infrastructure error. If the retries fail, then the test script will not block the engine tree if all failures were caused by infrastructure.

This is similar to what the CI recipes are doing in https://flutter.googlesource.com/recipes/+/a181878fde742dacd94afca04c5a4db1b3c30b91

@flutter-dashboard
Copy link

It looks like this pull request may not have tests. Please make sure to add tests before merging. If you need an exemption to this rule, contact "@test-exemption-reviewer" in the #hackers channel in Chat (don't just cc them here, they won't see it! Use Discord!).

If you are not sure if you need tests, consider this rule of thumb: the purpose of a test is to make sure someone doesn't accidentally revert the fix. Ask yourself, is there anything in your PR that you feel it is important we not accidentally revert back to how it was before your fix?

Reviewers: Read the Tree Hygiene page and make sure this patch meets those guidelines before LGTMing.

…handle FTL infrastructure errors in the script

This test had been temporarily moved to an API 33 device as a workaround for an FTL infrastructure issue (see flutter#50721)

This PR resumes use of a Pixel 8/API 34 device for the FTL tests.  It also retries the test if FTL returns an error code that is known to represent an FTL infrastructure error.  If the retries fail, then the test script will not block the engine tree if all failures were caused by infrastructure.

This is similar to what the CI recipes are doing in https://flutter.googlesource.com/recipes/+/a181878fde742dacd94afca04c5a4db1b3c30b91
@jason-simmons jason-simmons force-pushed the ftl_handle_infra_errors branch from 1065ff8 to a451910 Compare February 16, 2024 22:48
@jason-simmons jason-simmons changed the title Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastucture errors in the script Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script Feb 16, 2024
@reidbaker
Copy link
Contributor

Thank you lgtm


return_code = process.wait()
if return_code in FTL_INFRA_FAILURE_CODES:
print('Firebase test %s failed with infrastructure error code: %s' % (apk, return_code))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good addition

@jason-simmons jason-simmons added the autosubmit Merge PR when tree becomes green via auto submit App label Feb 17, 2024
@auto-submit auto-submit bot merged commit 4278210 into flutter:main Feb 17, 2024
engine-flutter-autoroll added a commit to engine-flutter-autoroll/flutter that referenced this pull request Feb 17, 2024
…cript and handle FTL infrastructure errors in the script (flutter/engine#50735)
auto-submit bot pushed a commit to flutter/flutter that referenced this pull request Feb 17, 2024
…143624)

flutter/engine@2ed159a...e51d4f1

2024-02-17 [email protected] Connect signals in swapped form. (flutter/engine#50705)
2024-02-17 [email protected] Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script (flutter/engine#50735)

If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC [email protected],[email protected],[email protected] on the revert to ensure that a human
is aware of the problem.

To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose

To report a problem with the AutoRoller itself, please file a bug:
https://issues.skia.org/issues/new?component=1389291&template=1850622

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
autosubmit Merge PR when tree becomes green via auto submit App
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants