Skip to content

Ensure screenshots are taken and uploaded to Skia gold, or fail the test #143459

Closed
flutter/engine
#50703
@matanlurey

Description

@matanlurey

From Discord:

Running into some weirdness.

In flutter/engine#50583, I added another set of tests running Android API v28, expecting new goldens. I only saw a few (<5) and assumed it just matched existing digests and moved on.

Now on an entirely unrelated PR, https://flutter-engine-gold.skia.org/cl/github/50601, they are showing up.

This is pretty crucial because these are the only rendering tests for the Android embedder, if I can't rely on the goldens all of this effort might be wasted.

I'll file a separate issue for some possible race-y conditions that result in a screenshot never being taken, but the test should definitely fail if an expected screenshot is not created and uploaded. @gaaclarke had some similar work for the Impeller golden files, and ended up with a diff file approach that seems reasonable to copy or at least be inspired by.

The outcome of this issue would be:

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issues not at the top of the work liste: scenario-appThe `testing/scenario_app` fixture in the engineplatform-androidAndroid applications specificallyteam-engineOwned by Engine team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions