Skip to content

Fix cases where we would unintentionally tar the entire build workspace #49130

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Nov 15, 2019

Conversation

mark-vieira
Copy link
Contributor

@mark-vieira mark-vieira commented Nov 15, 2019

We recently started noticing that end of build had increased substantially. This is attributed to the buildFinished hook that packs up certain log files and test output and uploads to GCP for later retrieval if needed. There seemed to be some issue with the logic here that would cause the entire build workspace to be included in the bundle. One scenario in which this could happen is if our included filters didn't match any files, in which case we wouldn't add any filters to our Ant fileset, so by default this would include the entire workspace. Essentially, this happens for any build that doesn't spin up elasticsearch clusters via testclusters. For such a build, none of the workspace files would match our criteria and the default behavior would kick in.

We began to observe this behavior after #48732 was merged. The reason was that for any given build we would at least include the journalctl.log file created in the build workspace. When that was removed, certain builds (those that didn't leverage testclusters) would now not match any files and Ant would default to the "include all" strategy.

@mark-vieira mark-vieira added the :Delivery/Build Build or test infrastructure label Nov 15, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (:Core/Infra/Build)

Signed-off-by: Mark Vieira <[email protected]>
@mark-vieira mark-vieira requested a review from rjernst November 15, 2019 00:34
@mark-vieira mark-vieira self-assigned this Nov 15, 2019
Copy link
Member

@rjernst rjernst left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@alpar-t alpar-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mark-vieira mark-vieira merged commit 49be465 into elastic:master Nov 15, 2019
mark-vieira added a commit that referenced this pull request Nov 15, 2019
…ce (#49130)

Fix cases where we would unintentionally tar the entire build workspace
mark-vieira added a commit that referenced this pull request Nov 15, 2019
…ce (#49130)

Fix cases where we would unintentionally tar the entire build workspace
@mark-vieira mark-vieira deleted the fix-build-finished-upload branch November 15, 2019 15:02
mark-vieira added a commit that referenced this pull request Nov 15, 2019
…ce (#49130)

Fix cases where we would unintentionally tar the entire build workspace
@jimczi jimczi added v7.5.0 and removed v7.5.1 labels Nov 19, 2019
@mark-vieira mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants