Skip to content

ci: avoid pounding on the poor ci-artifacts container #2622

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 15, 2020

Conversation

dscho
Copy link
Member

@dscho dscho commented May 12, 2020

I did not think through how I designed the Windows job initializing the minimal subset of Git for Windows' SDK: it currently accesses Azure Blobs and uses way too much bandwidth, blowing right through my quota.

With this PR, we use the (slower) method of downloading the git-sdk-64-minimal Build Artifact of our Azure Pipeline again, which should fix that problem.

@dscho
Copy link
Member Author

dscho commented May 12, 2020

Companion GitGitGadget PR: gitgitgadget#632

derrickstolee added a commit to microsoft/git that referenced this pull request May 13, 2020
…container

I did not think through how I designed the Windows job initializing the minimal subset of Git for Windows' SDK: it currently accesses Azure Blobs and uses way too much bandwidth, blowing right through my quota.

With this PR, we use the (slower) method of downloading the git-sdk-64-minimal Build Artifact of our Azure Pipeline again, which should fix that problem.

This is a companion PR to git-for-windows#2622
When this developer tested how the git-sdk-64-minimal artifact could be
served to all the GitHub workflow runs that need it, Azure Blobs looked
like a pretty good choice: it is reliable, fast and we already use it in
Git for Windows to serve components like OpenSSL, cURL, etc

It came as an unpleasant surprise just _how many_ times this artifact
was downloaded. It exploded the bandwidth to a point where the free tier
would no longer be enough, threatening to block other, essential Git for
Windows services.

Let's switch back to using the Build Artifacts of our trusty Azure
Pipeline for the time being.

To avoid unnecessary hammering of the Azure Pipeline artifacts, we use
the GitHub Action `actions/upload-artifact` in the `windows-build` job
and the GitHub Action `actions/download-artifact` in the `windows-test`
and `vs-test` jobs (the latter now depends on `windows-build` for that
reason, too).

Helped-by: Đoàn Trần Công Danh <[email protected]>
Signed-off-by: Johannes Schindelin <[email protected]>
@dscho dscho force-pushed the avoid-ci-artifacts-for-now branch from bec0334 to 3298900 Compare May 15, 2020 07:38
@dscho dscho merged commit 01c50ad into git-for-windows:master May 15, 2020
git-for-windows-ci pushed a commit that referenced this pull request May 15, 2020
ci: avoid pounding on the poor ci-artifacts container
git-for-windows-ci pushed a commit that referenced this pull request May 15, 2020
ci: avoid pounding on the poor ci-artifacts container
git-for-windows-ci pushed a commit that referenced this pull request May 15, 2020
ci: avoid pounding on the poor ci-artifacts container
@dscho dscho deleted the avoid-ci-artifacts-for-now branch May 15, 2020 11:20
dscho added a commit to dscho/git that referenced this pull request May 15, 2020
…-for-now

ci: avoid pounding on the poor ci-artifacts container
git-for-windows-ci pushed a commit that referenced this pull request May 29, 2020
ci: avoid pounding on the poor ci-artifacts container
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant