Skip to content

CLOUDP-59015: Upload rpm to mongo yum repo #78

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Apr 9, 2020
Merged

CLOUDP-59015: Upload rpm to mongo yum repo #78

merged 13 commits into from
Apr 9, 2020

Conversation

gssbzn
Copy link
Collaborator

@gssbzn gssbzn commented Mar 31, 2020

Proposed changes

Jira ticket: CLOUDP-59015

Further comments

Running test here https://evergreen.mongodb.com/version/5e84863cd1fe0775bdea7566

@gssbzn gssbzn added the WIP Work in progress label Mar 31, 2020
.evergreen.yml Outdated
@@ -122,6 +122,50 @@ tasks:
permissions: public-read
content_type: ${content_type|application/x-gzip}

- name: publish

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

call this push.

</html>


repos:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd trim the list of repos to be only things you intend to actual push.

.evergreen.yml Outdated
--arch x86_64 \
--packages https://s3.amazonaws.com/mongodb-mongocli-build/${project}/${revision}/dist/mongocli_next_${revision}_${version_id}_${created_at}_linux_x86_64.rpm

./curator repo submit \

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd do what you can to try and get org/community to run in parallel.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, I was just thinking of this seeing how long this takes, I may need to run other distros in parallel as well

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there's basically no local work, it's all busy-waiting, so finding some way to not serialize these tasks is good (and largely, all the work is parallelized on the backend.

@gssbzn gssbzn removed the WIP Work in progress label Apr 1, 2020
@gssbzn
Copy link
Collaborator Author

gssbzn commented Apr 1, 2020

@tychoish this is RFAL, opened a build ticket as it looks like we need some work for other rpm distros that are not rehad7

@tychoish
Copy link

tychoish commented Apr 1, 2020

what is RFAL?

.evergreen.yml Outdated
run_on:
- rhel70-small
tasks:
- name: compile
- name: package
# Redhat buildvariants
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd just append a bunch of tasks to a single build variant.

@tychoish
Copy link

tychoish commented Apr 1, 2020

is the thing in the package only a go binary? does it link to any system library. If contents of the package are the same regardless, you should be able to push the same .rpm all RPM repositories

Copy link

@tychoish tychoish left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see other comments

@gssbzn
Copy link
Collaborator Author

gssbzn commented Apr 2, 2020

@tychoish changed this to be parallel tasks instead of buildvariants,
Yes, the RPM is just a go binary, no dependencies or linking other binaries, we still get

[2020/04/02 11:55:45.836] [curator] 2020/04/02 11:55:45 [p=emergency]: job 'build-repo.distro.rpm.repo.13b13efe-ee5e-4f91-9868-ec7ea97b5519' completed with error [problem building repo in '/data/repobuilder/repo.mongodb.com/yum/redhat/7/mongodb-enterprise/development/x86_64': signing release metadata for /data/repobuilder/repo.mongodb.com/yum/redhat/7/mongodb-enterprise/development/x86_64: problem with notary service client signing file: exit status 1]

Or

[2020/04/02 11:43:09.697] [curator] 2020/04/02 11:43:09 [p=emergency]: job 'build-repo.distro.rpm.repo.b83164ac-440c-4769-a513-dabab9e04d4c' completed with error [problem building repo in '/data/repobuilder/repo.mongodb.com/yum/amazon/2/mongodb-enterprise/development/x86_64': signing release metadata for /data/repobuilder/repo.mongodb.com/yum/amazon/2/mongodb-enterprise/development/x86_64: problem with notary service client signing file: exit status 1]

And no clear idea or reference if this is just miss-configuration on our side

@gssbzn
Copy link
Collaborator Author

gssbzn commented Apr 6, 2020

@tychoish any other comment here? I also updated BUILD-10839 with more details

@gssbzn gssbzn requested a review from andreaangiolillo April 9, 2020 10:00
Copy link
Collaborator

@andreaangiolillo andreaangiolillo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gssbzn gssbzn merged commit 0caad2e into master Apr 9, 2020
@gssbzn gssbzn deleted the CLOUDP-59015 branch April 9, 2020 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants