Skip to content

sync python package version in requirements #234

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
6 of 9 tasks
mguidon opened this issue Sep 25, 2018 · 3 comments
Closed
6 of 9 tasks

sync python package version in requirements #234

mguidon opened this issue Sep 25, 2018 · 3 comments
Assignees
@pcrespov
Labels
a:infra+ops maintenance of infrastructure or operations (discussed in retro)
Milestone
Ankh-Morpork

Comments

@mguidon
Copy link
Member

mguidon commented Sep 25, 2018 •
edited by pcrespov
Loading

Goals of this case:

  • Guarantee maximum compatibility among all requirements in simcore projects
  • Guaranteed compatibility with python distributions >=3.6
  • Define a workflow to define requirements. E.g. author can leave version open and at a given point, some tool freezes the version to provide guarantees described above (see tools described in comments).

Update libraries

  • packages/director-sdk won't do. it is auto-generated
  • packages/s3wrapper
  • packages/service-library
  • packages/simcore-sdk
  • Shortcuts for CI, dev and prod: pip install -r mylib/requirements/[ci|dev|prod].txt
  • update ops/travis with ci shortcuts

Update services

  • services/webserver
  • services/sidecar
  • services/storage
  • services/director
@mguidon
Copy link
Member Author

mguidon commented Sep 25, 2018 •
edited by pcrespov
Loading 

simcore-service-sidecar 0.0.1 has requirement docker==3.3.0, but you'll have docker 3.5.0 which is incompatible.
simcore-service-director 0.1.0 has requirement requests==2.19.1, but you'll have requests 2.19.0 which is incompatible.

@pcrespov pcrespov changed the title Add script to synchronize python package version Add script to synchronize python package version in requirements Oct 13, 2018
@pcrespov pcrespov changed the title Add script to synchronize python package version in requirements sync python package version in requirements Oct 13, 2018
@pcrespov pcrespov self-assigned this Oct 13, 2018
@pcrespov
Copy link
Member

  • Start to have incompatibilities with later versions of python. e.g. pica has issues with python3.7. Should we activate cox to test compatibility >=3.6?

@pcrespov pcrespov mentioned this issue Oct 31, 2018
Closed
@pcrespov pcrespov added the a:infra+ops maintenance of infrastructure or operations (discussed in retro) label Oct 31, 2018
@pcrespov pcrespov added backlog and removed backlog labels Dec 13, 2018
@pcrespov
Copy link
Member

References:

@pcrespov pcrespov mentioned this issue Dec 21, 2018
Closed
9 tasks
@ghost ghost added review and removed in progress labels Dec 21, 2018
@sanderegg sanderegg mentioned this issue Jan 8, 2019
Closed
@sanderegg sanderegg added this to the Ankh-Morpork milestone Apr 16, 2019
@pcrespov pcrespov mentioned this issue Apr 30, 2019
Merged
8 tasks
pcrespov added a commit that referenced this issue May 14, 2019
@pcrespov
Is234/compile requirements (#733)
05c746e 
Implements #234 : normalizes dependencies for python packages in osparc-simcore repository

- documented (see ``docs/python-dependencies.md``) new workflow with python requirements
- updates ``packages`` and ``services`` 
- updates ``ops\travis`` CI
   - moves out a part of unittest ``simcore-sdk`` into a new unit-test for ``service-library``
   - installation is always performed as ``pip install -r requirements/ci.txt ``
   -  @mguidon,  sidecar as NO tests (created ``ops\tracis`` but disabled)!

* Fixed makefile for all OS
* Fixing storage tests:
 - downgraded aiopg until bug is fixed
* Fixes overlapping port
* Enhaces doc
* Downgraded aio-pika
 - avoid test-errors in webserver integration!
 - cleanup
sanderegg added a commit that referenced this issue May 22, 2019
@sanderegg
test staging (#802)
784706f 
* Delete settings.json

* Fixes for alpha tester (#748)

* fake-template-projects.json created. 2 templates moved here
* Kember use case added
* MattWard use case added
* 4x CC 0D added
* Provide a way to refetch data from DataManager
* connect the kember-model to the kember-viewer
* moved null handler to node_ports package
* set node ports log level to same as sidecar
* removed Unused import logging
* New issue: add UX_improvemnts label and asign it to oSPARC Product Backlog project

* Permission policies (#731)

* LinkButton and LinkLabel moved
* Project -> Study
* default hardcoded permissions added
* Added some restrictions
* Link -> Edge
* Moved permission checks to data level
* Set Default Role
* more permission checks
* token permission checks
* datcore read permission check
* study.node.data.* permission check
* study.node.rename permission check
* services.filtered.read permission check
* fixed plotly minor bug
* Test permissions
* Moved some removeNode code to Workbench
* Moved removeEdge code to Workbench
* test edge create/delete
* test node rename
* deserializeNodes and deserializeEdges added
* deserializeEdges fixed for 'outputNode's
* got rid of canStart
* Typo: presgined -> presigned
* do not allow anonymous users to add/delete tokens
* do not allow anonymous users to update user profile

* Frontend privileges. 2nd iteration (#753)

* help points to our itisfoundation.github.io
* typo
* Do not show Debug level in logger to User and Anon
* Do not show nodeIds in NodesTree to User and Anon
* Tester and higher level roles can switch their role to a lower one

* Is730/serve studies (#747)

Implements a first prototype for issue #730 

Adds new subsystem ``services/web/server/src/simcore_service_webserver/studies_access.py``
 - Open services/web/server/tests/sandbox/*.md and click any link
 - If user is logged in, it copies the project and displays it
 - if anonymous, it creates a temporary user and does the previous step
 - Merges changes from PR #734 that contains the UI part.
   - queries id in url and opens page with specified study
   - fixes log out
   - preview of permissions (client-side only)

Next step will incorporate privileges and user roles on the server side.

* Quick fixes (#742)

A couple of iframe bugs fixed:

Maximizing an iframe now works.
We can now resize a SidePanel over an iframe
Other bugs:

File picker bug fixed. #741

* Update study_access_demo.md

Added link to actual emulator [skip travis-ci]

* Logger context dependant (#754)

* replace label by nodeId in logger
* Bring back the update page alert window
* added link to version/commit to login page
* startInteractiveNode out from populateNodeData
* Log message changes when label is changed
* Logger node context dependant

* Is234/compile requirements (#733)

Implements #234 : normalizes dependencies for python packages in osparc-simcore repository

- documented (see ``docs/python-dependencies.md``) new workflow with python requirements
- updates ``packages`` and ``services`` 
- updates ``ops\travis`` CI
   - moves out a part of unittest ``simcore-sdk`` into a new unit-test for ``service-library``
   - installation is always performed as ``pip install -r requirements/ci.txt ``
   -  @mguidon,  sidecar as NO tests (created ``ops\tracis`` but disabled)!

* Fixed makefile for all OS
* Fixing storage tests:
 - downgraded aiopg until bug is fixed
* Fixes overlapping port
* Enhaces doc
* Downgraded aio-pika
 - avoid test-errors in webserver integration!
 - cleanup

* Fix input node's title (#771)

* fix #770

* Improve CI/CD for simcore and add staging/production stages (#738)

build docker images once and push to dockerhub
pull from dockerhub for testing
implement release workflow

* Is788/allow different stack name (#789)

* director/sidecar independant of stack name using SWARM_STACK_NAME
* allow choosing port where simcore platform is available

* fixed link to image

* Maintenance/update requirements (#792)

* Upstead api/tests requirements
* Updates travis system-testing requirements
* Updated s3wrapper requirements
* update servicelib requirements
* Updates simcore-sdk requirements and with this all packages requirements
* Updates apihub/tests requirements
* Fixes missing ops/travis requirements
* Updates director
* Updates sidecar
* updated storage

* Fix: 2 file management bugs (#782)

* getLowerRoles fixed
* CopyFile returns true/false if request sent + test
* DeleteFile returns true/false if request sent + test
* getChildrenRoles by checking inheritance
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pcrespov pcrespov

Labels
a:infra+ops maintenance of infrastructure or operations (discussed in retro)
Projects
None yet
Milestone
Ankh-Morpork
Development

Successfully merging a pull request may close this issue.

WIP: Is234/update py requirements pcrespov/osparc-simcore
3 participants
@pcrespov @mguidon @sanderegg