Skip to content

How do task pairs share information? #299

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
tcompa opened this issue Feb 16, 2023 · 2 comments · Fixed by #671
Closed

How do task pairs share information? #299

tcompa opened this issue Feb 16, 2023 · 2 comments · Fixed by #671
Labels
flexibility Support more workflow-execution use cases

Comments

@tcompa
Copy link
Collaborator

tcompa commented Feb 16, 2023

Placeholder issue, branching from #177

Concerning compound tasks: they are logical units of two tasks (a non-parallel preliminary task and a parallel execution) that need to share some data (possibly also parameters, but Dataset.metadata is a reasonable place for that). Note that the shared data are mostly a few paths, not the actual image data. The sharing can happen on-disk, possibly in a "temporary" location, or in the metadata inputs/outputs. Current preference is for using special key-value pairs in metadata dictionary, so that the workflow&task definition remains the same, and the compound-task would "only" exist as an additional endpoint.

@tcompa
Copy link
Collaborator Author

tcompa commented Feb 16, 2023

@tcompa tcompa added the Priority Important, but not the highest priority label Feb 28, 2023
@tcompa tcompa added the flexibility Support more workflow-execution use cases label Sep 15, 2023
@jluethi
Copy link
Collaborator

jluethi commented Sep 27, 2023

Revisit in the context of fractal-analytics-platform/fractal-server#6, not urgent

@jluethi jluethi removed the Priority Important, but not the highest priority label Sep 27, 2023
@tcompa tcompa mentioned this issue Apr 11, 2024
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
flexibility Support more workflow-execution use cases
Projects
Development

Successfully merging a pull request may close this issue.

2 participants