Deduplicate sampling/demo code #76
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR deduplicates the code inadvertently readded in #69 to use the refactored helpers implemented in #57.
Most of the commits are simple mechanical refactorings, aside from:
sgm.util.load_model_from_config
had to be changed not tomodel.eval()
(which was already done in Minimal txt2img example #60)do_sample
anddo_txt2img
from the sampling demo with the refactored helpers, and adds a newmove_model
context manager argument to implement low-VRAM mode. (I think it turned out pretty elegant.)👉 Since I do not have a beefy enough CUDA device at my easy disposal, I didn't test the streamlit demo yet.