Skip to content

[Pipelines] Add community pipeline for Zero123 #4295

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Aug 2, 2023

Conversation

kxhit
Copy link
Contributor

@kxhit kxhit commented Jul 26, 2023

What does this PR do?

As discussed in issue, this PR implements a diffusers inference pipeline for Zero123, a popular single image to novel view synthesis stable diffusion model, largely scaled pre-trained on Objaverse Dataset. See Zero123-hf repo for demos and clean workspace.

  • Results from the pipeline are consistent with the original one.
  • The weights for 'cc_projection' layer are not fully converted to diffuser, still need to load the original .ckpt.
  • Documentation.

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you read the contributor guideline?
  • Did you read our philosophy doc (important for complex PRs)?
  • Was this discussed/approved via a Github issue or the forum? Please add a link to it if that's the case. A: Yes, issue
  • Did you make sure to update the documentation with your changes? Here are the
    documentation guidelines, and
    here are tips on formatting docstrings.
  • Did you write any new necessary tests? A: Simply run pipeline_zero1to3.py will call the main() to test the pipe.

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Jul 26, 2023

The documentation is not available anymore as the PR was closed or merged.

…d convert ckpt scripts; support diffusers weights
@patrickvonplaten
Copy link
Contributor

Looks great!

@patrickvonplaten patrickvonplaten merged commit 615c04d into huggingface:main Aug 2, 2023
AmericanPresidentJimmyCarter pushed a commit to AmericanPresidentJimmyCarter/diffusers that referenced this pull request Apr 26, 2024
* add zero123 pipeline to community

* add community doc

* reformat

* update zero123 pipeline, including cc_projection within diffusers; add convert ckpt scripts; support diffusers weights
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants