Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add VAE select #2867

Merged
merged 6 commits into from
May 9, 2024
Merged

Add VAE select #2867

merged 6 commits into from
May 9, 2024

Conversation

mashb1t
Copy link
Collaborator

@mashb1t mashb1t commented May 4, 2024

closes #1840 (@E2GO fyi)
as discussed in #2861 (@ILikeToasters fyi)

Adds a dropdown for model VAE, which is especially handy when the base model doesn't have one baked in.
Upload VAEs to the already existing models/vae folder.
IMPORTANT: not models/vae_approx, which is used for the preview of intermediate step images with fixed VAE

Open TODO's:

  • add VAE to metadata
  • (if necessary) add refiner support => would only work for sd1.5 refiners, not necessary for now
  • (optional) add validation for default value (currently implemented like model and refiner, does not crash on startup when default_vae is not in list of vae_filenames

Tested with model Mohawk (any other model with no VAE baked in will work for testing too)

Before:
washed out look, desaturated

Details

(EDIT screenshot with different model, see exact resulting image below)
Screenshot 2024-05-04 184639

2024-05-04_21-30-18_2490

After:
selected VAE is applied, colorful image

Details

screencapture-localhost-7865-2024-05-04-21_08_47

2024-05-04_21-28-22_2490

@mashb1t mashb1t added this to the 2.4.0 milestone May 4, 2024
@mashb1t mashb1t requested a review from lllyasviel as a code owner May 4, 2024 19:23
@mashb1t mashb1t mentioned this pull request May 4, 2024
@mashb1t mashb1t marked this pull request as draft May 4, 2024 19:47
@mashb1t mashb1t added the Size M medium change, isolated, testing with care label May 4, 2024
@mashb1t mashb1t marked this pull request as ready for review May 4, 2024 22:51
@mashb1t mashb1t changed the base branch from main to develop May 4, 2024 22:58
@mashb1t mashb1t merged commit c32bc5e into develop May 9, 2024
csokun pushed a commit to csokun/Fooocus that referenced this pull request Jun 16, 2024
* Revert "fix: use LF as line breaks for Docker entrypoint.sh (lllyasviel#2843)" (lllyasviel#2865)

False alarm, worked as intended before. Sorry for the fuzz.
This reverts commit d16a54e.

* feat: add VAE select

* feat: use different default label, add translation

* fix: do not reload model when VAE stays the same

* refactor: code cleanup

* feat: add metadata handling
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Size M medium change, isolated, testing with care
Projects
None yet
Development

Successfully merging this pull request may close these issues.

VAE problem?
1 participant