Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

diffusers soft inpainting support #7863

Closed
SlZeroth opened this issue May 5, 2024 · 5 comments
Closed

diffusers soft inpainting support #7863

SlZeroth opened this issue May 5, 2024 · 5 comments

Comments

@SlZeroth
Copy link
Contributor

SlZeroth commented May 5, 2024

SDXL inpaint quality is really poor

but it can solve with like A1111 webui support soft inpainting feature

is there any support plan to soft inpaint?

@tolgacangoz
Copy link
Contributor

Could you please describe how you used SD-XL for inpainting? Have you tried SD-XL's fine-tuned model for inpainting? One can try it quickly from this space.

@SlZeroth
Copy link
Contributor Author

SlZeroth commented May 6, 2024

@StandardAI I tried inpaint before. but this inpainting quality is really bad. webui officially support soft inpainting for solve the poor inpainting quality. but diffusers not support soft inpainting

@tolgacangoz
Copy link
Contributor

tolgacangoz commented May 6, 2024

If you share a really bad output, we can discuss it in a more measurable and healthy way IMO.

@asomoza
Copy link
Member

asomoza commented May 6, 2024

I would appreciate it if you could do both: show an example of poor inpainting in diffusers, and then show the same example improved with automatic1111 soft inpainting.

I'm aware of the "soft inpainting", but I haven't had the time to test it to see if it's an improvement or not. IMO the results should be similar to what we can do with differential diffusion and the key point is that it allows to use mask with a soft brush (or gradients).

You can take a look at some experiments I did with it:

#6529 (comment)
#7038 (comment)

@SlZeroth
Copy link
Contributor Author

@asomoza thank you for nice answer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants