Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Diffusion artifacts & other issues #13

Open
elthariel opened this issue Jan 22, 2025 · 0 comments
Open

Diffusion artifacts & other issues #13

elthariel opened this issue Jan 22, 2025 · 0 comments

Comments

@elthariel
Copy link

elthariel commented Jan 22, 2025

Hello,

First, I'd like to thank you for sharing your amazing paper which brings significant ideas to the field.

Sadly, I haven't been able to use this model in any of my own test images using the gradio interface released, as the images produces by the model exhibit important artifacts. I'm going to share here the details of my setup as well as the images in question.

Examples

Here are 2 images produced by MangaNinja that are good examples of the issue I'm experiencing:

  • The first image is produced using the reference image used as reference as well as target with the default gradio settings
  • The second image is produced using the reference image provided and with a different lineart of the same character, still with the default gradio settings, but with the checkbox "input is lineart" activated
  • I'm following the process documented in the README:
    • Upload image
    • Preprocess image
    • Add points to provide guidance
    • Generate

Image
Image

Here's the reference image:

Image

and here's the lineart:

Image

I've tried using different image format (png, jpg) and rgb or grayscale for the lineart image, but it produces similar result.

Setup

The relevant informations about my setup are provided in this gist
It includes information about the packages installed, my gpu, system, etc.
I can provide more details if you deem it useful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant