Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: add dtype selection to PixArt #12

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Conversation

SLAPaper
Copy link

add dtype selection to pixart loading so that it won't conflicting with fp8 mode of ComfyUI, which is incompatible with pixart models mentioned in #9

PixArt/loader.py Outdated Show resolved Hide resolved
PixArt/nodes.py Outdated Show resolved Hide resolved
PixArt/nodes.py Outdated Show resolved Hide resolved
@SLAPaper
Copy link
Author

type annotations removed

@city96
Copy link
Owner

city96 commented Jan 27, 2024

Thanks, looks good now.

I thought about it more and I might be able to get FP8 support working for just the PixArt model. I'll take a shot at it tonight or tomorrow, then merge this if that doesn't pan out.

@city96
Copy link
Owner

city96 commented Jan 28, 2024

Alright, I got started on proper FP8 support on this branch. I think it's doable, though I don't have much free time these days.

In the meantime I just added a quick workaround so the current code still works when launched with --fp8_e5m2-unet - it'll just falls back to fp16 or whatever the default dtype is. Can you test if this works for you?

@SLAPaper
Copy link
Author

Fine, I'll test it afterwards

@SLAPaper
Copy link
Author

The quick fix works fine, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants