Optmised for 6 GB?

[AndrWeisR]

Can this be optimised to run in 6 GB similarly to Hlky's https://github.com/sd-webui/stable-diffusion-webui/tree/master/optimizedSD ?

I'm getting CUDA out of memory when using prompt and edit_prompt in 6 GB @ 512x512. Generation of a single 512x512 image is working.

[bloc97]

I will need to see whether this can be optimized for 6GB, as we need to save the attention maps, which is pretty big for the lower parts of the u-net (8x4096x4096). Maybe a workaround would be to save them to RAM and load them one by one during inference.