Fix the incorrect output of sdxl inpaint

[yuanwu2017]

What does this PR do?

Fix the incorrect output of sdxl inpaint.
Command:
python text_to_image_generation.py --model_name_or_path diffusers/stable-diffusion-xl-1.0-inpainting-0.1 --base_image https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/inpaint.png --mask_image https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/inpaint_mask.png --prompts "concept art digital painting of an elven castle, inspired by lord of the rings, highly detailed, 8k" --seed 42 --scheduler euler_discrete --num_images_per_prompt 12 --batch_size 4 --image_save_dir ./xl2 --use_habana --use_hpu_graphs --gaudi_config Habana/stable-diffusion --sdp_on_bf16 --bf16

Before:

Images(only attach first four images ):

After：

Images(only attach first four images ):

Seeing from the results, the performance has no decline. The output pictures are more fine

Fixes # (issue)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[yuanwu2017]

@regisss @dsocek Please help to review.

[yuanwu2017]

pass ci test.