text_encoder is not found in self._lora_loadable_modules=['transformer'].

[jashwanth0712]

while i was trying to tun the model, i have ended up with this particular error

  File "/workspace/dimensionx/DimensionX/src/gradio_demo/app.py", line 60, in <module>
    pipe_image.fuse_lora(lora_scale=1 / lora_rank)
  File "/usr/local/lib/python3.10/dist-packages/diffusers/loaders/lora_pipeline.py", line 2888, in fuse_lora
    super().fuse_lora(
  File "/usr/local/lib/python3.10/dist-packages/diffusers/loaders/lora_base.py", line 445, in fuse_lora
    raise ValueError(f"{fuse_component} is not found in {self._lora_loadable_modules=}.")
ValueError: text_encoder is not found in self._lora_loadable_modules=['transformer'].

[chenshuo20]

You can take a look this issue.

[DsnTgr]

# pipe.load_lora_weights(lora_path, weight_name="orbit_left_lora_weights.safetensors", adapter_name="orbit_left")
pipe.load_lora_weights(lora_path, weight_name="orbit_up_lora_weights.safetensors", adapter_name="orbit_up")
pipe.fuse_lora(components=["transformer"], lora_scale=1 / lora_rank)

You need to define the components in fuse_lora fuction.