Certain LoRA will not load

[w4ffl35]

Describe the bug

Issue

Certain LoRA will not load

Diffusers version: v0.17.1

Examples

**Problem: ** LoRA file that will not load with SD 2.1 768

• Pixhell LoRA which is supposed to work with SD 2.1 768

• Error message Network alpha is not consistent

• Exception location: loaders.py, line 1297

• Expected: Expect LoRA to load as it is created for SD 2.1 768

• More info: When I printed out network_alpha and alpha I get 94.0, 123.0 respectively.

Reproduction

1. Download https://civitai.com/models/21461?modelVersionId=28943 LoRA file
2. apply it to SD 2.1 768
3. Get the error message in description.

After loading the pretrained model:

pipe.load_lora_weights(
  ".",
  weight_name=checkpoint_path,
  use_safetensors=True
)

Logs

File "venv/lib/python3.10/site-packages/diffusers/loaders.py", line 1297, in _convert_kohya_lora_to_diffusers
    raise ValueError("Network alpha is not consistent")
ValueError: Network alpha is not consistent

### System Info

diffusers 0.17.1, Ubuntu and Windows, Python 3.10.6

### Who can help?

_No response_

[patrickvonplaten]

cc @sayakpaul here

[sayakpaul]

Hi!

Could you please provide a reproducible snippet? Note that this seems like a known issue too: #3087.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.