Update src/diffusers/models/transformers/transformer_wan.py

a-r-r-o-w · web-flow · commit 1411b3356389 · 2025-04-05T03:41:25.000+05:30
diff --git a/src/diffusers/models/transformers/transformer_wan.py b/src/diffusers/models/transformers/transformer_wan.py
@@ -537,7 +537,7 @@ def apply_rotary_emb(hidden_states: torch.Tensor, freqs: torch.Tensor):
                 query, key, value, attn_mask=attention_mask, dropout_p=0.0, is_causal=False
             )
         else:
-            # Perturbed attention applied only when self-attention
+            # Perturbed attention applied only to self-attention path
             hidden_states = value
 
         hidden_states = hidden_states.transpose(1, 2).flatten(2, 3)

Original file line number	Diff line number	Diff line change
`@@ -537,7 +537,7 @@ def apply_rotary_emb(hidden_states: torch.Tensor, freqs: torch.Tensor):`
`537`	`537`	`query, key, value, attn_mask=attention_mask, dropout_p=0.0, is_causal=False`
`538`	`538`	`)`
`539`	`539`	`else:`
`540`		`- # Perturbed attention applied only when self-attention`
	`540`	`+ # Perturbed attention applied only to self-attention path`
`541`	`541`	`hidden_states = value`
`542`	`542`
`543`	`543`	`hidden_states = hidden_states.transpose(1, 2).flatten(2, 3)`