You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What happened: lora was unable to be loaded to vLLM, and the lora syncer emitted Red Herring error logs and kept retrying the same adapter, blocking other, valid adapters
What you expected to happen: fail to load an adapter gracefully, and move on to the next one in the list
How to reproduce it (as minimally and precisely as possible): configure 2 lora adapters, 1 valid rank 8 adapter, and one invalid adapter (vllm default max rank is 16, so choose larger than that), apply.
The text was updated successfully, but these errors were encountered:
What happened: lora was unable to be loaded to vLLM, and the lora syncer emitted Red Herring error logs and kept retrying the same adapter, blocking other, valid adapters
What you expected to happen: fail to load an adapter gracefully, and move on to the next one in the list
How to reproduce it (as minimally and precisely as possible): configure 2 lora adapters, 1 valid rank 8 adapter, and one invalid adapter (vllm default max rank is 16, so choose larger than that), apply.
The text was updated successfully, but these errors were encountered: