Corrupted tokens on two or more stream concurrent prompts

[celsowm]

Hi !
I tried lots of models, quants and not, and the result are always the same as this video:

bug_vllm.mp4

As you can see, when the second stream prompt is also called corrupted tokens starts
I also tried curl and js fetch requests and the result (concurrents) are the same.

Any hints?