Skip to content

Commit 8b40c7d

Browse files
NickLuccheshreyankg
authored andcommitted
[Bugfix][Docs] Fix offline Whisper (vllm-project#13274)
1 parent fef8410 commit 8b40c7d

File tree

2 files changed

+21
-1
lines changed

2 files changed

+21
-1
lines changed

docs/source/models/supported_models.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM.
938938
* ✅︎
939939
:::
940940

941+
#### Transcription (`--task transcription`)
942+
943+
Speech2Text models trained specifically for Automatic Speech Recognition.
944+
945+
:::{list-table}
946+
:widths: 25 25 25 5 5
947+
:header-rows: 1
948+
949+
- * Architecture
950+
* Models
951+
* Example HF Models
952+
* [LoRA](#lora-adapter)
953+
* [PP](#distributed-serving)
954+
- * `Whisper`
955+
* Whisper-based
956+
* `openai/whisper-large-v3-turbo`
957+
* 🚧
958+
* 🚧
959+
:::
960+
941961
_________________
942962

943963
## Model Support Policy

vllm/entrypoints/llm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -421,7 +421,7 @@ def generate(
421421
instead pass them via the ``inputs`` parameter.
422422
"""
423423
runner_type = self.llm_engine.model_config.runner_type
424-
if runner_type != "generate":
424+
if runner_type not in ["generate", "transcription"]:
425425
messages = [
426426
"LLM.generate() is only supported for (conditional) generation "
427427
"models (XForCausalLM, XForConditionalGeneration).",

0 commit comments

Comments
 (0)