File tree Expand file tree Collapse file tree 2 files changed +21
-1
lines changed Expand file tree Collapse file tree 2 files changed +21
-1
lines changed Original file line number Diff line number Diff line change @@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM.
938
938
* ✅︎
939
939
:::
940
940
941
+ #### Transcription (` --task transcription ` )
942
+
943
+ Speech2Text models trained specifically for Automatic Speech Recognition.
944
+
945
+ :::{list-table}
946
+ :widths: 25 25 25 5 5
947
+ :header-rows: 1
948
+
949
+ - * Architecture
950
+ * Models
951
+ * Example HF Models
952
+ * [ LoRA] ( #lora-adapter )
953
+ * [ PP] ( #distributed-serving )
954
+ - * ` Whisper `
955
+ * Whisper-based
956
+ * ` openai/whisper-large-v3-turbo `
957
+ * 🚧
958
+ * 🚧
959
+ :::
960
+
941
961
_________________
942
962
943
963
## Model Support Policy
Original file line number Diff line number Diff line change @@ -421,7 +421,7 @@ def generate(
421
421
instead pass them via the ``inputs`` parameter.
422
422
"""
423
423
runner_type = self .llm_engine .model_config .runner_type
424
- if runner_type != "generate" :
424
+ if runner_type not in [ "generate" , "transcription" ] :
425
425
messages = [
426
426
"LLM.generate() is only supported for (conditional) generation "
427
427
"models (XForCausalLM, XForConditionalGeneration)." ,
You can’t perform that action at this time.
0 commit comments