Skip to content

Commit 3f99e71

Browse files
committed
Docs: Quickstart Fixes
- Fixes the InferencePool name reference in HTTPRoute. - Fixes target model name in InferenceModel. Signed-off-by: Daneyon Hansen <[email protected]>
1 parent 4ff391b commit 3f99e71

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

Diff for: config/manifests/gateway/httproute-with-timeout.yaml

+1-1
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ spec:
1111
- backendRefs:
1212
- group: inference.networking.x-k8s.io
1313
kind: InferencePool
14-
name: vllm-llama2-7b
14+
name: vllm-llama3-8b-instruct
1515
matches:
1616
- path:
1717
type: PathPrefix

Diff for: config/manifests/gateway/httproute.yaml

+1-1
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ spec:
1111
- backendRefs:
1212
- group: inference.networking.x-k8s.io
1313
kind: InferencePool
14-
name: vllm-llama2-7b
14+
name: vllm-llama3-8b-instruct
1515
matches:
1616
- path:
1717
type: PathPrefix

Diff for: config/manifests/inferencemodel.yaml

+1-1
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ spec:
88
poolRef:
99
name: vllm-llama3-8b-instruct
1010
targetModels:
11-
- name: food-review-1
11+
- name: food-review
1212
weight: 100
1313

1414
---

0 commit comments

Comments
 (0)