Skip to content

Commit 94c0ee1

Browse files
committed
Feedback fixes
1 parent 294cded commit 94c0ee1

File tree

1 file changed

+9
-2
lines changed

1 file changed

+9
-2
lines changed

pkg/README.md

+9-2
Original file line numberDiff line numberDiff line change
@@ -44,20 +44,27 @@
4444
```bash
4545
kubectl apply -f ./manifests/gateway/gateway.yaml
4646
```
47-
> **_NOTE:_** This file couples together the gateway infra and the HTTPRoute infra for a convenient, quick startup. Should you wish to experiment on the same gateway, a new `Backend` & `HTTPRoute` will need to be created per route/pool you would like.
47+
> **_NOTE:_** This file couples together the gateway infra and the HTTPRoute infra for a convenient, quick startup. Creating additional/different InferencePools on the same gateway will require an additional set of: `Backend`, `HTTPRoute`, the resources included in the `./manifests/gateway/ext-proc.yaml` file, and an additional `./manifests/gateway/patch_policy.yaml` file.
48+
49+
50+
Should you wish to experiment on the same gateway, a new `Backend` and `HTTPRoute` will need to be created per route/pool you would like.
4851

4952
1. **Deploy Ext-Proc**
5053

5154
```bash
5255
kubectl apply -f ./manifests/gateway/ext_proc.yaml
5356
kubectl apply -f ./manifests/gateway/patch_policy.yaml
5457
```
55-
> **_NOTE:_** This is also per InferencePool, and will need to be configured to support the new pool should you wish to experiment further
58+
> **_NOTE:_** This is also per InferencePool, and will need to be configured to support the new pool should you wish to experiment further.
5659
5760
1. **OPTIONALLY**: Apply Traffic Policy
5861

5962
For high-traffic benchmarking you can apply this manifest to avoid any defaults that can cause timeouts/errors.
6063

64+
```bash
65+
kubectl apply -f ./manifests/gateway/traffic_policy.yaml
66+
```
67+
6168
1. **Try it out**
6269

6370
Wait until the gateway is ready.

0 commit comments

Comments
 (0)