-
Notifications
You must be signed in to change notification settings - Fork 53
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Rename TargetPortNumber to PortNumber in ExtensionRef #376
Comments
There is a targetPortNumber in Spec https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/api/v1alpha1/inferencepool_types.go#L61 I may need to read more about the code to understand the diff BTW what is EPP abbrev for, it was ext-proc |
This is the targetPortNumber on the model servers. This issue is referring to the port number of the epp (ext-proc) pods that the proxy will use to communicate with via the ext-proc protocol.
EPP is an abbreviation of "endpoint picker". |
got it, i am not sure what is ExtensionReference for? Seems we donot care about it at all. It is just set to envoy ext-proc filter(by patch) rather than used by epp |
It is for the gateway controller that sets up the extension with the proxy. It needs to know where the extension is running to configure the proxy with the extension. |
/assign |
Thanks @hzxuzhonghu for working on this, note that this requires changing the api to v1alpha2; we can do that by simply renaming v1alpha1 to v1alpha2 since k8s deprecation policy allows deprecating an alpha API in the same release: https://kubernetes.io/docs/reference/using-api/deprecation-policy/ |
Are there anyother fields that need to be deprecated or mutated, i can change at the sametime |
If you'd like to take #379 , feel free! |
Ok, let me try to file a pr next monday |
In ExtensionReference in the InferencePool we name the port number TargetPortNumber, this is misleading since it should be the port number on the Service fronting the epp pods, not the port number on the epp pods themselves.
The text was updated successfully, but these errors were encountered: