Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a metric to track InferenceModels ready to serve by the epp #598

Open
ahg-g opened this issue Mar 28, 2025 · 0 comments
Open

Add a metric to track InferenceModels ready to serve by the epp #598

ahg-g opened this issue Mar 28, 2025 · 0 comments
Labels
good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.

Comments

@ahg-g
Copy link
Contributor

ahg-g commented Mar 28, 2025

What would you like to be added:

A metric tracking the InferenceModels ready to serve by the epp

Why is this needed:

When rolling out a new model adapter, there is currently no update on the InferenceModel status indicating if the epp became aware of it. We decided that the epp should not update the status of the object since it is the responsibility of a control plane component. However, it is still important operationally to expose what inferenceModels the epp is aware of.

@ahg-g ahg-g added good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. labels Apr 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.
Projects
None yet
Development

No branches or pull requests

1 participant