You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A metric emitted by the EPP to track the number of ready pods from the EPP PoV.
Why is this needed:
The EPP doesn't own the status of the InferencePool object, so it can't keep track of that there. Having a metric to track the number of ready pods is important for operators to track rollouts.
The text was updated successfully, but these errors were encountered:
We probably should plan to break that metric down by attributes the pool is aware of (i.e. not O(pods), but O(groups of pods under the pool)). We don't have such a label, but I can already see ones coming up like heterogenity and assignment.
What would you like to be added:
A metric emitted by the EPP to track the number of ready pods from the EPP PoV.
Why is this needed:
The EPP doesn't own the status of the InferencePool object, so it can't keep track of that there. Having a metric to track the number of ready pods is important for operators to track rollouts.
The text was updated successfully, but these errors were encountered: