Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add integration tests on error cases #325

Open
5 tasks
Tracked by #362
liu-cong opened this issue Feb 12, 2025 · 0 comments
Open
5 tasks
Tracked by #362

Add integration tests on error cases #325

liu-cong opened this issue Feb 12, 2025 · 0 comments
Labels
help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.

Comments

@liu-cong
Copy link
Contributor

liu-cong commented Feb 12, 2025

Hermetic test is a fast way to verify functionality e2e without requiring a real cluster.

Add the following cases to make sure the EPP can correctly handle the errors.

  • Test when requested model is not found in InferenceModel
  • Test InferenceModel has a different InferencePool than the poolName flag passed to EPP - this should be the same as the InferenceModel doesn't exist
  • Test when no backend pods are available
  • Test invalid request payload (e.g., doesn't contain "model")
  • Test backend server error, client should receive an error with an appropriate error code
@kfswain kfswain added help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. labels Feb 19, 2025
@ahg-g ahg-g mentioned this issue Feb 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
Projects
None yet
Development

No branches or pull requests

2 participants