-
Notifications
You must be signed in to change notification settings - Fork 1.4k
test: add kv cache event tests for disagg workers #3602
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
/bot run |
PR_Github #2429 [ run ] triggered by Bot |
PR_Github #2429 [ run ] completed with state |
7502595
to
1c81fab
Compare
/bot run |
PR_Github #2452 [ run ] triggered by Bot |
PR_Github #5 [ run ] triggered by Bot |
PR_Github #5 [ run ] completed with state |
PR_Github #2452 [ run ] completed with state |
/bot run |
PR_Github #2540 [ run ] triggered by Bot |
PR_Github #2540 [ run ] completed with state |
/bot run |
PR_Github #2579 [ run ] triggered by Bot |
PR_Github #2579 [ run ] completed with state |
/bot run |
PR_Github #2624 [ run ] triggered by Bot |
PR_Github #2624 [ run ] completed with state |
/bot run |
PR_Github #2695 [ run ] triggered by Bot |
PR_Github #2695 [ run ] completed with state |
Signed-off-by: Zheng Duan <[email protected]>
Signed-off-by: Zheng Duan <[email protected]>
Signed-off-by: Zheng Duan <[email protected]>
3a54f12
to
419586e
Compare
/bot reuse-pipeline |
PR_Github #2761 [ reuse-pipeline ] triggered by Bot |
PR_Github #2761 [ reuse-pipeline ] completed with state |
This PR introduces new tests for some features required by kv cache aware routing on disaggregate serving.
This PR also fixed the issue that
LLM.get_kv_cache_events
returnsList[List[dict]]
instead of type annotatedList[dict]
and updated tests accordingly.