Add an integration test on traffic splitting behavior

[liu-cong]

Hermetic test is a fast way to verify functionality without requiring a real cluster.

We should test the traffic splitting between target models. A potential approach is to send a large number of requests (say 10000), and verify the traffic split ratio within a certain threshold.