Skip to content

Commit 89512e6

Browse files
committed
Fix decoupled batch statistics to account for implicit batch size
1 parent bc16e1a commit 89512e6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/python_be.cc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1236,7 +1236,7 @@ ModelInstanceState::ProcessRequests(
12361236
uint64_t compute_end_ns = 0;
12371237
SET_TIMESTAMP(compute_end_ns);
12381238
reporter.SetComputeEndNs(compute_end_ns);
1239-
reporter.SetBatchStatistics(request_count);
1239+
reporter.SetBatchStatistics(total_batch_size);
12401240

12411241
if (response_batch.data_->has_error) {
12421242
if (response_batch.data_->is_error_set) {

0 commit comments

Comments
 (0)