Fix: Correct num_requests in benchmark for Pipeline Parallel Serving #6721
Job | Run time |
---|---|
1s | |
9s | |
4s | |
7s | |
3s | |
2s | |
2s | |
1m 27s | |
1m 11s | |
1m 19s | |
5m 1s | |
1m 13s | |
1m 56s | |
0s | |
0s | |
12m 35s |
Job | Run time |
---|---|
1s | |
9s | |
4s | |
7s | |
3s | |
2s | |
2s | |
1m 27s | |
1m 11s | |
1m 19s | |
5m 1s | |
1m 13s | |
1m 56s | |
0s | |
0s | |
12m 35s |