The pd leader occupies a large amount of cpu

[Linzai99]

Bug Report

use tikv-client get region info from pd server, GetRegion QPS 66k, leader CPU 3600%, Goroutine count 244k

What did you do?

pressure test on online tikv culster

What did you expect to see?

Load balancing and low resource usage

What did you see instead?

GetRegion QPS 66k, leader CPU 3600%, Goroutine count 244k

What version of PD are you using (pd-server -V)?

pd-server v8.1.0，tikv-client v2.0.7

[rleungx]

Is there any profile?

[Linzai99]

Is there any profile?

get profile and goroutine in the zip file
profile.zip

[rleungx]

I think most of the CPU is occupied by handling gRPC requests since right now the GetRegion is an unary call. We are working on changing it to a streaming call, which could be help for this case.