[configgrpc] Remove deprecated ServerConfig.ToListener (#9583) #5

Job	Run time
govulncheck	1m 3s
setup-environment	38s
checks	1m 44s
test-coverage	8m 8s
lint	3m 15s
cross-build-collector (darwin, amd64)	36s
unittest-matrix (~1.22)	5m 5s
cross-build-collector (darwin, arm64)	41s
unittest-matrix (~1.21.5)	5m 8s
cross-build-collector (linux, 386)	44s
cross-build-collector (linux, amd64)	43s
cross-build-collector (linux, arm64)	40s
cross-build-collector (linux, ppc64le)	44s
cross-build-collector (linux, arm, 7)	41s
cross-build-collector (linux, s390x)	35s
cross-build-collector (windows, 386)	47s
cross-build-collector (windows, amd64)	39s
unittest	1s
	31m 52s

Provide feedback