fix some ip can not allocate after released #10759

Job	Run time
Build centos-compile	1m 55s
Build kube-ovn-base	4s
Build E2E Binaries	1m 39s
Build vpc-nat-gateway	13s
Network Policy Path Filter	0s
Build kube-ovn	1m 35s
Kubernetes Conformance E2E	1s
Chart Installation Test	1s
Installation Compatibility Test	1s
Kubernetes Network Policy E2E	1s
Cyclonus Network Policy E2E	1s
Kubernetes Network Policy Legacy E2E	1s
Kube-OVN Conformance E2E	1s
Kube-OVN IC Conformance E2E	1s
LB Service E2E	1s
Disable Network Policy Test	1s
Disable OVN LB Test	1s
Underlay Logical Gateway Installation Test	1s
Cilium Chaining E2E	1s
Kube-OVN HA E2E	1s
Push Images	1s
	5m 41s

Provide feedback