Envoy failing to successfully connect dataplane connections

[praveingk]

I see that dataplane-type envoy fails intermittently after to connect a remote service to local app.

Try to run demo/iperf3/kind/test.py

ubuntu@clink-test:~/clusterlink/demos/iperf3/kind$ kubectl exec -i iperf3-client-cxbd2 --  iperf3 -c iperf3-server -p 5000
Connecting to host iperf3-server, port 5000
[  5] local 10.244.0.9 port 33258 connected to 10.96.223.215 port 5000
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   378 MBytes  3.17 Gbits/sec    0    752 KBytes       
[  5]   1.00-2.00   sec   357 MBytes  2.99 Gbits/sec    0   1.34 MBytes       
[  5]   2.00-3.00   sec   369 MBytes  3.10 Gbits/sec    0   1.55 MBytes       
[  5]   3.00-4.00   sec   349 MBytes  2.93 Gbits/sec    1   1.70 MBytes       
[  5]   4.00-5.00   sec   392 MBytes  3.28 Gbits/sec    0   2.64 MBytes       
[  5]   5.00-6.00   sec   317 MBytes  2.66 Gbits/sec    1   2.64 MBytes       
[  5]   6.00-7.00   sec   348 MBytes  2.93 Gbits/sec    0   2.64 MBytes       
[  5]   7.00-8.00   sec   341 MBytes  2.86 Gbits/sec   90   2.64 MBytes       
[  5]   8.00-9.00   sec   360 MBytes  3.02 Gbits/sec    0   2.64 MBytes       
[  5]   9.00-10.00  sec   375 MBytes  3.14 Gbits/sec    1   2.64 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  3.50 GBytes  3.01 Gbits/sec   93             sender
[  5]   0.00-10.31  sec  3.28 GBytes  2.73 Gbits/sec                  receiver

iperf Done.
ubuntu@clink-test:~/clusterlink/demos/iperf3/kind$ kubectl exec -i iperf3-client-cxbd2 --  iperf3 -c iperf3-server -p 5000
iperf3: error - unable to receive control message - port may not be available, the other side may have stopped running, etc.: Connection reset by peer
command terminated with exit code 1
ubuntu@clink-test:~/clusterlink/demos/iperf3/kind$ kubectl exec -i iperf3-client-cxbd2 --  iperf3 -c iperf3-server -p 5000
iperf3: error - unable to receive control message - port may not be available, the other side may have stopped running, etc.: Connection reset by peer
command terminated with exit code 1
ubuntu@clink-test:~/clusterlink/demos/iperf3/kind$ kubectl exec -i iperf3-client-cxbd2 --  iperf3 -c iperf3-server -p 5000
iperf3: error - unable to receive control message - port may not be available, the other side may have stopped running, etc.: Connection reset by peer
command terminated with exit code 1
ubuntu@clink-test:~/clusterlink/demos/iperf3/kind$ kubectl exec -i iperf3-client-cxbd2 --  iperf3 -c iperf3-server -p 5000
Connecting to host iperf3-server, port 5000
[  5] local 10.244.0.9 port 50464 connected to 10.96.223.215 port 5000
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   342 MBytes  2.86 Gbits/sec    0   1.35 MBytes       
[  5]   1.00-2.00   sec   374 MBytes  3.14 Gbits/sec  167   1.68 MBytes       
[  5]   2.00-3.00   sec   304 MBytes  2.55 Gbits/sec    0   1.68 MBytes       
[  5]   3.00-4.00   sec   333 MBytes  2.79 Gbits/sec    0   1.68 MBytes       
[  5]   4.00-5.00   sec   376 MBytes  3.16 Gbits/sec    0   1.68 MBytes       
[  5]   5.00-6.00   sec   349 MBytes  2.92 Gbits/sec    0   1.68 MBytes       
[  5]   6.00-7.00   sec   326 MBytes  2.75 Gbits/sec    0   1.69 MBytes       
[  5]   7.00-8.00   sec   358 MBytes  3.01 Gbits/sec    0   1.69 MBytes       
[  5]   8.00-9.00   sec   270 MBytes  2.26 Gbits/sec    1   1.69 MBytes       
[  5]   9.00-10.00  sec   339 MBytes  2.84 Gbits/sec  404   1.70 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  3.29 GBytes  2.83 Gbits/sec  572             sender
[  5]   0.00-10.01  sec  3.03 GBytes  2.60 Gbits/sec                  receiver

iperf Done.

[orozery]

Can you specify the full set of commands to run, assuming a freshly cloned repo?

I tried the following which works:
./demos/iperf3/kind/test.py

then kubectl exec -i iperf3-client-5z4q8 -- iperf3 -c iperf3-server -p 5000 which I copied from the output of the previous command.
Ran a few times and all were successful.