Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: New TSA/TSB tests take a long time (15+ hours) and generate a lot of logs (50+ GB) #15830

Open
arista-nwolfe opened this issue Dec 2, 2024 · 0 comments
Assignees
Labels

Comments

@arista-nwolfe
Copy link
Contributor

Issue Description

Two bgp tests (test_startup_tsa_tsb_service.py and test_reliable_tsa.log) were added in #13290
These two tests take a long time to run on a T2 and generate very large log files.

Results you see

The size of the files: 21GB and 30GB

-rw-r--r--  1 nwolfe nwolfe 21757082711 Nov 25 17:36  test_startup_tsa_tsb_service.log
-rw-r--r--  1 nwolfe nwolfe 30412758340 Nov 25 17:30  test_reliable_tsa.log

The length of the tests:

test_startup_tsa_tsb_service.py: ~8 hours

Individual testlet lengths:
bgp/test_startup_tsa_tsb_service.py:

bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_dut_cold_reboot[cmp206-4] - 00:35:36
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_dut_abnormal_reboot[cmp206-4] - 00:33:09
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_user_init_tsa[cmp206-4] - 00:28:34
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_user_init_tsa_while_service_run_on_dut[cmp206-4] - 00:23:36
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_user_init_tsb_while_service_run_on_dut[cmp206-4] - 00:22:27
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_timer_efficiency[cmp206-4] - 00:33:09
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_dut_cold_reboot[cmp206-6] - 00:38:40
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_dut_abnormal_reboot[cmp206-6] - 00:31:49
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_user_init_tsa[cmp206-6] - 00:26:44
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_user_init_tsa_while_service_run_on_dut[cmp206-6] - 00:22:03
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_user_init_tsb_while_service_run_on_dut[cmp206-6] - 00:21:20
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_timer_efficiency[cmp206-6] - 00:31:58
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_supervisor_cold_reboot[cmp206] - 00:24:25
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_supervisor_abnormal_reboot[cmp206] - 00:48:52
bgp/test_startup_tsa_tsb_service.py::test_startup_tsa_tsb_service::test_tsa_tsb_service_with_tsa_on_sup[cmp206] - 00:51:10

test_reliable_tsa.py

bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsa_act_when_sup_duts_on_tsb_initially[cmp206] - 00:20:26
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsa_act_when_sup_on_tsb_duts_on_tsa_initially[cmp206] - 00:18:37
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsb_act_when_sup_on_tsa_duts_on_tsb_initially[cmp206] - 00:39:31
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsb_act_when_sup_and_duts_on_tsa_initially[cmp206] - 00:18:43
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsa_act_when_sup_duts_on_tsb_initially[cmp206] - 00:27:54
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsa_act_when_sup_on_tsa_duts_on_tsb_initially[cmp206] - 00:32:11
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsb_act_when_sup_on_tsb_duts_on_tsa_initially[cmp206] - 00:21:43
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsb_act_when_sup_and_duts_on_tsa_initially[cmp206] - 00:24:09
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsa_act_with_sup_reboot[cmp206] - 00:41:17
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsa_act_when_duts_on_tsa_with_sup_config_reload[cmp206] - 00:25:03
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsa_act_with_reboot_when_sup_dut_on_tsb_init[cmp206] - 00:38:25
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsa_with_conf_reload_when_sup_on_tsa_dut_on_tsb_init[cmp206] - 00:37:54
bgp/test_reliable_tsa.py::test_reliable_tsa::test_user_init_tsa_on_dut_followed_by_sup_tsa[cmp206] - 00:19:10
bgp/test_reliable_tsa.py::test_reliable_tsa::test_user_init_tsa_on_dut_followed_by_sup_tsb[cmp206] - 00:19:04
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsa_when_startup_tsa_tsb_service_running[cmp206] - 00:57:30
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsb_when_startup_tsa_tsb_service_running[cmp206] - 00:36:13
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsb_followed_by_dut_bgp_restart_when_sup_on_tsa_duts_on_tsb[cmp206] - 00:22:33
bgp/test_reliable_tsa.py::test_reliable_tsa::test_sup_tsb_followed_by_dut_bgp_restart_when_sup_and_duts_on_tsa[cmp206] - 00:31:59
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsb_followed_by_dut_bgp_restart_when_sup_on_tsb_duts_on_tsa[cmp206] - 00:23:28
bgp/test_reliable_tsa.py::test_reliable_tsa::test_dut_tsb_followed_by_dut_bgp_restart_when_sup_and_duts_on_tsa[cmp206] - 00:32:36

Results you expected to see

Tests to not take so much time and generate so much logs.

Is it platform specific

generic

Relevant log output

No response

Output of show version

No response

Attach files (if any)

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: No status
Development

No branches or pull requests

3 participants