Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPIKE] Document Localnet feature paths for E2E tests #492

Open
11 tasks
jessicadaugherty opened this issue Feb 6, 2023 · 4 comments
Open
11 tasks

[SPIKE] Document Localnet feature paths for E2E tests #492

jessicadaugherty opened this issue Feb 6, 2023 · 4 comments
Assignees
Labels
documentation Improvements or additions to documentation triage It requires some decision-making at team level (it can't be worked on as it stands)

Comments

@jessicadaugherty
Copy link
Contributor

jessicadaugherty commented Feb 6, 2023

Objective

Improve and expand the definition of E2E localnet test paths for stress, chaos, and other types of testing to ensure the robustness of the network. A set of well-defined test paths will enable the team to identify potential weaknesses and improve the overall stability before deploying to testnet.

Origin Document

MVT Features

Goals

  • Harden V1 for testnet by identifying and addressing potential vulnerabilities and weaknesses.
  • Establish a comprehensive set of test paths for each module, covering various scenarios and edge cases.

Deliverables

  • Review the current test paths and note any areas for improvement or gaps in coverage here.
  • Enhance existing feature paths with more detail and clarity, ensuring they comprehensively cover each module's feature sets.
  • Identify and document additional test scenarios, including edge cases, potential vulnerabilities, and stress/chaos scenarios, for each module.
  • Outline testing priorities per module

Non-goals / Non-deliverables

  • Designing or writing tests

General issue deliverables

  • Update the appropriate CHANGELOG
  • Update any relevant READMEs (local and/or global)
  • Update any relevant global documentation & references
  • If applicable, update the source code tree explanation
  • If applicable, add or update a state, sequence or flowchart diagram using mermaid

Testing Methodology

  • All tests: make test_all
  • LocalNet: verify a LocalNet is still functioning correctly by following the instructions at docs/development/README.md

Creator: @jessicadaugherty

@jessicadaugherty jessicadaugherty converted this from a draft issue Feb 6, 2023
@jessicadaugherty jessicadaugherty moved this to Backlog in V1 Dashboard Feb 6, 2023
@jessicadaugherty jessicadaugherty changed the title [WIP] Document Unhappy E2E Localnet Paths to be Defined [CHORE] Document Unhappy E2E Localnet Paths to be Defined Feb 10, 2023
@jessicadaugherty jessicadaugherty self-assigned this Feb 10, 2023
@jessicadaugherty jessicadaugherty added the documentation Improvements or additions to documentation label Feb 10, 2023
@jessicadaugherty jessicadaugherty changed the title [CHORE] Document Unhappy E2E Localnet Paths to be Defined [CHORE] Document E2E Localnet Paths to be Defined Feb 22, 2023
@jessicadaugherty
Copy link
Contributor Author

Repurpose into spike for chaos and stress testing

@jessicadaugherty jessicadaugherty changed the title [CHORE] Document E2E Localnet Paths to be Defined [SPIKE] Document E2E Localnet Paths to be Defined Mar 28, 2023
@jessicadaugherty
Copy link
Contributor Author

Note to self: discuss guidelines with team (and ownership):

  • Design best practices
  • Avoiding redundancies/modular tests
  • Data sources
  • Prioritization
  • Automation
  • Frequency
  • Reporting standardization

@jessicadaugherty jessicadaugherty added the triage It requires some decision-making at team level (it can't be worked on as it stands) label Mar 28, 2023
@jessicadaugherty jessicadaugherty changed the title [SPIKE] Document E2E Localnet Paths to be Defined [SPIKE] Document Localnet feature paths for E2E tests Apr 18, 2023
@jessicadaugherty
Copy link
Contributor Author

Iteration 15 Planning: @team please check criteria. Lmk if we should have a more explicit deliverable re: scenario coverage (e.g. if the goal should be just to identify paths for must have testnet features)

@bryanchriswhite bryanchriswhite moved this from Backlog to Up Next in V1 Dashboard Apr 19, 2023
@Olshansk Olshansk assigned dylanlott and unassigned deblasis Apr 19, 2023
@Olshansk
Copy link
Member

Iteration 15 Planning: @team please check criteria. Lmk if we should have a more explicit deliverable re: scenario coverage (e.g. if the goal should be just to identify paths for must have testnet features)

I think the deliverables are still a bit too ambiguous and broad, especially because V1 E2E Paths ended up being more of a brainstorming workshop of how to write tests using LLMs rather than defining actual test cases.

Going to think about it for another day or two and update by EOW.

@bryanchriswhite bryanchriswhite moved this from Up Next to In Progress in V1 Dashboard May 31, 2023
@bryanchriswhite bryanchriswhite moved this from In Progress to Up Next in V1 Dashboard Jun 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation triage It requires some decision-making at team level (it can't be worked on as it stands)
Projects
Status: Up Next
Development

No branches or pull requests

8 participants