Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Analysis tab for sketch editor #10

Open
daemontus opened this issue Jun 29, 2023 · 2 comments
Open

Analysis tab for sketch editor #10

daemontus opened this issue Jun 29, 2023 · 2 comments
Milestone

Comments

@daemontus
Copy link
Member

Here, we can compute various results for a particular network sketch.

However, I'm not quite sure if this is the best course of action. These results would be invalid once the sketch changes, plus it does not make sense why these are all on one tab.

Maybe a better approach would be to have these analysis tools as separate "workflow windows"?

Also, we should think about the ability to offload tasks to a separate machine (maybe even pause/resume?).

@daemontus daemontus added this to the 1.0.0 milestone Jun 29, 2023
@ondrej33
Copy link
Member

ondrej33 commented Aug 8, 2024

A prototype of an analysis workflow was added in #47. At the moment, there is an "analysis tab" in the editor window, which allows for the starting of a new window for a particular analysis. This analysis workflow uses a "frozen" variant of the sketch, so the subsequent changes made in the editor do not invalidate the results. We can add some option to explicitly reload the sketch though.

At the moment, we only have a partial inference analysis (that processes a PSBN, basic regulations' properties and HCTL properties). It serves as a first step and a demonstration of a workflow. The user starts the inference with a button, a basic "wait" message appears, and once finished, a summary of results/computation appears. Users can then sample candidate networks. There is a button to restart the analysis.

We should as soon as possible:

  • Extend the inference to consider all parts of the sketch (generic static properties and template dynamic properties).
  • Add consistency check at the beginning (Sketch consistency check (before analysis) #45).
  • Implement the variant of inference that only considers static properties to have at least two different (modular) working analyses.
  • Add some more advanced details about results (project number of candidates onto individual functions).
  • Improve the UI of the inference.
  • Handle the situation when there are no satisfactory candidates.

Further improvements could include a button for reloading the current version of the sketch from the editor, opening a new editor session with the candidate network, or allowing the user to select which properties to run inference with. But there are, of course, many more.

@ondrej33
Copy link
Member

ondrej33 commented Nov 19, 2024

The inference workflow now supports all the necessary functionality for the initial release (as of #56). There are some additional tasks that we could tackle in future:

  • Add visualization of the results, perhaps through decision trees.
  • Allow the user to select a subset of properties for the inference.
  • Make the inference into a step-by-step iterative workflow, where intermediate results can be computed and then used for follow-up computations.

Another task is to extend the Analysis tab with more types of analyses.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants