Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Thicket postprocessing #70

Draft
wants to merge 15 commits into
base: develop
Choose a base branch
from
Draft

Thicket postprocessing #70

wants to merge 15 commits into from

Conversation

pearce8
Copy link
Collaborator

@pearce8 pearce8 commented Dec 11, 2023

Description

We will use Thicket for postprocessing performance results.

  • Caliper modifiers. Caliper modifier "mode" determines what data is available in the .cali files after the run.
  • Python (not ipython) script for "Canned" stacked plots in Thicket for "Plain" Caliper modifier
  • Propagate experiment info to Caliper (Dewi); strong/weak use MPI ranks on x-axis, throughput uses problem size
  • Add Caliper modifier for "Plain" + MPI; stacked plots should work for this as well
  • Add mechanism to archive .cali files (how long), trigger Thicket python script with ramble analyze
  • (later) post data on a dashboard

Dependencies: FIXME:Add a list of any dependencies.

Fixes issue(s): FIXME:Add list of relevant issues.

Type of Change

  • { } Adding a system, benchmark, or experiment
  • { } Modifying an existing system, benchmark, or experiment
  • { } Documentation update
  • { } Build/CI update
  • { } Benchpark core functionality

Checklist:

If adding/modifying a system:

  • { } Create a new directory for the system and a new system.py file
  • { } Add a new dry run unit test in .github/workflows
  • { } System appears in System Specifications table in docs catalogue section

If adding/modifying a benchpark:

  • { } Add a new application.py and (maybe) package.py under a new directory
    for this benchmark
  • { } Configure an experiment
  • { } Benchmark appears in Benchmarks and Experiments table in docs catalogue
    section

If adding/modifying a experiment:

  • { } Extend experiment.py under existing directory for specific benchmark
  • { } Define a single node and multi-node experiments

If adding/modifying core functionality:

  • { } Update docs
  • { } Update .github/workflows and .gitlab/ci unit tests (if needed)

We will use Thicket for postprocessing performance results.
- Caliper options used for the runs dictate what data is available in the .cali files after the run.
- We will probably want a "mode" of thicket per "mode" of Caliper.
- Working towards several dashboards:
--- performance over time
--- scaling
@pearce8 pearce8 added the feature New feature or request label Dec 11, 2023
@pearce8 pearce8 added this to the v0.1.1 milestone Dec 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants