Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

removed normalized_avg_processors and created documentation on how to add it back #1981

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

rvtovar
Copy link

@rvtovar rvtovar commented Feb 11, 2025

Description

removed normalized_avg_processors from configuration/datawarehouse.d/ref/ gateways-statsitics.json and job-statistics.json, deleted jobs-norm-avg-proc-time.sql and jobs-norm-avg-proc-agg.sql from configuration/datawarehouse.d/include.

Then created howto-normalized-avg-processor.md on how to re add the statistic.

Motivation and Context

The statistic did not have much use and was a 100% correct because of the sql so it was removed with a documenation added to re add it if someone was interested in that statistic.

Tests performed

Re ran all the regression test on a aarch64 and x86_64 system.

Checklist:

  • The pull request description is suitable for a Changelog entry
  • The milestone is set correctly on the pull request
  • The appropriate labels have been added to the pull request

@rvtovar rvtovar added this to the 11.5.0 milestone Feb 11, 2025
@rvtovar rvtovar requested a review from jpwhite4 February 11, 2025 16:44
@rvtovar rvtovar self-assigned this Feb 11, 2025
@rvtovar
Copy link
Author

rvtovar commented Feb 12, 2025

When i was orginally removing normailzied_avg_processors i accidentally modified the shape of has_data_access.json which caused the component test to fail. After seeing that i went back in and used jq to fix the json to be in the shape that it is supposed to, Component Testing passes.

@rvtovar rvtovar marked this pull request as ready for review February 18, 2025 15:38
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think there should be a description at the top of this file explaining why the statistic was removed.

@@ -0,0 +1,90 @@
The Normalized Avg Processor statistic is available if you add the following JSON and SQL Files to the XDMoD project.
Copy link
Contributor

@aaronweeden aaronweeden Feb 19, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The Normalized Avg Processor statistic is available if you add the following JSON and SQL Files to the XDMoD project.
The "Job Size: Normalized" statistic can be restored if you modify/add the following JSON and SQL files to your installation of Open XDMoD. The files are located in `/etc/xdmod` unless you used a different prefix when installing Open XDMoD (e.g., `/opt/xdmod-{{ page.sw_version }}/etc`).

Comment on lines +3 to +4
1. Add the follwing to:
- configuration/datawarehouse.d/ref/Job-Statistics.json
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
1. Add the follwing to:
- configuration/datawarehouse.d/ref/Job-Statistics.json
Add the following to `datawarehouse.d/ref/Jobs-statistics.json`:

Comment on lines +22 to +23
2. Add the following to:
- configuration/datawarehouse.d/ref/Gateways-Statistics.json
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
2. Add the following to:
- configuration/datawarehouse.d/ref/Gateways-Statistics.json
2. Add the following to `datawarehouse.d/ref/Gateways-statistics.json`:

Comment on lines +34 to +35
3. Create a **jobs-norm-avg-proc-time.sql** in the following:
- configuration/datawarehouse.d/include/jobs-norm-avg-proc-time.sql
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
3. Create a **jobs-norm-avg-proc-time.sql** in the following:
- configuration/datawarehouse.d/include/jobs-norm-avg-proc-time.sql
3. Create the file `datawarehouse.d/include/Jobs-norm-avg-proc-time.sql`:

Comment on lines +63 to +64
4. create a **jobs-norm-avg-proc-agg.sql** at the follwing:
- configuration/datawarehouse.d/include/jobs-norm-avg-proc-agg.sql
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
4. create a **jobs-norm-avg-proc-agg.sql** at the follwing:
- configuration/datawarehouse.d/include/jobs-norm-avg-proc-agg.sql
4. Create the file `datawarehouse.d/include/Jobs-norm-avg-proc-agg.sql`:

@@ -8,3 +8,4 @@ The Open XDMoD HOWTOs are "how to" documents on specific subjects.
- [Change Metric Explorer Colors](howto-colors.html)
- [Enable Node Utilization Statistics](howto-node-utilization.html)
- [Reconstruct Slurm Accounting Logs](howto-reconstruct-slurm.html)
- [Add Normalize Avg Processors](howto-normalized-avg-processors.html)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- [Add Normalize Avg Processors](howto-normalized-avg-processors.html)
- [Restore the "Job Size: Normalized" statistic](howto-normalized-avg-processors.html)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants