slurmacct

Slurm accounting report tools

Generate top user and group accounting statistics from Slurm as an alternative to the sreport command. The tools are:

slurmacct
topreports

slurmacct tool

Specific start and end Time/Date for the report may be specified. The default period is last month.

The -c option selects the current month until today, and -w selects the last week.

A specific user, group or node partition may be specified.

Output lines are sorted in order of decreasing usage, so it's easy to identify top users and groups.

The sreport command can show a top user report:

sreport user top start=0101 end=0110 TopCount=50 -t hourper --tres=cpu,gpu

but there are some advantages of slurmacct over the sreport command:

• Partition specific accounting is possible.

• Average CPU count (job parallelism) is printed.

• Average waiting time in the queue is printed (answer to "My jobs wait for too long").

• User full name is printed (useful to managers).

Usage: slurmacct [-s Start_time -e End_time | -c | -w | -m monthyear] [-p partition(s)] [-u username] [-g groupname] [-G] [-r report-directory] [-n] [-h]
where:
	-s Start_time [last month]: Starting time of accounting period.
	-e End_time [last month]: End time of accounting period.
	-m monthyear: Select month and year (like "november2019")
	-c: Current month
	-w: Last week
	-p partition(s): Select only Slurm partion <partition>[,partition2,...]
	-u username: Print only user <username> 
	-g groupname: Print only users in UNIX group <groupname>
	-G: Print only groupwise summed accounting data
	-r: Copy the report to a specified directory as well
	-n: No header information is printed
	-h: Print this help information

The Start_time and End_time values specify the date/time interval of
job completion/termination (see "man sacct").

Hint: Specify Start/End time as MMDD (Month and Date)

Time/Date format: MMDD (Month-Day)

Example

$ slurmacct -s 1201 -e 1231 -p xeon8

Jobs completed/terminated between date/time 1201 and 1231
Partition selected: xeon8
                             Wallclock          Average Average
Username    Group    #jobs       hours  Percent  #cpus  q-hours  Full name
--------    -----  ------- -----------  ------- ------- -------  ---------
   TOTAL    (All)    38189   2511099.3   100.00    0.00   21.60  
  user01   group1      621    492932.0    19.63   16.00   26.16  Name 1
  user02   group2      547    431252.9    17.17   16.00   29.55  Name 2
  user03   group3      423    349400.0    13.91   16.00   74.40  Name 3
  ...

topreports tool

The topreports tool uses slurmacct to generate specific useful reports. It may be executed daily to get updated weekly and monthly reports.

topreports [monthyear]

By default 3 report periods will be generated: Last month, current month, and current week. The optional monthyear argument selects month and year (like "november2019")

You have to configure two items in the script:

• Directory and report file name prefix: PREFIX

• Partion list: similar, overlapping partitions are comma-separated