pbstools 3.4.4

Changes:

• reaver cgroup awareness
• Various minor dagsub improvements and fixes
• pbsacct Python module handles tasks= requests in TORQUE 6.1.x accounting logs
• Proper logging in pbsacct data feed scripts (job-db-update, jobscript-to-db. sw_app-index, etc.)
• Several new pbsacct web reports, including moabstats and active-apps.
• Add start_count column to pbsacct Jobs table
• Add indices on {submit,eligible,start,end}_ts and start_count in pbsacct Jobs table

pbstools 3.4

Changes:

• Fixes in dagsub, pbs-spark-submit, and pbsacct web application
• Numerous software pattern additions to sw_app-index
• Improvements to pbsacct Python class for processing accounting logs, including an abstraction for talking to the pbsacct database
• The pbsacct web application now includes previously external PHP libraries to generate Excel and ODF spreadsheet files
• Prototype support for using other databases than MySQL for pbsacct, starting with SQLite
• Schema changes to pbsacct Jobs table:
• Add _seconds versions of time fields to work around MySQL limitations WRT times greater than 839 hours
• Add ngpus column
• Rewrite of several pbsacct database scripts in Python (with the old Perl versions moved to deprecated)
  • job-db-update
  • jobscript-to-db
  • js
  • spool-jobscripts
  • sw_app-index
• Prototype for pbsacct self-service interface where users can only see their jobs (or those of their groups and accounts):
• Deprecate fixup-nodect, jobstats, and find-outlyers
• Add TravisCI build support to test building parallel-command-processor and pbsdcp-scatter

3.2

Changes:

• Revision control moved to https://github.com/tabaer/pbstools
• Fixes to job-db-update, jobarray-script-update, jobscript-to-db, jobscript-watcher, pbs-spark-submit, and qpeek
• Add jobarray-to-pcp, a way to repackage a job array as a parallel-command-processor job
• Add Python classes for handling PBS accounting logs in a unified way
• Add many software package patterns to sw_app_index
• Add sw_app_cache and pbsacct Software table, used to cache the list of found values of sw_app, which accelerates software reports
• Add multiple ways to do date range matches, including start, end, and "during"
• Schema changes to pbsacct Jobs table
  • system to VARCHAR*32
  • jobid to VARCHAR*64
• Schema additions to pbsacct Jobs table
  • eligible_ts
  • eligible_date
  • cput_sec
  • cput_req_sec
  • walltime_sec
  • walltime_req_sec
  • more extensive indexing by dates
• Add pbsacct-dump
• Some OSC site-specific changes
• RPM packaging improvements