-
Notifications
You must be signed in to change notification settings - Fork 1
Home
This wiki talks about ways to compare the accounting records at your site to the accounting records stored in APEL. It is based on the system we developed at Liverpool, but it is intended to be both portable and extensible. If the batch system or CE at your site is not covered by any of the sections, we encourage you to extend to software using similar scripts and techniques to those presented. Andrew McNab (Andrew.Mcnab@cern.)ch can give you write access to the repository for bug fixes and new methods.
For the time being, I recommended to install this software directly from github repo as follows:
git clone https://:@github.com/gridpp/audit.git
The nodes that need the software will be described in specific sections late.
You'll need a Linux system with a browser for this step. Login as root and install the software, as described above, off the /root directory or somewhere like that.
Start the browser and go to the next EGI accounting portal
https://accounting-next.egi.eu/
In the web page, click Research Infrastructure, Tier 2 ...
In the Row Variable, select Submit Host, and chose start time, end time, which is usually one month, e.g. Oct 2016 to Oct 2016. This is not as meaningless as it looks - it means the start of Oct to the end of Oct.
You will make two runs of the report. On the first run, select metric as Number of Jobs and click update. Below the table is a button to download the data as CSV. Do so, and save the file in ~/audit/APEL/, calling the file jobcount.csv.
On the second run, select metric as Normalised Sum of Elapsed * Number of Processors, Again, click Update and save the data as a CSV, calling the file hs06.csv this time.
On the command line, for each of your submit host, run this:
$ ./totals.pl hs06.csv hepgrid97
Numeric column totals:
1859428.0362 1859428 0.09
$ ./totals.pl jobcount.csv hepgrid97
Numeric column totals:
76217 76217 0.23
This means that, for the hepgrid97 .ph.liv.ac.uk CE, APEL knows of 76217 jobs, and thinks they did 1,859,428 HS06 Hours of work.
Do that for all your CEs/Submit hosts. Where you are using VAC, put in the leading characters of the VAC hostname; for Liverpool, this would be like this:
$ ./totals.pl hs06.csv vac01.ph.liv.ac.uk
Numeric column totals:
484434.3381 484435 0
$ ./totals.pl jobcount.csv vac01.ph.liv.ac.uk
Numeric column totals:
111806 111806 0.31
The work for each VAC factory is totalled, and this shows that APEL knows of 111806 jobs, and thinks they did 484,434 HS06 Hours of work.
TBD