This is one automation kit for Openstack swift performance measurement with COSBench, it leverages bash and perl scripts to help automate the one performance measure procedure, including setup/teardown storage cluster, kicking off load generation, processing performance statistics.
So far some parameters or actions are swift specific, tweaks are expected to adapt to your setup.
- Setting up no-password ssh/scp : BKM_setting up no-password rsh/scp
- check if ssh, scp, sar, iostat, vmstat, perl etc tools installed
- Modify NodeList, ProxyList, ClientList files to reflect your real settings.
- copy its software to the local Linux machine
- Modify NodeList: add the nodes (IP or hostname) which you want to monitor
- Modify header.sh : define configurable parameters for other shell use 2.1: RESULTDIR: define your own name of result directory
- Execute install.sh : for first run to install the scripts to the nodes in NodeList
- Modify run.sh: scripts for a single run 4.1: $COSBENCH for your COSBench path, $CONFIG_DIR and $CONFIG_LIST 4.2: $REMOTE_SERV and $REMOTE_DIR for where the data will be copied to
- summary_v1.0.xlsm: Excel spreadsheet for post-processing
- Modify all.sh: change this scripts for multiple run
run_sysstat.sh : to collect sar/iostat/vmstat data in the nodes in NodeList
stop_sysstat.sh : to stop collecting sar/iostat/vmstat data in the nodes in NodeList
process_sysstat.sh post-processing the sar/iostat/vmstat data
remote_copy.sh : to copy all the data from nodes in NodeList to the local machine
output : directory to hold results
verify.sh : to check whether the nodes in NodeList can be pinged, sshed, execute vmstat etc
clean_sysstat.sh: clean the log and csv file on remote hosts
- stop_sysstat.sh
- clean_sysstat.sh
- start_sysstat.sh
- kick off workload
- stop_sysstat.sh
- process_sysstat.sh
- remote_copy.sh
-
Failed to collect data in localhost A: Also need to enable no-password ssh/scp on localhost
-
Only collect data in one node, seems like don't start work on multi nodes A: need to add "-f" option to SSH command
== END