Skip to content

Update installation.md #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update installation.md #13

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 0 additions & 16 deletions installation.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,29 +30,13 @@ Inside the Docker container:
# singularity exec ./ecp.simg /bin/bash --rcfile /etc/bash.bashrc
# which spack
```
Replacing MPI On Theta at ALCF: Allocate two nodes:
```
% qsub -A <PROJECT_ID> -t 30 -n 2 -q debug-cache-quad -I
% /projects/ECP_SDK/tutorial/run_job.sh
% cat /projects/ECP_SDK/tutorial/run_job.sh
module swap PrgEnv-intel PrgEnv-gnu
module swap cray-mpich cray-mpich-abi
export SINGULARITYENV_LIBWLM_DETECT=/opt/cray/wlm_detect/1.3.2-6.0.6.0_3.8__g388ccd5.ari/lib64
aprun -n 16 -N 8 singularity exec -H $HOME -B /projects/ECP_SDK:/projects/ECP_SDK:ro -B /opt:/opt:ro -B /var/opt:/var/opt:ro /projects/ECP_SDK/containers/singularity/ecp.simg bash -c 'unset CRAYPE_VERSION; source /usr/local/packages/ecp/misc/bashrc; spack load -r trilinos tau ;spack unload openmpi mpich ; export LD_LIBRARY_PATH=$LIBWLM_DETECT:$CRAY_LD_LIBRARY_PATH:$CRAYPAT_LD_LIBRARY_PATH:$LD_LIBRARY_PATH ; /projects/ECP_SDK/tutorial/demo/trilinos/Zoltan/Zoltan; '
```

### Shifter

Replacing MPI with system MPI on Cori at NERSC:
```
# shifterimg -v pull docker:ecpe4s/e4s-gpu:22.02
# shifter -E --image=ecpe4s/e4s-gpu:22.02 -- /bin/bash --rcfile /etc/bash.bashrc
# which spack

# shifterimg images | grep exascaleproject

# salloc -N 2 -q interactive -t 00:30:00 --image=ecpe4s/e4s-gpu:22.02 -C haswell -L SCRATCH
# srun -n 32 shifter -- /bin/bash -c 'unset CRAYPE_VERSION; . /etc/bash.bashrc ; spack load trilinos; spack unload openmpi mpich; ./Zoltan'
```

Please contact Sameer Shende at sameer [at] cs.uoregon.edu if you have any questions.