Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pangenome-aware-wgs-bwa-case doesn't run successfully. #940

Open
Jiawei-Shen opened this issue Feb 27, 2025 · 1 comment
Open

pangenome-aware-wgs-bwa-case doesn't run successfully. #940

Jiawei-Shen opened this issue Feb 27, 2025 · 1 comment

Comments

@Jiawei-Shen
Copy link

I followed the pangenome-aware-wgs-bwa-case-study.md to run the code.
But since I am using LSF (Load Sharing Facility) cluster, I change the code

mkdir -p output
mkdir -p output/intermediate_results_dir

BIN_VERSION="pangenome_aware_deepvariant-1.8.0"

sudo docker pull google/deepvariant:"${BIN_VERSION}"

sudo docker run \
  -v "${PWD}/input":"/input" \
  -v "${PWD}/output":"/output" \
  -v "${PWD}/reference":"/reference" \
  --shm-size 12gb \
  google/deepvariant:"${BIN_VERSION}" \
  /opt/deepvariant/bin/run_pangenome_aware_deepvariant \
  --model_type WGS \
  --ref /reference/GRCh38_no_alt_analysis_set.fasta \
  --reads /input//HG003.novaseq.pcr-free.35x.dedup.grch38_no_alt.chr20.bam  \
  --pangenome /input/hprc-v1.1-mc-grch38.gbz \
  --output_vcf /output/HG003.output.vcf.gz \
  --output_gvcf /output/HG003.output.g.vcf.gz \
  --num_shards $(nproc) \
  --regions chr20 \
  --intermediate_results_dir /output/intermediate_results_dir

to

export LSF_DOCKER_SHM_SIZE=64g
bsub -Is -G compute-epigenome-condo -R 'gpuhost' -gpu "num=1" -q epigenome-interactive \
  -a 'docker(google/deepvariant:pangenome_aware_deepvariant-1.8.0)' \
  /opt/deepvariant/bin/run_pangenome_aware_deepvariant \
    --model_type WGS \
    --ref /reference/GRCh38_no_alt_analysis_set.fasta \
    --reads /input/HG003.novaseq.pcr-free.35x.dedup.grch38_no_alt.chr20.bam \
    --pangenome /input/hprc-v1.1-mc-grch38.gbz \
    --output_vcf /output/HG003.output.vcf.gz \
    --output_gvcf /output/HG003.output.g.vcf.gz \
    --num_shards 16 \
    --regions chr20 \
    --intermediate_results_dir /output/intermediate_results_dir

But the terminal outputs:

Image
and no other outputs then.

I checked the share_memeory and it crushed like this.:
Image

Do you know why this doesn't work?

@kishwarshafin
Copy link
Collaborator

Hi @Jiawei-Shen can you please share the full log? It doesn't look like the memory loading crashed, those are warnings that can be ignored. Are you seeing make_examples fail?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants