stage11 stage13 issues

[Wujianting]

Hello, I have some problems need your help me.
In stage 11:

////////////////////////////////////////////////////////////////////////////////////
In stage 13:

Can you help me?
Thank you

[Natalia-T]

Hi @Wujianting,
For the first problem:

You can try to add to env.sh:
export PYTHONPATH=<your path>/anonymization_metrics:$PYTHONPATH

This is done in

Voice-Privacy-Challenge-2020/baseline/local/asv_eval.sh

Line 90 in 1dcdcda

PYTHONPATH=$(realpath ../anonymization_metrics) python local/scoring/linkability/compute_linkability.py \

Ideally, this should be in env.sh

[Natalia-T]

For the second problem, could you please attach the corresponding logs rescorelm.*.log?

[Wujianting]

对于第二个问题，能否附上相应的日志rescorelm.*.log？
rescorelm.1.log
rescorelm.2.log
rescorelm.3.log
rescorelm.4.log
rescorelm.5.log
rescorelm.6.log
rescorelm.7.log
rescorelm.8.log
rescorelm.9.log
rescorelm.10.log
rescorelm.11.log
rescorelm.12.log
rescorelm.13.log
rescorelm.14.log
rescorelm.15.log
rescorelm.16.log

That's all
Thank you for your help.

[Wujianting]

Hi @Wujianting, For the first problem:

You can try to add to env.sh: export PYTHONPATH=<your path>/anonymization_metrics:$PYTHONPATH

This is done in

Voice-Privacy-Challenge-2020/baseline/local/asv_eval.sh

Line 90 in 1dcdcda

PYTHONPATH=$(realpath ../anonymization_metrics) python local/scoring/linkability/compute_linkability.py \

Ideally, this should be in env.sh

I have successfully solved the problem of stage11. Thank you for your help.
Solution: I used git clone to download anonymization again_ metrics.
But I still haven't solved stage13. Please help me solve it in your spare time. Thank you very much.

[Natalia-T]

For the second problem, some of the processes were killed by the system as written in the logs, i.e., in rescorelm.1.log: 31838 Killed

[Wujianting]

对于第二个，一些被系统处理的问题，如日志中所写，rescorelm.1.log： 31838 Killed

Hello, let me make it clear that the second screenshot is the result of running stage13 only. Is there a necessary process for stage13 in the previous stage?
Do you mean that the whole process of stage 1-16 can not run continuously?

[Natalia-T]

To run Stage 13, Stage 12 (Make ASR evaluation subsets) should be completed; Stage 11 is not necessary for that.

In Stage 13, most of your 16 processes correctly worked, and some of them were killed by another process/service in your system. I can not say which service in your system and why killed some of the processes at Stage 13. Where did you run your scripts - on the cluster or work station?

[Wujianting]

要运行Stage 13，Stage 12（制作 ASR 评估子集）应该完成；Stage 11没有必要这样做。

在Stage 13中，您的 16 个进程中的大多数都正常工作，其中一些被系统中的另一个进程/服务杀死。我不能说你系统中的哪个服务以及为什么杀死了一些进程Stage 13。您在哪里运行脚本 - 在集群或工作站上？

I connect wsl2 through visual studio code on my computer to experiment.
This is my whole process, Please have a look. Thank you very much.

[Natalia-T]

What happens with the processes in wsl2 if the memory exceeds the available capacity? Would it kill the processes?
You can try to run decoding (and LM scoring) in 1 thread instead of 16.