the comfyui custom node of MuseTalk to make audio driven videos!
make sure ffmpeg is worked in your commandline
for Linux
apt update
apt install ffmpeg
for Windows,you can install ffmpeg by WingetUI automatically
then!
git clone https://github.com/AIFSH/ComfyUI-MuseTalk_FSH.git
cd ComfyUI-MuseTalk_FSH
pip install -r requirements.txt
pip install --no-cache-dir -U openmim
mim install mmengine
mim install "mmcv>=2.0.1"
mim install "mmdet>=3.1.0"
mim install "mmpose>=1.1.0" You can download weights manually as follows:
-
Download our trained weights.
-
Download the weights of other components:
或者下载MuseTalk.zip，
解压后把子文件夹放入ComfyUI-MuseTalk_FSH/models/目录
Finally, these weights should be organized in models as follows:
ComfyUI-MuseTalk_FSH/models/
├── musetalk
│ └── musetalk.json
│ └── pytorch_model.bin
├── dwpose
│ └── dw-ll_ucoco_384.pth
├── face-parse-bisent
│ ├── 79999_iter.pth
│ └── resnet18-5c106cde.pth
├── sd-vae-ft-mse
│ ├── config.json
│ └── diffusion_pytorch_model.bin
└── whisper
└── tiny.pt
