Skip to content

Commit 4d9824a

Browse files
committed
add intro
1 parent d944753 commit 4d9824a

File tree

4 files changed

+28
-1
lines changed

4 files changed

+28
-1
lines changed

README.md

Lines changed: 28 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,28 @@
1-
# [Motion Consistency Model](https://yhzhai.github.io/mcm/)
1+
# [Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation](https://yhzhai.github.io/mcm/)
2+
3+
<a href='https://yhzhai.github.io/mcm/'><img src='https://img.shields.io/badge/Project-Page-Green'></a> <a href='https://arxiv.org/abs/2406.06890'><img src='https://img.shields.io/badge/Paper-arXiv-red'></a>
4+
5+
[Yuanhao Zhai](https://www.yhzhai.com/)<sup>1</sup>, [Kevin Lin](https://sites.google.com/site/kevinlin311tw/)<sup>2</sup>, [Zhengyuan Yang](https://zyang-ur.github.io)<sup>2</sup>, [Linjie Li](https://scholar.google.com/citations?hl=en&user=WR875gYAAAAJ)<sup>2</sup>, [Jianfeng Wang](http://jianfengwang.me)<sup>2</sup>, [Chung-Ching Lin](https://scholar.google.com/citations?hl=en&user=legkbM0AAAAJ)<sup>2</sup>, [David Doermann](https://cse.buffalo.edu/~doermann/)<sup>1</sup>, [Junsong Yuan](https://cse.buffalo.edu/~jsyuan/)<sup>1</sup>, [Lijuan Wang](https://scholar.google.com/citations?hl=en&user=cDcWXuIAAAAJ)<sup>2</sup>
6+
7+
**<sup>1</sup>State University of New Yort at Buffalo &nbsp; | &nbsp; <sup>2</sup>Microsoft**
8+
9+
**TL;DR**: Our motion consistency model not only accelerates text2video diffusion model sampling process, but also can benefit from an additional high-quality image dataset to improve the frame quality of generated videos.
10+
11+
![Our motion consistency model not only distill the motion prior from the teacher to accelerate sampling, but also can benefit from an additional high-quality image dataset to improve the frame quality of generated videos.](static/images/illustration.png)
12+
13+
**All training, inference, and evaluation code, as well as model checkpoints will be released in the coming two weeks. Please stay tuned!**
14+
15+
## :fire: News
16+
**[06/2024]** Paper and project page release.
17+
18+
## Citation
19+
```
20+
@article{zhai2024motion,
21+
title={Motion Consistency Model: Accelerating Video Diffusion with Disentangled
22+
Motion-Appearance Distillation},
23+
author={Zhai, Yuanhao and Lin, Kevin and Yang, Zhengyuan and Li, Linjie and Wang, Jianfeng and Lin, Chung-Ching and Doermann, David and Yuan, Junsong and Wang, Lijuan},
24+
year={2024},
25+
journal={arXiv preprint arXiv:2406.06890},
26+
website={https://yhzhai.github.io/mcm/},
27+
}
28+
```

static/images/hf.png

181 KB
Loading

static/images/illustration.png

1.05 MB
Loading

static/pdfs/mcm.pdf

4.87 MB
Binary file not shown.

0 commit comments

Comments
 (0)