OpenESL: Sign Language Translation/Recognition using Event Camera

🎯 Update Log:

• [Aug-19, 2024] Event-CSL Benchmark Dataset for Sign Language Translation is released.

🎯 VECSL Benchmark Dataset

[arXiv:2503.06484] Sign Language Translation using Frame and Event Stream: Benchmark Dataset and Algorithms, Xiao Wang, Yuehang Li, Fuling Wang, Bo Jiang, Yaowei Wang, Yonghong Tian, Jin Tang, Bin Luo, arXiv:2503.06484 [Paper] [Demo Video (1:23sec)]

vecsl_github_demo.mp4

🎯 Event-CSL Benchmark Dataset

[arXiv:2408.10488] Event Stream-based Sign Language Translation: A High-Definition Benchmark Dataset and A Novel Baseline, Shiao Wang, Xiao Wang, Duoqing Yang, Yao Rong, Fuling Wang, Jianing Li, Lin Zhu, Bo Jiang, arXiv 2025,
[Paper]

sign_demo.mp4

Other Materials

• [Paper with code]: https://paperswithcode.com/task/sign-language-recognition/codeless
• [Awesome-Sign-Language]: https://github.com/ZechengLi19/Awesome-Sign-Language

📰 Citation

If you find this work helps your research, please star this GitHub and cite the following papers:

@misc{wang2025eventcsl,
      title={Event Stream-based Sign Language Translation: A High-Definition Benchmark Dataset and A Novel Baseline}, 
      author={Shiao Wang and Xiao Wang and Duoqing Yang and Yao Rong and Fuling Wang and Jianing Li and Lin Zhu and Bo Jiang},
      year={2025},
      eprint={2408.10488},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
}

@article{wang2025FESLT,
  title={Sign language translation using frame and event stream: Benchmark dataset and algorithms},
  author={Wang, Xiao and Li, Yuehang and Wang, Fuling and Jiang, Bo and Wang, Yaowei and Tian, Yonghong and Tang, Jin and Luo, Bin},
  journal={arXiv preprint arXiv:2503.06484},
  year={2025}
}

If you have any questions about these works, please feel free to leave an issue.