Repositories list

• VideoGen-Eval

  Public
  The Dawn of Video Generation: Preliminary Explorations with SORA-like Models

  benchmarkvideo-generationimage-to-video+ 5text-to-videoaigcvideo-to-videovideo-evaluationsora-video-ai

  MIT License

  •4•120•0•0•Updated Nov 14, 2024Nov 14, 2024

• YOLO-World

  Public
  [CVPR 2024] Real-Time Open-Vocabulary Object Detection

  Python

  •

  GNU General Public License v3.0

  •454•4.7k•304•7•Updated Nov 5, 2024Nov 5, 2024

• CV-VAE

  Public
  [NeurIPS 2024] CV-VAE: A Compatible Video VAE for Latent Generative Video Models

  Jupyter Notebook

  •8•243•16•0•Updated Nov 1, 2024Nov 1, 2024

• SEED-X

  Public
  Multimodal Models in Real World

  Jupyter Notebook

  •

  Other

  •16•403•21•0•Updated Oct 28, 2024Oct 28, 2024

• UniRepLKNet

  Public
  [CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

  deep-learningarchitectureartificial-intelligence+ 2convolutional-neural-networksmultimodal-learning

  Python

  •

  Apache License 2.0

  •54•938•5•0•Updated Oct 24, 2024Oct 24, 2024

• SEED

  Public
  Official implementation of SEED-LLaMA (ICLR 2024).

  multimodalvision-languagefoundation-model

  Python

  •

  Other

  •31•579•32•2•Updated Sep 21, 2024Sep 21, 2024

• VL-GPT

  Public
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation

  Apache License 2.0

  •2•85•2•0•Updated Sep 12, 2024Sep 12, 2024

• HiFi-123

  Public
  [ECCV 2024] HiFi-123: Towards High-fidelity One Image to 3D Content Generation

  Python

  •0•59•0•0•Updated Jul 12, 2024Jul 12, 2024

• FreeNoise

  Public
  [ICLR 2024] Code for FreeNoise based on VideoCrafter

  generative-modeldiffusionaigc+ 1video-diffusion-model

  Python

  •

  Apache License 2.0

  •24•386•8•1•Updated Jul 11, 2024Jul 11, 2024

• SEED-Bench

  Public
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.

  Python

  •

  Other

  •12•315•20•1•Updated Jul 11, 2024Jul 11, 2024

• AILab-CVC.github.io

  Public
  Homepage of Tencent AI Lab CVC.

  HTML

  •0•0•0•0•Updated Jul 10, 2024Jul 10, 2024

• VideoCrafter

  Public
  VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

  video-generationimage-to-videotext-to-video

  Python

  •

  Other

  •340•4.6k•63•3•Updated Jul 10, 2024Jul 10, 2024

• TaleCrafter

  Public
  [SIGGRAPH Asia 2023] An interactive story visualization tool that support multiple characters

  storytellingstorycreationsiggraph-asia-2023+ 1siggprah-asia

  12•254•5•0•Updated Mar 22, 2024Mar 22, 2024

• M2PT

  Public
  [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities

  deep-learningtransformersartificial-intelligence+ 1multimodal

  Python

  •

  Apache License 2.0

  •4•94•1•0•Updated Mar 13, 2024Mar 13, 2024

• Make-Your-Video

  Public
  [IEEE TVCG 2024] Customized Video Generation Using Textual and Structural Guidance

  Python

  •

  Other

  •8•185•2•0•Updated Feb 24, 2024Feb 24, 2024

• Animate-A-Story

  Public
  Retrieval-Augmented Video Generation for Telling a Story

  17•249•3•0•Updated Feb 5, 2024Feb 5, 2024

• GPT4Tools

  Public
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.

  Python

  •

  Other

  •59•761•14•0•Updated Dec 19, 2023Dec 19, 2023

• GroupMixFormer

  Public
  GroupMixAttention and GroupMixFormer

  Python

  •

  MIT License

  •12•113•3•0•Updated Dec 13, 2023Dec 13, 2023