Deep-HOSeq: Deep Higher-Order Sequence Fusion for Multimodal Sentiment Analysis.
-
Updated
Oct 19, 2020 - Python
Deep-HOSeq: Deep Higher-Order Sequence Fusion for Multimodal Sentiment Analysis.
Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
Few-Shot malware classification using fused features of static analysis and dynamic analysis (基于静态+动态分析的混合特征的小样本恶意代码分类框架)
Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images - ICCV 2021
Creating multimodal multitask models
FusionBrain Challenge 2.0: creating multimodal multitask model
This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.
Multimodal sentiment analysis using hierarchical fusion with context modeling
This repository contains the dataset and baselines explained in the paper: M2H2: A Multimodal Multiparty Hindi Dataset For HumorRecognition in Conversations
Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)
A generalized self-supervised training paradigm for unimodal and multimodal alignment and fusion.
Multimodal sentiment analysis
[CVAMD 2021] "End-to-End Learning of Fused Image and Non-Image Feature for Improved Breast Cancer Classification from MRI"
Repository for context based emotion recognition
The codebase for our paper on Multi-modal Medical Dialogue Summarization
MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)
Repo for "Centaur: Robust Multimodal Fusion for Human Activity Recognition"
[FR|EN - Trio] 2023 - 2024 Centrale Méditerranée AI Master | Multimodal retranscription with text, audio and video
A Transferability-guided Protein-Ligand Interaction Prediction Method
We propose Multi-Modal Segmentation TransFormer (MMSFormer) that incorporates a novel fusion strategy to perform multimodal material segmentation.
Add a description, image, and links to the multimodal-fusion topic page so that developers can more easily learn about it.
To associate your repository with the multimodal-fusion topic, visit your repo's landing page and select "manage topics."