This code consists of the implementations of TopicBERT framework proposed in the paper titled: "TopicBERT: Topic-aware BERT for Efficient Document Classification" accepted at EMNLP2020 Conference in "Findings in EMNLP" track.
Paper: TopicBERT: Topic-aware BERT for Efficient Document Classification
The two subdirectories contains the implementations of our two proposed models:
- TopicBERT
- TopicDistilBERT