NLP models with clean implementation.
10 important NLP models range from 2003 to 2020:
- NNLM(2003)
- Word2Vec(2013)
- Seq2Seq(2014)
- Attention(2015)
- fastText(2016)
- Transformer(2017)
- BERT(2018)
- GPT(2018)
- XLNet(2019)
- T5(2020)
You may wonder where is GPT-2? Well, it's in toyllm!
I separated the models into two libraries, toynlp
for traditional "small" NLP models and toyllm
for LLMs, which are typically larger and more complex.