Skip to content

Latest commit

 

History

History
75 lines (61 loc) · 2.38 KB

File metadata and controls

75 lines (61 loc) · 2.38 KB

Natural Language Processing

This is the repository for the Natural Language Processing course at the Asian Institute of Technology.

Google slide lectures can be found: https://drive.google.com/drive/folders/14x9_-Y_aWysPIZFLaVrZE2ngy2h_beJj?usp=sharing

YT playlist: https://www.youtube.com/playlist?list=PLqL-7eLmqd9V3faivSAST76YQClS44dSz

Credits

I would also like to give huge credits to several GitHub / web resources that I have revised to create this:

Useful GitHub

I would also like to thank students who have contributed:

Outline

  1. Fundamentals

    • Word Vectors - Word2Vec (Naive)
    • Word Vectors - Word2Vec (Negative sampling)
    • Word Vectors - GloVe
    • Window-Based Name Entity Recognition
    • Dependency Parsing
    • Information Retrieval / Salient Spans
  2. DL

    • Classification
    • Sequence-to-Sequence Models
      • LSTM, biGRU, CNN, Transformer
    • Langauge Models
      • LSTM, Transformer
    • Masked Language Models
      • BERT
      • Much more...
    • Case studies
      • QA
      • Summarization
      • Pruning
      • distilBERT
      • SentenceBERT
      • SimCSE
      • Much more...
  3. SpaCy

  4. Huggingface

    • Case studies
  5. Retrieval Augmented Generation

    • Prompt, Chain, Tools, Agent
  6. Multimodal Language Model

    • ViT, BEIT, CLIP, SimVLM, Flamingo, BLIP-2, CoCa
  7. Reinforcement Learning with Human Feedback

    • SFT, PPO, DPO, RRHF