Hardware-software co-design for Transformer(Attention based NNs)

Interesting open source design, system architecture, hardware and algorithm co-design

1. TransCODE: Co-design of Transformers and Accelerators for Efficient Training and Inference
2. Butterfly Accelerator for Efficient Transformer
3. BERT Model on Silicon
4. transformer-cpp-cpu
5. NiuTrans.NMT

HLS-FPGA

1. HLS_Transformer c++ version of ViT
2. transformer_core transformer in C++. Be used to learn vivado hls and the algorithm
3. transformer_hls
4. trans-fat