GitHub - j4orz/picosw2.0: ai algorithms

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 40 Commits
data		data
.gitignore		.gitignore
0-ngram.ipynb		0-ngram.ipynb
1-fnn.ipynb		1-fnn.ipynb
2-made.ipynb		2-made.ipynb
3-cnn.ipynb		3-cnn.ipynb
4-gpt2.ipynb		4-gpt2.ipynb
5-llama3.ipynb		5-llama3.ipynb
5.1-llama3-chat.ipynb		5.1-llama3-chat.ipynb
6-r1.ipynb		6-r1.ipynb
README		README
REFERENCE.md		REFERENCE.md

Repository files navigation

piconn: software 2.0 models on (pytorch-nv) and (jax-tpu)
references: scardapane/jurafsky, goodfellow/prince
models (formalized in REFERENCE.md):
    - pre-transformers: fnn, rnn, lstm, made, cnn
    - transformers: gpt2 (124M), llama3 (7B), r1