BACKEND TRAINING

This repo contains a standalone deepspeed training implementation.

Name		Name	Last commit message	Last commit date
Latest commit History 16 Commits
sample-data		sample-data
LICENSE		LICENSE
README.md		README.md
data_process.py		data_process.py
ilab_to_sdg.py		ilab_to_sdg.py
main_ds.py		main_ds.py
multipack_sampler.py		multipack_sampler.py
token_dataset.py		token_dataset.py
tokenizer_utils.py		tokenizer_utils.py
utils.py		utils.py

Provide feedback