Skip to content

gpjt/fine-tune-2024-04

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

91 Commits
batch-size-memory-modeling-0.5B
batch-size-memory-modeling-0.5B
 
 
batch-size-memory-modeling-8B
batch-size-memory-modeling-8B
 
 
final-tune
final-tune
 
 
sequence-length-memory-modeling-8B
sequence-length-memory-modeling-8B
 
 
sequence-length-memory-modeling
sequence-length-memory-modeling
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 
batch-size-charts.ipynb
batch-size-charts.ipynb
 
 
charts.ipynb
charts.ipynb
 
 
ds_config.json
ds_config.json
 
 
first-8B-fine-tune.py
first-8B-fine-tune.py
 
 
initial-0.5b-fine-tune.ipynb
initial-0.5b-fine-tune.ipynb
 
 
overfitting.png
overfitting.png
 
 
requirements.txt
requirements.txt
 
 
second-0.5b-fine-tune.ipynb
second-0.5b-fine-tune.ipynb
 
 
second-8B-fine-tune.py
second-8B-fine-tune.py
 
 
setup.cfg
setup.cfg
 
 
third-0.5b-fine-tune-as-script-with-deepspeed-and-logging.py
third-0.5b-fine-tune-as-script-with-deepspeed-and-logging.py
 
 
third-0.5b-fine-tune-as-script-with-deepspeed-and-memory-usage-and-clear-cache.py
third-0.5b-fine-tune-as-script-with-deepspeed-and-memory-usage-and-clear-cache.py
 
 
third-0.5b-fine-tune-as-script-with-deepspeed-and-memory-usage-and-vram-restriction.py
third-0.5b-fine-tune-as-script-with-deepspeed-and-memory-usage-and-vram-restriction.py
 
 
third-0.5b-fine-tune-as-script-with-deepspeed-and-memory-usage.py
third-0.5b-fine-tune-as-script-with-deepspeed-and-memory-usage.py
 
 
third-0.5b-fine-tune-as-script-with-deepspeed-and-profiler.py
third-0.5b-fine-tune-as-script-with-deepspeed-and-profiler.py
 
 
third-0.5b-fine-tune-as-script-with-deepspeed.py
third-0.5b-fine-tune-as-script-with-deepspeed.py
 
 
third-0.5b-fine-tune-as-script.py
third-0.5b-fine-tune-as-script.py
 
 
third-0.5b-fine-tune-load-only.py
third-0.5b-fine-tune-load-only.py
 
 
third-0.5b-fine-tune-with-dp-fork-after-forum-post.ipynb
third-0.5b-fine-tune-with-dp-fork-after-forum-post.ipynb
 
 
third-0.5b-fine-tune-with-dp.ipynb
third-0.5b-fine-tune-with-dp.ipynb
 
 

Repository files navigation

fine-tune-2024-04

My goal is to fine-tune meta-llama/Meta-Llama-3-8B on timdettmers/openassistant-guanaco with no quantization.

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

9 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages