Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TorchAcc][Experimental] Integrate more model in torchacc #683

Merged
merged 49 commits into from
May 22, 2024
Merged

[TorchAcc][Experimental] Integrate more model in torchacc #683

merged 49 commits into from
May 22, 2024

Commits on Jan 25, 2024

  1. [TorchAcc] Integrate TorchAcc and provide a sft example of qwen-72b-c… 

    …hat. (modelscope#333)
    @baoleai
    baoleai committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    e2d3b44 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Enhance TorchAcc support for dynamic sequence. (modelscope#382)

    @baoleai
    baoleai committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    6c899c9 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. [TorchAcc] Add support for save/load checkpoint. (modelscope#444)

    @baoleai
    baoleai committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    1321592 View commit details
    Browse the repository at this point in the history

  2. baichuan_patch

    @Zhikaiiii
    Zhikaiiii committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    dba0c65 View commit details
    Browse the repository at this point in the history

  3. patch baichuan

    wzk committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    ef6e2d6 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. modify baichuan

    @Zhikaiiii
    Zhikaiiii committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    432c070 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'torchacc' into torchacc2

    @Zhikaiiii
    Zhikaiiii committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    1d6f719 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. [TorchAcc] Fix batch split when padding_to is not None. (modelscope#480) 

    * [TorchAcc] Fix batch split when padding_to is not None.

* fix lint
    @baoleai
    baoleai committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    a5a6fdc View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Merge branch 'torchacc' of https://github.com/modelscope/swift into t… 

    …orchacc2
    @Zhikaiiii
    Zhikaiiii committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    37c4787 View commit details
    Browse the repository at this point in the history

  2. metric warmup calculate

    @Zhikaiiii
    Zhikaiiii committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    32cc090 View commit details
    Browse the repository at this point in the history

  3. fix conflict

    @Zhikaiiii
    Zhikaiiii committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    64246d3 View commit details
    Browse the repository at this point in the history

  4. fix

    @Zhikaiiii
    Zhikaiiii committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    290c2dd View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. model patch

    @Zhikaiiii
    Zhikaiiii committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    7e6b197 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. add profiler

    @Zhikaiiii
    Zhikaiiii committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    f0c7c8a View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. add yi

    @Zhikaiiii
    Zhikaiiii committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    c8dbfc6 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. [TorchAcc] Integrate TorchAcc and provide a sft example of qwen-72b-c… 

    …hat. (modelscope#333)
    @baoleai
    baoleai committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    669f5d9 View commit details
    Browse the repository at this point in the history

  2. Enhance TorchAcc support for dynamic sequence. (modelscope#382)

    @baoleai
    baoleai committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    b140759 View commit details
    Browse the repository at this point in the history

  3. [TorchAcc] Add support for save/load checkpoint. (modelscope#444)

    @baoleai
    baoleai committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    6faa7b3 View commit details
    Browse the repository at this point in the history

  4. fix patch

    @baoleai
    baoleai committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    1c3a258 View commit details
    Browse the repository at this point in the history

  5. fix lint

    @baoleai
    baoleai committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    160a9d5 View commit details
    Browse the repository at this point in the history

  6. code clean

    @baoleai
    baoleai committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    e0fe1d4 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. add argument:fsdp num

    @Zhikaiiii
    Zhikaiiii committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    0bb1797 View commit details
    Browse the repository at this point in the history

  2. [TorchAcc] rebase master

    @Zhikaiiii
    Zhikaiiii committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    f03aa00 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. [TorchAcc] Integrate TorchAcc and provide a sft example of qwen-72b-c… 

    …hat. (modelscope#333)
    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    661def1 View commit details
    Browse the repository at this point in the history

  2. Enhance TorchAcc support for dynamic sequence. (modelscope#382)

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    da6c94a View commit details
    Browse the repository at this point in the history

  3. [TorchAcc] Add support for save/load checkpoint. (modelscope#444)

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    73a843a View commit details
    Browse the repository at this point in the history

  4. fix patch

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    ee012b1 View commit details
    Browse the repository at this point in the history

  5. fix lint

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    f1b19a6 View commit details
    Browse the repository at this point in the history

  6. code clean

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0457fa4 View commit details
    Browse the repository at this point in the history

  7. fix comments

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    d10901f View commit details
    Browse the repository at this point in the history

  8. rebase

    @baoleai
    baoleai committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    30ad8c8 View commit details
    Browse the repository at this point in the history

  9. clean code

    @Zhikaiiii
    Zhikaiiii committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    cd6e799 View commit details
    Browse the repository at this point in the history

  10. Merge remote-tracking branch 'origin_balole/features/rebase_0401' int… 

    …o rebase_baole
    @Zhikaiiii
    Zhikaiiii committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    4400ea5 View commit details
    Browse the repository at this point in the history

  11. clean code

    @Zhikaiiii
    Zhikaiiii committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    f92274c View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge remote-tracking branch 'origin/main' into rebase_acc

    @Zhikaiiii
    Zhikaiiii committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    8e3cf24 View commit details
    Browse the repository at this point in the history

  2. format code

    @Zhikaiiii
    Zhikaiiii committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    8ee4bbf View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. [fix]add mark_step to optimize speed

    @Zhikaiiii
    Zhikaiiii committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    c3284ed View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. add script

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    e38fc2e View commit details
    Browse the repository at this point in the history

  2. add torchacc trim graph

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    aa61d6f View commit details
    Browse the repository at this point in the history

  3. remove useless code

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    40d18e9 View commit details
    Browse the repository at this point in the history

  4. remove useless files

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    0a173f1 View commit details
    Browse the repository at this point in the history

  5. add qwen72b full script

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    6226edb View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into rebase_acc

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    5da5649 View commit details
    Browse the repository at this point in the history

  7. fix bugs

    @Zhikaiiii
    Zhikaiiii committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    6d68d29 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. qwen15 and llama3 support

    @Zhikaiiii
    Zhikaiiii committed May 17, 2024
    Configuration menu
    Copy the full SHA
    a508e21 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into rebase_acc

    @Zhikaiiii
    Zhikaiiii committed May 17, 2024
    Configuration menu
    Copy the full SHA
    bf2a440 View commit details
    Browse the repository at this point in the history

  3. remove prof callback

    @Zhikaiiii
    Zhikaiiii committed May 17, 2024
    Configuration menu
    Copy the full SHA
    c5c310a View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. fix default value and add switch

    @Zhikaiiii
    Zhikaiiii committed May 21, 2024
    Configuration menu
    Copy the full SHA
    bd8d072 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. update script

    @Zhikaiiii
    Zhikaiiii committed May 22, 2024
    Configuration menu
    Copy the full SHA
    df84f3f View commit details
    Browse the repository at this point in the history