-
Describe the question.我有长文本数据准备全参微调InternLM2-7b-chat，想询问支持的数据的max_length长度？ |
Beta Was this translation helpful? Give feedback.
Answered by
ZwwWayne
Jan 31, 2024
Replies: 1 comment 1 reply
-
|
仅供参考：出于效率和效果的 trade-off，我们目前用32K长文本进行了训练，然后外推到200K。 |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
感谢！ |
Beta Was this translation helpful? Give feedback.
Answer selected by
ZwwWayne
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
仅供参考：出于效率和效果的 trade-off，我们目前用32K长文本进行了训练，然后外推到200K。