SFT在用mix_strategy时，支不支持每个epoch都重新做sampling? #9494
Unanswered
zilinwang-1529
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
我在用两个dataset进行SFT，用了interleave_under做downsampling。但是我发现tokenization的时候只做了downsampling过后的数据，而且我没有找到可以每个epoch进行resampling的参数。请问这个功能有支持吗，或者说未来有计划加上吗？
Beta Was this translation helpful? Give feedback.
All reactions