请问该框架支持预训练的序列并行吗？

[YihengLiu1996]

Reminder

• I have read the README and searched the existing issues.

System Info

想使用本框架开展预训练的序列并行

Reproduction

...

Expected behavior

No response

Others

No response

[HaoshengZou]

will do this week

Feb 26. update:
Sorry we haven't had man power recently as focus is shifted to R1 models for now. We'll update later when we have man power.

[dubeno]

有进展吗？

[AllenShow]

支持预训练了吗？