Skip to content

Commit a9856ce

Browse files
authored
Update pretrain_bert.py (deepspeedai#355)
fix a bug that cause File "pretrain_bert.py", line 91, in loss_func lm_loss_, sop_logits = output_tensor ^^^^^^^^^^^^^^^^^^^^ ValueError: too many values to unpack (expected 2)
1 parent 31e2584 commit a9856ce

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pretrain_bert.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@ def data_post_process(data, data_sampler_state_dict):
8787
return data
8888

8989
def loss_func(loss_mask, sentence_order, output_tensor):
90-
lm_loss_, sop_logits = output_tensor
90+
lm_loss_, sop_logits, _ = output_tensor
9191

9292
lm_loss_ = lm_loss_.float()
9393
loss_mask = loss_mask.float()

0 commit comments

Comments
 (0)