Skip to content

Commit be0b438

Browse files
committed
add mp
1 parent 1bbefe5 commit be0b438

File tree

2 files changed

+1
-0
lines changed

2 files changed

+1
-0
lines changed

img/mp.png

80.3 KB
Loading

pmoe_ppo.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -233,6 +233,7 @@ def train_net(self):
233233
loss.backward()
234234
nn.utils.clip_grad_norm_(self.parameters, self.max_grad_norm)
235235
self.optimizer.step()
236+
236237
loss_list = [coef_loss.item(), q_loss.item(), policy_loss.item(), value_loss.item()]
237238
return loss_list
238239

0 commit comments

Comments
 (0)