Skip to content

Commit e835c79

Browse files
committed
fix trailing whitespace in ppo.py
1 parent 4a919f8 commit e835c79

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ding/rl_utils/ppo.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ def calculate_kl_div(log_ratio: torch.Tensor, kl_type: str) -> torch.Tensor:
3535
The implementation is based on John Schulman's blog post "Approximating KL Divergence".
3636
Reference: http://joschu.net/blog/kl-approx.html
3737
Arguments:
38-
- log_ratio (:obj:`torch.Tensor`): The log-ratio of probabilities, which should be
38+
- log_ratio (:obj:`torch.Tensor`): The log-ratio of probabilities, which should be
3939
log(q/p) = logp_new - logp_pretrained.
4040
- kl_type (:obj:`str`): The type of KL divergence estimator to use.
4141
- 'k1': The standard, unbiased but high-variance estimator: `E_q[log(q/p)]`.

0 commit comments

Comments
 (0)