How to clip grad only for certain parameters within a module? #15092

danielyan86129 started this conversation in General

danielyan86129
Oct 11, 2022

Hi,

how do I only clip grad for certain params in a module?
Also can I do this in a module's member module?
Should this be done by overriding configure_gradient_clipping() within the specific module, and it will be called properly?

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment