Custom L2 and L1 regularization - only on NN parameters #207
Description
Currently AdamW's built in L2 regularization would also apply to the mechanistic parameters. Would be pushed to pmin + (pmin + pmax)/2 due to sigmoid scaling
{{ message }}
Currently AdamW's built in L2 regularization would also apply to the mechanistic parameters. Would be pushed to pmin + (pmin + pmax)/2 due to sigmoid scaling