If we consider the gradient of the Himmelblau function above, we can try to solve  without caring about the objective value. Then we can still create `NDifferentiable`s, but we need to specify the cache to hold the value of . Currently, the only relevant ones are `NonDifferentiable` and `OnceDifferentiable`. `TwiceDifferentiable` could be used for higher order (tensor) methods, though they are rarely worth the cost. The relevant functions coded in Julia are:
0 commit comments