Paper
https://arxiv.org/pdf/1611.09913
Equations
$$\begin{aligned}
\mathbf{c}(t) &= s\left( \mathbf{W}_{hh}^c \, \mathbf{h}(t-1) + \mathbf{W}_{xh}^c \, \mathbf{x}(t) + \mathbf{b}^c \right), \\\
\mathbf{g}(t) &= \sigma\left( \mathbf{W}_{hh}^g \, \mathbf{h}(t-1) + \mathbf{W}_{xh}^g \, \mathbf{x}(t) + \mathbf{b}^g \right), \\\
\mathbf{h}(t) &= \mathbf{g}(t) \circ \mathbf{h}(t-1) + \left( 1 - \mathbf{g}(t) \right) \circ \mathbf{c}(t).
\end{aligned}$$
Official implementation
none
