Layers with recurrent hidden state

Basically all layers which define get_rec_initial_extra_outputs.

Most (all) of them only when inside a rec loop, otherwise they behave just as if you would iterate over the time axis.

• WindowLayer: state [B,W,...]
• CumsumLayer: state
• RecLayer: state depending on unit option, e.g. LSTMStateTuple
• RnnCellLayer: state depending on unit option, e.g. LSTMStateTuple
• SelfAttentionLayer: k_left, v_left
• KenLmStateLayer: state, step, scores
• CumConcatLayer: state
• SubnetworkLayer: any from subnet
• BaseChoiceLayer, ChoiceLayer, DecideLayer, etc: choice_scores, choice_src_beams
• EditDistanceTableLayer: state, optional source_len
• MaskedComputationLayer: any from subnet, _output
• UnmaskLayer: t
• TwoDLSTMLayer: state, output, iteration