@@ -20,7 +20,6 @@ specified reservoir driver.
2020 and reservoir nodes.
2121 - `bias_vector`: The bias vector to be added at each time step during the reservoir
2222 update.
23-
2423"""
2524function create_states (reservoir_driver:: AbstractReservoirDriver ,
2625 train_data,
@@ -108,8 +107,6 @@ echo state networks (`ESN`).
108107 Defaults to `tanh_fast`.
109108 - `leaky_coefficient`: The leaky coefficient used in the RNN.
110109 Defaults to 1.0.
111-
112-
113110"""
114111function RNN (; activation_function= NNlib. fast_act (tanh), leaky_coefficient= 1.0 )
115112 RNN (activation_function, leaky_coefficient)
@@ -185,7 +182,6 @@ This function creates an MRNN object with the specified activation functions,
185182leaky coefficient, and scaling factors, which can be used as a reservoir driver
186183in the ESN.
187184
188-
189185[^Lun2015]: Lun, Shu-Xian, et al.
190186 "_A novel model of leaky integrator echo state network for
191187 time-series prediction._" Neurocomputing 159 (2015): 58-66.
234230Returns a Fully Gated Recurrent Unit (FullyGated) initializer
235231for the Echo State Network (ESN).
236232
237- Returns the standard gated recurrent unit [^Cho2014] as a driver for the
233+ Returns the standard gated recurrent unit [^Cho2014] as a driver for the
238234echo state network (`ESN`).
239235
240-
241236[^Cho2014]: Cho, Kyunghyun, et al.
242237 "_Learning phrase representations using RNN encoder-decoder
243238 for statistical machine translation._"
@@ -281,7 +276,6 @@ This driver is based on the GRU architecture [^Cho2014].
281276 - `variant`: The GRU variant to use.
282277 By default, it uses the "FullyGated" variant.
283278
284-
285279[^Cho2014]: Cho, Kyunghyun, et al.
286280 "_Learning phrase representations using RNN encoder-decoder for statistical machine translation._"
287281 arXiv preprint arXiv:1406.1078 (2014).
0 commit comments