@@ -15,8 +15,8 @@ features like low-rank parameterisation and custom non-linearities. Akin to
15
15
Bonsai and ProtoNN, the three-phase training routine for FastRNN and FastGRNN
16
16
is decoupled from the custom cells to facilitate a plug and play behaviour of
17
17
the custom RNN cells in other architectures (NMT, Encoder-Decoder etc.).
18
- Additionally, numerically equivalent CUDA-based implementations FastRNNCuda
19
- and FastGRNNCuda are provided for faster training.
18
+ Additionally, numerically equivalent CUDA-based implementations ** FastRNNCUDA **
19
+ and ** FastGRNNCUDA ** are provided for faster training.
20
20
` edgeml_pytorch.graph.rnn ` also contains modified RNN cells of ** UGRNNCell** ,
21
21
** GRUCell** , and ** LSTMCell** , which can be substituted for Fast(G)RNN,
22
22
as well as untrolled RNNs which are equivalent to ` nn.LSTM ` and ` nn.GRU ` .
@@ -67,9 +67,9 @@ Final Test Accuracy: 0.9347
67
67
68
68
Non-Zeros: 1932 Model Size: 7.546875 KB hasSparse: False
69
69
```
70
- ` usps10/ ` directory will now have a consolidated results file called ` FastRNNResults.txt ` or
71
- ` FastGRNNResults.txt ` depending on the choice of the RNN cell. A directory ` FastRNNResults ` or
72
- ` FastGRNNResults ` with the corresponding models with each run of the code on the ` usps10 ` dataset.
70
+ ` usps10/ ` directory will now have a consolidated results file called ` FastRNNResults.txt ` ,
71
+ ` FastGRNNResults.txt ` or ` FastGRNNCUDAResults.txt ` depending on the choice of the RNN cell. A directory ` FastRNNResults ` ,
72
+ ` FastGRNNResults ` or ` FastGRNNCUDAResults ` with the corresponding models with each run of the code on the ` usps10 ` dataset.
73
73
74
74
Note that the scalars like ` alpha ` , ` beta ` , ` zeta ` and ` nu ` correspond to the values before
75
75
the application of the sigmoid function.
0 commit comments