Skip to content
This repository was archived by the owner on Apr 29, 2021. It is now read-only.

RNN-T: Time-reduction #25

Open
julianmack wants to merge 249 commits into
base: master
Choose a base branch
from
Open

RNN-T: Time-reduction #25

julianmack wants to merge 249 commits into from

Conversation

@julianmack
Copy link
Contributor

@julianmack julianmack commented Jan 15, 2020

Adds time reduction layer to RNN-T.

Blocked by:

NOTE: currently the base branch is rnnt - Make sure you make base: master before merging.

@julianmack
Updated .gitignore
4c70324
@julianmack
Updated tests so that none fail as a result of device errors by sendi…
3b846f0 
…ng tensors to the same device before comparing
@julianmack
Added Makefile to build source dependencies
de02c1c
@julianmack
Added rnnt encoder incl docstrings
2acedcc
@julianmack
Added rnnt init of simple encoder
745f07d
@julianmack
Fixed bugs from deepspeech, rnnt rebase
20c715d
@julianmack
Added rnnt network including definition
1c7607f
@julianmack
Updated rnnt docstrings and .joint() args ordering
3edc45a
@julianmack
Added rnnt builder
d1678d5
@julianmack
Added batch_first to rnn proto
34edc2b
@julianmack
Added rnnt loss
f8b366d
@julianmack
Small addition to make separator_index docstring clearer
4f6a445
@julianmack
Added greedy rnnt decoder and fixed bugs in forward pass and init of …
aeda860 
…rnnt network
@julianmack
Can now build, train and evaluate rnnt
20d4b0c
@julianmack
Added beam rnnt decoding
96e3e6c
@julianmack
Fixed all old failing tests. Added new NotImplemented tests
baa2b27
@julianmack
All tests passing
a03543f
@julianmack
Small changes to rnnt model definition, loss and decoders
aa5f9a8
@julianmack
Added seperate time-reduction rnnt encoder config file
b661c30
@julianmack
Updated installation docs
b6074d3
@julianmack
Updated default config for rnnt
a106765
@julianmack
Added rnnt example usage notebook
40a403b
@julianmack
Added del of variables - preventing/reducing cuda memory leak
2a83e95
@julianmack
RNNT decoding callback is no longer evaluated on first epoch by default
017ad19
@julianmack
Changes to reduce (RNN-T) training memory consumption. All activation…
da3204d 
…s now inplace=True
@julianmack
Changed rnnt default lr
35b9b7f
@julianmack
Added test for rnnt model. Not passing
c928870
@julianmack
Forward pass of rnnt test working
b32ec6d
@julianmack
Added fc layers in rnnt encoder and updated rnnt test
7a2da9e
@julianmack
Updated rnnt docstrings
0fb8742
@julianmack
Updated comments and formatting
639d6c6
@julianmack
Added greedy transducer decoder tests
6f0cebe
@julianmack
Cleaned up test warning hacks
66cbd5d
@julianmack
Merge branch 'rnnt' into rnnt_scaleup1
88383d9
@julianmack
Updated docs
6185c82
@julianmack
Merge branch 'rnnt' into rnnt_scaleup1
02d62b7
@julianmack
Removed check for batch_first rnns in encoder
11545b9
@julianmack
Fixed bug in transducer proto test generator
41a26c6
@julianmack
Merge branch 'rnnt' into rnnt_scaleup1
682a242
@julianmack
Updated tests to calculate transducer output size w. time_reduction
a6bd090
@julianmack
Updated rnn_t config with SpecAugment
e7b3438
@julianmack
Merge branch 'rnnt' into rnnt_scaleup1
b21cbc7
@julianmack
Updated rnn_t config with SpecAugment
edc1eb3
@julianmack
Updated config to add time reduction layer
c0fc924
@julianmack
Updated config data dir
695a6d7
@julianmack
Fixed failing tests
5cc9743
@julianmack
Updated batch size
ad15347
@julianmack
Updated enc_out size to reflect small encoder value
4bb6786
@julianmack
Added ability to return hidden state and allow batch_first rnns
29c4514
@julianmack
Updated PredNet to prevent embedding copy (for speed)
f0ba9fb
@julianmack
Merge branch 'rnnt' into rnnt_scaleup1
215f2e1
@julianmack
Added check that rnn hidden state is of length 2 if it is a tuple
cb351a7
@julianmack
Updated mistake in joint_net docstring
dbd04d0
@julianmack
Merge branch 'rnn_hidden' into rnnt
022a081
@julianmack
Merge branch 'rnnt' into rnnt_scaleup1
3eacdd7
@julianmack julianmack mentioned this pull request Jan 15, 2020
Draft
@julianmack julianmack changed the title Add time-reduction to RNN-T RNN-T: Tme-reduction Jan 15, 2020
@julianmack julianmack changed the title RNN-T: Tme-reduction RNN-T: Time-reduction Jan 15, 2020
@julianmack julianmack changed the base branch from rnnt to master January 28, 2020 15:16
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

No reviews

Assignees

No one assigned

Labels

blocked

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@julianmack