Skip to content

Commit 5102f69

Browse files
update 2024-flipped-conformer folder
1 parent 29f3ed9 commit 5102f69

File tree

3 files changed

+67
-1
lines changed

3 files changed

+67
-1
lines changed

2024-flipped-conformer/README

Lines changed: 0 additions & 1 deletion
This file was deleted.

2024-flipped-conformer/README.md

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
Configs and recipes for our global attention-based encoder-decoder models.
2+
3+
Paper: [The Conformer Encoder May Reverse the Time Dimension](https://arxiv.org/abs/2410.00680)
4+
5+
We use [RETURNN](https://github.com/rwth-i6/returnn) based on PyTorch for training and our setups are based on [Sisyphus](https://github.com/rwth-i6/sisyphus).
6+
7+
### Sisyphus Setup
8+
9+
To prepare a sisyphus setup, you can run `prepare_sis_dir.sh <setup-dirname>`.
10+
After that, you need to create a `__init__.py` file inside
11+
the `config` folder and import the sis config there to run it.
12+
Here is an example to run chunked AED experiments for librispeech:
13+
```python
14+
from i6_experiments.users.schmitt.experiments.exp2024_08_27_flipped_conformer import flipped_conformer_exps
15+
16+
17+
def main():
18+
flipped_conformer_exps.py()
19+
```
20+
Then, to run the experiments, you just call `./sis m` inside the setup dir. This
21+
will call the `main` function defined above.
Lines changed: 46 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
1+
#!/bin/bash
2+
3+
set -e
4+
5+
dirname=$1
6+
7+
if [ ! $# -eq 1 ]; then
8+
echo "Usage: $0 <setup-dirname>"
9+
exit -1
10+
fi
11+
12+
mkdir -p $dirname
13+
cd $dirname
14+
15+
echo "Cloning repos"
16+
17+
git clone git@github.com:rwth-i6/sisyphus.git
18+
ln -s sisyphus/sis . # used to call the manager to run jobs
19+
20+
git clone git@github.com:rwth-i6/returnn.git
21+
22+
mkdir "recipe"
23+
git clone git@github.com:rwth-i6/i6_core.git recipe/i6_core
24+
git clone git@github.com:rwth-i6/i6_experiments.git recipe/i6_experiments
25+
26+
echo "Creating setup dirs"
27+
28+
mkdir "alias" # sis jobs aliases (symlinks)
29+
mkdir "output" # sis jobs outputs (symlinks)
30+
mkdir "work" # sis jobs
31+
mkdir "config" # main entry config is added here
32+
33+
# sisyphus settings which needs to be adapted depending on the working environment
34+
cp recipe/i6_experiments/users/schmitt/experiments/exp2024_08_27_flipped_conformer/settings.py .
35+
36+
# create dir for pycharm project to avoid indexing huge dirs (e.g work)
37+
echo "Creating dir for PyCharm project"
38+
39+
pycharmProj="`basename $PWD`-proj"
40+
mkdir $pycharmProj
41+
cd $pycharmProj
42+
ln -s ../returnn .
43+
ln -s ../sisyphus .
44+
ln -s ../settings.py .
45+
ln -s ../recipe .
46+
ln -s ../config .

0 commit comments

Comments
 (0)