Skip to content

Commit a0bd55f

Browse files
author
Ander Corral
committed
Added integration tests and updated FAQ
1 parent 1e1c540 commit a0bd55f

File tree

3 files changed

+27
-2
lines changed

3 files changed

+27
-2
lines changed

.github/workflows/push.yml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -192,6 +192,13 @@ jobs:
192192
-report_every 5 -train_steps 10 \
193193
-save_model /tmp/onmt.model \
194194
-save_checkpoint_steps 10
195+
- name: Testing translation with features
196+
run: |
197+
python translate.py \
198+
-model /tmp/onmt.model_step_10.pt \
199+
-src data/data_features/src-test.txt \
200+
-src_feats "{'feat0': 'data/data_features/src-test.feat0'}" \
201+
-verbose
195202
- name: Test RNN translation
196203
run: |
197204
head data/src-test.txt > /tmp/src-test.txt

docs/source/FAQ.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -527,4 +527,12 @@ src_feats_vocab:
527527
feat_1: exp/data.vocab.feat_1
528528
feat_merge: "sum"
529529

530-
```
530+
```
531+
532+
During inference you can pass features by using the `--src_feats` argument.
533+
534+
**Important note!** During inference, input sentence is expected to be tokenized. Therefore feature inferring should be handled prior to running the translate command. Example:
535+
536+
```bash
537+
python translate.py -model model_step_10.pt -src ../data.txt.tok -output ../data.out --src_feats "{'feat_0': '../data.txt.feats0', 'feat_1': '../data.txt.feats1'}"
538+
```

onmt/tests/pull_request_chk.sh

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -276,7 +276,7 @@ ${PYTHON} onmt/bin/train.py \
276276
-rnn_size 2 -batch_size 10 \
277277
-word_vec_size 5 -rnn_size 10 \
278278
-report_every 5 -train_steps 10 \
279-
-save_model $TMP_OUT_DIR/onmt.model \
279+
-save_model $TMP_OUT_DIR/onmt.features.model \
280280
-save_checkpoint_steps 10 >> ${LOG_FILE} 2>&1
281281
[ "$?" -eq 0 ] || error_exit
282282
echo "Succeeded" | tee -a ${LOG_FILE}
@@ -297,6 +297,16 @@ ${PYTHON} translate.py -model ${TEST_DIR}/test_model.pt -src $TMP_OUT_DIR/src-te
297297
echo "Succeeded" | tee -a ${LOG_FILE}
298298
rm $TMP_OUT_DIR/src-test.txt
299299

300+
echo -n " [+] Testing NMT translation with features..."
301+
${PYTHON} translate.py \
302+
-model ${TMP_OUT_DIR}/onmt.features.model_step_10.pt \
303+
-src ${DATA_DIR}/data_features/src-test.txt \
304+
-src_feats "{'feat0': '${DATA_DIR}/data_features/src-test.feat0'}" \
305+
-verbose >> ${LOG_FILE} 2>&1
306+
[ "$?" -eq 0 ] || error_exit
307+
echo "Succeeded" | tee -a ${LOG_FILE}
308+
rm -f $TMP_OUT_DIR/onmt.features.model*
309+
300310
echo -n " [+] Testing NMT ensemble translation..."
301311
head ${DATA_DIR}/src-test.txt > $TMP_OUT_DIR/src-test.txt
302312
${PYTHON} translate.py -model ${TEST_DIR}/test_model.pt ${TEST_DIR}/test_model.pt \

0 commit comments

Comments
 (0)