Skip to content

Commit dab5e26

Browse files
authored
Support more model outputs for BERT/ERNIE/RoBERTa (#2583)
* Support more model outputs for BERT. * Make more task classed support more outputs. * Convert list to tuple automatically in ModelOutput. * Support more model outputs for ERNIE. * Support more model outputs for Roberta. * Add embedding output to all hidden states. * Clean import in model_output.py
1 parent 9fda199 commit dab5e26

File tree

5 files changed

+1092
-182
lines changed

5 files changed

+1092
-182
lines changed

paddlenlp/transformers/__init__.py

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -120,4 +120,11 @@
120120
if is_faster_tokenizer_available():
121121
from .bert.faster_tokenizer import *
122122
from .ernie.faster_tokenizer import *
123-
from .tinybert.faster_tokenizer import *
123+
from .tinybert.faster_tokenizer import *
124+
125+
# patches of paddle.nn.Transformer to get all hidden_states and attentions
126+
import paddle
127+
from .model_outputs import _transformer_encoder_layer_fwd, _transformer_encoder_fwd
128+
129+
paddle.nn.TransformerEncoderLayer.forward = _transformer_encoder_layer_fwd
130+
paddle.nn.TransformerEncoder.forward = _transformer_encoder_fwd

0 commit comments

Comments
 (0)