File tree Expand file tree Collapse file tree 1 file changed +3
-8
lines changed
examples/sentiment_analysis/skep Expand file tree Collapse file tree 1 file changed +3
-8
lines changed Original file line number Diff line number Diff line change 10
10
<img src =" https://paddlenlp.bj.bcebos.com/models/transformers/skep/skep.png " width =" 80% " height =" 60% " > <br />
11
11
</p >
12
12
13
- 百度研究团队在三个典型情感分析任务,句子级情感分类(Sentence-level Sentiment Classification),评价对象级情感分类(Aspect-level Sentiment Classification)、观点抽取(Opinion Role Labeling),共计14个中英文数据上进一步验证了情感预训练模型SKEP的效果。实验表明,以通用预训练模型ERNIE(内部版本)作为初始化,SKEP相比ERNIE平均提升约1.2%,并且较原SOTA平均提升约2% ,具体效果如下表:
13
+ 百度研究团队在三个典型情感分析任务,句子级情感分类(Sentence-level Sentiment Classification),评价对象级情感分类(Aspect-level Sentiment Classification)、观点抽取(Opinion Role Labeling),共计14个中英文数据上进一步验证了情感预训练模型SKEP的效果。实验表明,以通用预训练模型ERNIE作为初始化 ,具体效果如下表:
14
14
15
15
16
16
20
20
<td><strong><center>数据集合</strong></td>
21
21
<td><strong><center>语言</strong></td>
22
22
<td><strong><center>指标</strong></td>
23
- <td><strong><center>原SOTA</strong></td>
24
23
<td><strong><center>SKEP</strong></td>
25
24
<td><strong><center>数据集地址</strong></td>
26
25
</tr>
29
28
<td><center>SST-2</td>
30
29
<td><center>英文</td>
31
30
<td><center>ACC</td>
32
- <td><center>97.50</td>
33
31
<td><center>97.60</td>
34
32
<td><center><a href="https://gluebenchmark.com/tasks" >下载地址</a></td>
35
33
</tr>
36
34
<tr>
37
35
<td><center>ChnSentiCorp</td>
38
36
<td><center>中文</td>
39
37
<td><center>ACC</td>
40
- <td><center>95.80</td>
41
- <td><center>96.50</td>
38
+ <td><center>96.08</td>
42
39
<td><center><a href="https://ernie.bj.bcebos.com/task_data_zh.tgz" >下载地址</a></td>
43
40
</tr>
44
41
<tr>
45
42
<td rowspan="1"><center>评价对象级的<br /><center>情感分类</td>
46
43
<td><center>SE-ABSA16_PHNS</td>
47
44
<td><center>中文</td>
48
45
<td><center>ACC</td>
49
- <td><center>79.58</td>
50
- <td><center>82.91</td>
46
+ <td><center>65.22</td>
51
47
<td><center><a href="http://alt.qcri.org/semeval2016/task5/" >下载地址</a></td>
52
48
</tr>
53
49
<tr>
54
50
<td rowspan="1"><center>观点<br /><center>抽取</td>
55
51
<td><center>COTE_DP</td>
56
52
<td><center>中文</td>
57
53
<td><center>F1</td>
58
- <td><center>84.33</td>
59
54
<td><center>86.30</td>
60
55
<td><center><a href="https://github.com/lsvih/chinese-customer-review" >下载地址</a></td>
61
56
</tr>
You can’t perform that action at this time.
0 commit comments