File tree Expand file tree Collapse file tree 1 file changed +6
-2
lines changed Expand file tree Collapse file tree 1 file changed +6
-2
lines changed Original file line number Diff line number Diff line change 1
1
# ERNIE 3.0 轻量级模型
2
2
3
3
## 模型介绍
4
-
4
+ TBD
5
5
<p align =" center " >
6
6
<img width="644" alt="image" src="https://user-images.githubusercontent.com/1371212/168254282-e6901f9a-fd9a-4bbd-a5b6-e847b7f90bb4.png">
7
7
</p >
8
8
9
9
## 模型效果
10
10
11
- ERNIE 3.0 开源 Base(12L768H) 和 Medium(6L768H) 两个模型,它们在 CLUE ** 验证集** 上指标如下:
11
+ 本项目开源 ** ERNIE 3.0 _ base_ *** 和 ** ERNIE 3.0 _ medium_ ** 两个模型:
12
+
13
+ - [ ** ERNIE 3.0-_ Base_ ** ] ( https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_base_zh.pdparams ) (_ 12-layer, 768-hidden, 12-heads_ )
14
+ - [ ** ERNIE 3.0-_ Medium_ ** ] ( https://bj.bcebos.com/paddlenlp/models/transformers/ernie_3.0/ernie_3.0_medium_zh.pdparams ) (_ 6-layer, 768-hidden, 12-heads_ )
12
15
16
+ 在 CLUE ** 验证集** 上评测指标如下表所示:
13
17
<table style =" width :100% ;" cellpadding =" 2 " cellspacing =" 0 " border =" 1 " bordercolor =" #000000 " >
14
18
<tbody>
15
19
<tr>
You can’t perform that action at this time.
0 commit comments