Skip to content

Commit f8aaef1

Browse files
authored
Remove some outdate docs (#7360)
1 parent 1ace0d5 commit f8aaef1

File tree

9 files changed

+6
-587
lines changed

9 files changed

+6
-587
lines changed

docs/api_guides/low_level/layers/control_flow.rst

Lines changed: 0 additions & 58 deletions
This file was deleted.

docs/api_guides/low_level/layers/control_flow_en.rst

Lines changed: 0 additions & 59 deletions
This file was deleted.

docs/api_guides/low_level/layers/conv.rst

Lines changed: 0 additions & 65 deletions
This file was deleted.

docs/api_guides/low_level/layers/conv_en.rst

Lines changed: 0 additions & 58 deletions
This file was deleted.

docs/api_guides/low_level/layers/sparse_update.rst

Lines changed: 3 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -4,42 +4,14 @@
44
稀疏更新
55
#####
66

7-
Fluid 的 :ref:`cn_api_fluid_layers_embedding` 层在单机训练和分布式训练时,均可以支持“稀疏更新”,即梯度以 sparse tensor 结构存储,只保存梯度不为 0 的行。
7+
`paddle.nn.functional.embedding <cn_api_paddle_nn_functional_embedding>` 层在单机训练和分布式训练时,均可以支持“稀疏更新”,即梯度以 sparse tensor 结构存储,只保存梯度不为 0 的行。
88
在分布式训练中,对于较大的 embedding 层,开启稀疏更新有助于减少通信数据量,提升训练速度。
99

1010
在 paddle 内部,我们用 lookup_table 来实现 embedding。下边这张图说明了 embedding 在正向和反向计算的过程:
1111

1212
如图所示:一个 Tensor 中有两行不为 0,正向计算的过程中,我们使用 ids 存储不为 0 的行,并使用对应的两行数据来进行计算;反向更新的过程也只更新这两行。
1313

14-
.. image:: ../../../images/lookup_table_training.png
14+
.. image:: ../../../design/dist_train/src/lookup_table_training.png
1515
:scale: 50 %
1616

17-
embedding 使用例子:
18-
---------------------
19-
20-
API 详细使用方法参考 :ref:`cn_api_fluid_layers_embedding` ,以下是一个简单的例子:
21-
22-
.. code-block:: python
23-
24-
DICT_SIZE = 10000 * 10
25-
EMBED_SIZE = 64
26-
IS_SPARSE = False
27-
def word_emb(word, dict_size=DICT_SIZE, embed_size=EMBED_SIZE):
28-
embed = fluid.layers.embedding(
29-
input=word,
30-
size=[dict_size, embed_size],
31-
dtype='float32',
32-
param_attr=fluid.ParamAttr(
33-
initializer=fluid.initializer.Normal(scale=1/math.sqrt(dict_size))),
34-
is_sparse=IS_SPARSE,
35-
is_distributed=False)
36-
return embed
37-
38-
以上参数中:
39-
40-
- :code:`is_sparse` : 反向计算的时候梯度是否为 sparse tensor。如果不设置,梯度是一个 :ref:`Lod_Tensor <cn_user_guide_lod_tensor>` 。默认为 False。
41-
42-
- :code:`is_distributed` : 标志是否是用在分布式的场景下。一般大规模稀疏更新(embedding 的第 0 维维度很大,比如几百万以上)才需要设置。具体可以参考大规模稀疏的 API guide :ref:`cn_api_guide_async_training` 。默认为 False。
43-
44-
- API 汇总:
45-
- :ref:`cn_api_fluid_layers_embedding`
17+
API 详细使用方法参考 `paddle.nn.functional.embedding <cn_api_paddle_nn_functional_embedding>`

0 commit comments

Comments
 (0)