Skip to content

Commit c8d64f7

Browse files
🗑️ Remove deprecated machine learning documentation files
- Deleted outdated documentation for large language models deployment - Removed files related to agent systems, prompt engineering, and model communities - Cleaned up neural network and skorch documentation - Simplified project structure by removing redundant and unfinished sections
1 parent 8403e6e commit c8d64f7

File tree

21 files changed

+361
-205
lines changed

21 files changed

+361
-205
lines changed
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
---
2+
sidebar_position: 1
3+
title: 🚧Encoder-Decoder结构
4+
---
5+
6+
Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
---
2+
sidebar_position: 3
3+
title: 🚧Transformer结构
4+
---
5+
6+
7+
8+
9+
Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
---
2+
sidebar_position: 4
3+
title: 🚧Transformer
4+
---
5+
6+
学习Transformer的原理,使用PyTorch实现一个简单的Transformer模型,对模型进行训练和推理。通过分布式训练,提升模型训练效率。
7+
8+
通过这个单元的学习,你可以获得一个专属于自己的大模型,并可以用于自己的业务场景。
9+
10+
<DocCardList />
Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
---
2+
sidebar_position: 5
3+
title: 🚧分布式训练
4+
---
5+
6+
## 原理部分
7+
8+
DDP 与 NvLink 是目前大模型分布式训练最主要的技术支撑。
9+
10+
ddp 是 pytorch 推出的一个用于分布式训练的工具,它可以帮助我们方便地进行分布式训练。
11+
12+
deepspeed 是微软推出的一个用于分布式训练的工具,它可以帮助我们方便地进行分布式训练。
13+
14+
accelerate 是 Hugging Face 推出的一个用于分布式训练的工具, Accelerate。这不是 PyTorch 之上的高级框架,只是一个薄包装器。
15+
16+
17+
分布式训练常见的2种模式:
18+
- 单机多卡
19+
- 多机多卡
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
---
2+
sidebar_position: 4
3+
title: 🚧手写多模态大模型
4+
---
5+
6+
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
sidebar_position: 4
2+
sidebar_position: 6
33
title: 🚧模型微调
44
---
55

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
---
2+
sidebar_position: 2
3+
title: 🚧注意力机制
4+
---
5+
6+

docs/docs/机器学习/传统算法/skorch.md

Lines changed: 0 additions & 116 deletions
This file was deleted.

docs/docs/机器学习/大语言模型部署/Agent智能体.md

Lines changed: 0 additions & 42 deletions
This file was deleted.

docs/docs/机器学习/大语言模型部署/模型部署.md

Lines changed: 0 additions & 41 deletions
This file was deleted.

0 commit comments

Comments
 (0)