Skip to content

feat(shortgpt): add new script and polish existing code (typos, paths) #10882

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

tianyumyum
Copy link

Before submitting

  • Lint code. If there are lint issues, please format the code first.
# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py
  • Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

  1. 新增shortgpt删层操作,用于模型推理加速,减少显存使用
  2. 修复原项目中的typo,模型路径不对齐等问题

Copy link

paddle-bot bot commented Jul 23, 2025

Thanks for your contribution!

@CLAassistant
Copy link

CLAassistant commented Jul 23, 2025

CLA assistant check
All committers have signed the CLA.

@@ -1,17 +1,23 @@
# 向量检索模型训练

推荐安装 gpu 版本的[PaddlePaddle](https://www.paddlepaddle.org.cn/install/quick?docurl=/documentation/docs/zh/install/conda/linux-conda.html),以 cuda12.3的 paddle 为例,安装命令如下:
推荐安装 gpu 版本的[PaddlePaddle](https://www.paddlepaddle.org.cn/install/quick?docurl=/documentation/docs/zh/install/conda/linux-conda.html),以 cuda11.8的 paddle 为例,安装命令如下:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

推荐使用更高版本的paddle,低版本保留时间不会太长

Copy link
Author

@tianyumyum tianyumyum Jul 23, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

适配更高cuda版本的话,请问具体哪个版本呢,nightly or stable。目前我使用服务器中的cuda version是12.1

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

可以考虑当前的cuda 12.6和12.9

@tianyumyum tianyumyum marked this pull request as ready for review July 23, 2025 02:37
@DrownFish19
Copy link
Collaborator

我看Test测试还有些问题,可以试试拉最新代码,然后重新过Test试试

@DrownFish19 DrownFish19 reopened this Jul 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants