Skip to content

Fix/environment variable in multinode train #8413

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
huangfu170 wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Fix/environment variable in multinode train #8413

Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
a925285
Update train_node1.sh
huangfu170 Mar 24, 2026
c3b18ae
Update train_node2.sh
huangfu170 Mar 24, 2026
1869abe
Update train_node1.sh
huangfu170 Mar 24, 2026
428c427
Update train_node2.sh
huangfu170 Mar 24, 2026
3996ec0
Update examples/train/multi-node/swift/train_node2.sh
huangfu170 Mar 24, 2026
aa69b18
Update train_node1.sh
huangfu170 Mar 24, 2026
714b617
Update train_node2.sh
huangfu170 Mar 24, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions examples/train/multi-node/swift/train_node1.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
nnodes=2
nproc_per_node=4

CUDA_VISIBLE_DEVICES=0,1,2,3 \
NNODES=$nnodes \
NODE_RANK=0 \
MASTER_ADDR=127.0.0.1 \
MASTER_PORT=29500 \
NPROC_PER_NODE=$nproc_per_node \
export CUDA_VISIBLE_DEVICES=0,1,2,3
export NNODES=$nnodes
export NODE_RANK=0
export MASTER_ADDR=127.0.0.1
export MASTER_PORT=29500
export NPROC_PER_NODE=$nproc_per_node
swift sft \
--model Qwen/Qwen2.5-7B-Instruct \
--tuner_type full \
Expand Down
12 changes: 6 additions & 6 deletions examples/train/multi-node/swift/train_node2.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
nnodes=2
nproc_per_node=4

CUDA_VISIBLE_DEVICES=0,1,2,3 \
NNODES=$nnodes \
NODE_RANK=1 \
MASTER_ADDR=xxx.xxx.xxx.xxx \
MASTER_PORT=29500 \
NPROC_PER_NODE=$nproc_per_node \
export CUDA_VISIBLE_DEVICES=0,1,2,3
export NNODES=$nnodes
export NODE_RANK=1
export MASTER_ADDR=xxx.xxx.xxx.xxx
Comment thread
huangfu170 marked this conversation as resolved.
Outdated
export MASTER_PORT=29500
export NPROC_PER_NODE=$nproc_per_node
swift sft \
--model Qwen/Qwen2.5-7B-Instruct \
--tuner_type full \
Expand Down
Loading