Skip to content

Commit 18a616d

Browse files
fix: fix tp_size
1 parent ce6115b commit 18a616d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

graphgen/models/llm/local/sglang_wrapper.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ def __init__(
3636
self.tp_size = int(tp_size)
3737

3838
# Initialise the offline engine
39-
self.engine = sgl.Engine(model_path=self.model_path, tp_size=tp_size)
39+
self.engine = sgl.Engine(model_path=self.model_path, tp_size=self.tp_size)
4040

4141
# Keep helpers for streaming
4242
self.async_stream_and_merge = async_stream_and_merge

0 commit comments

Comments
 (0)