Commit 51ba342
[Docs] Add SGLang backend documentation
Update LLM documentation with SGLang support:
llms_modules.rst:
- Add SGLangWrapper to Wrappers section
- Add AsyncSGLang to Wrappers section
llms.rst:
- Update Key Components to mention SGLang
- Add SGLang Quick Example alongside vLLM example
- Add SGLang weight sync classes to autosummary:
- SGLangWeightSyncScheme
- SGLangWeightSender
- SGLangCollectiveTransport
- get_sglang_model_metadata
Example shows both managed and external server modes:
- AsyncSGLang.from_pretrained() for managed server
- AsyncSGLang.connect() for external server
ghstack-source-id: 7b20c92
Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: 7b20c92
Pull-Request: #3435
Co-authored-by: Cursor <cursoragent@cursor.com>1 parent b2714c9 commit 51ba342
File tree
3 files changed
+30
-1
lines changed- .github/unittest/llm/scripts_llm
- docs/source/reference
3 files changed
+30
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
| 28 | + | |
28 | 29 | | |
29 | 30 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
| 15 | + | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| 23 | + | |
| 24 | + | |
23 | 25 | | |
24 | 26 | | |
25 | 27 | | |
| |||
36 | 38 | | |
37 | 39 | | |
38 | 40 | | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
39 | 61 | | |
40 | 62 | | |
41 | 63 | | |
| |||
85 | 107 | | |
86 | 108 | | |
87 | 109 | | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
88 | 114 | | |
89 | 115 | | |
90 | 116 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| 21 | + | |
21 | 22 | | |
22 | 23 | | |
| 24 | + | |
23 | 25 | | |
24 | 26 | | |
25 | 27 | | |
| |||
0 commit comments