Commit a704967
authored
[V0.9.1][BugFix] Fix the bug in decoraotor patch (#2199)
### What this PR does / why we need it?
Fix the bug in the decorator patch, which would have a negative impact
on performance with mini batch. Now fix it by enabling this patch just
when engine_v1 and flashcomm_v1 enabled together.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI passed with new added/existing test.
Related:
#2191 (comment)
Signed-off-by: rjg-lyh <[email protected]>1 parent 2b97c69 commit a704967
File tree
2 files changed
+6
-2
lines changed- vllm_ascend
- patch/platform/patch_0_9_1
2 files changed
+6
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
| 28 | + | |
| 29 | + | |
28 | 30 | | |
29 | 31 | | |
30 | 32 | | |
31 | 33 | | |
32 | | - | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
33 | 38 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
22 | | - | |
0 commit comments