Skip to content

Commit bbb8e00

Browse files
token_dispatcher support expert_num 64 (#11066)
1 parent 96a3977 commit bbb8e00

File tree

1 file changed

+1
-0
lines changed
  • slm/model_zoo/gpt-3/external_ops/token_dispatcher_utils

1 file changed

+1
-0
lines changed

slm/model_zoo/gpt-3/external_ops/token_dispatcher_utils/utils.h

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,5 +124,6 @@ __device__ __forceinline__ void vectorized_memcpy(const T* src,
124124
PD_SWITCH_NUM_EXPERTS_IMPL(__num_expert, 8, __VA_ARGS__); \
125125
PD_SWITCH_NUM_EXPERTS_IMPL(__num_expert, 16, __VA_ARGS__); \
126126
PD_SWITCH_NUM_EXPERTS_IMPL(__num_expert, 32, __VA_ARGS__); \
127+
PD_SWITCH_NUM_EXPERTS_IMPL(__num_expert, 64, __VA_ARGS__); \
127128
PD_THROW("Unsupported expert number %d", int(__num_expert)); \
128129
} while (0)

0 commit comments

Comments
 (0)