-
Notifications
You must be signed in to change notification settings - Fork 3.1k
Silu op opt #4718
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Silu op opt #4718
Conversation
|
Thanks for your contribution! |
|
|
| text_encoder_runtime = create_ort_runtime( | ||
| args.model_dir, args.text_encoder_model_prefix, args.model_format, device_id=device_id | ||
| text_encoder_runtime = create_paddle_inference_runtime( | ||
| args.model_dir, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这个文件暂时先不要修改
| resnet_act_fn=resnet_act_fn, | ||
| resnet_groups=resnet_groups, | ||
| resnet_time_scale_shift=resnet_time_scale_shift, | ||
| resnet_pre_temb_non_linearity=False, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这里是固定为False吗
|
|
||
| # 3. down | ||
| down_block_res_samples = (sample,) | ||
| down_nonlinear_temb = self.down_resnet_temb_nonlinearity(emb) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这应该给个判断吧,只有resnet_pre_temb_non_linearity=True的时候才做这个
|
|
||
| # 3. down | ||
| down_block_res_samples = (sample,) | ||
| down_nonlinear_temb = self.down_resnet_temb_nonlinearity(emb) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
考虑这里是否需要对resnet_pre_temb_non_linearity先进行判断后再对down_nonlinear_temb进行赋值
like
if resnet_pre_temb_non_linearity:
down_nonlinear_temb = self.down_resnet_temb_nonlinearity(emb)
else:
down_nonlinear_temb = emb
|
This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。 |
|
This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。 |
|
This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。 |
|
This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。 |
|
Automatically closed by Paddle-bot. |
PR types
Performance optimization
PR changes
Models
Description
merge silu op as producer


here is difference: