Skip to content

Node Supported Bitwidth Filtering Bugfix#1422

Merged
yarden-yagil-sony merged 8 commits intomainfrom
bugfix/qc_filtering
Apr 24, 2025
Merged

Node Supported Bitwidth Filtering Bugfix#1422
yarden-yagil-sony merged 8 commits intomainfrom
bugfix/qc_filtering

Conversation

@yarden-yagil-sony
Copy link
Copy Markdown
Contributor

Pull Request Description:

Filter out nodes without enable quantization and not preserving

Checklist before requesting a review:

  • I set the appropriate labels on the pull request.
  • I have added/updated the release note draft (if necessary).
  • I have updated the documentation to reflect my changes (if necessary).
  • All function and files are well documented.
  • All function and classes have type hints.
  • There is a licenses in all file.
  • The function and variable names are informative.
  • I have checked for code duplications.
  • I have added new unittest (if necessary).

Copy link
Copy Markdown
Contributor

@elad-c elad-c left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need test for it...

@ofirgo
Copy link
Copy Markdown
Contributor

ofirgo commented Apr 23, 2025

Can you please explain what was the bug here?
@yarden-yagil-sony

for qc_opts in next_nodes_qc_options
for op_cfg in qc_opts.quantization_configurations])
for op_cfg in qc_opts.quantization_configurations
if op_cfg.enable_activation_quantization or op_cfg.quantization_preserving
Copy link
Copy Markdown
Contributor Author

@yarden-yagil-sony yarden-yagil-sony Apr 23, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ofirgo
here the "if" condition was missing, which led to considering cq of nodes with enable_activation_quantization=False and quantization_preserving=False.
It leds to error when these irrelevant nodes support only 8 and not both 8 and 16 bit, resulting in a node manually set to bithwidth16 but support only 8 bit (since we take the minimum of preserving next nodes supported bitwidth, line 131).

@yarden-yagil-sony yarden-yagil-sony merged commit 532f6ee into main Apr 24, 2025
31 checks passed
@ofirgo ofirgo deleted the bugfix/qc_filtering branch July 2, 2025 12:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants