Skip to content

Feat (common/quantizer): Enable passing custom quantizers#1456

Open
pablomlago wants to merge 2 commits intoXilinx:devfrom
pablomlago:feat/custom-quantizer
Open

Feat (common/quantizer): Enable passing custom quantizers#1456
pablomlago wants to merge 2 commits intoXilinx:devfrom
pablomlago:feat/custom-quantizer

Conversation

@pablomlago
Copy link
Collaborator

@pablomlago pablomlago commented Feb 12, 2026

Reason for this PR

Currently, every time we need to support a new quantization type, we need to modify our entry-point in several ways (e.g., new args, new option in the dict), and this process does not scale up with more advanced quantization schemes.

Changes made in this PR

  • Added a generic Registry helper to python_utils.py with a decorator-based API.
  • Created base class for custom quantizers (BaseQuantizer).
  • Added new custom-quantizer argument to the LLM entrypoint.
  • Added example demonstrating custom quantizer registration using the new registry.

Testing Summary

  • Added new test in test_llm_cases.py.

Risk Highlight

  • This PR includes code from another work (please detail).
  • This PR contains API-breaking changes.
  • This PR depends on work in another PR (please provide links/details).
  • This PR introduces new dependencies (please detail).
  • There are coverage gaps not covered by tests.
  • Documentation updates required in subsequent PR.

@pablomlago pablomlago marked this pull request as ready for review February 12, 2026 19:29
@pablomlago pablomlago requested a review from Giuseppe5 February 12, 2026 19:29
@pablomlago pablomlago changed the title Feat (common/quantizer): Proposal for custom quantizers Feat (common/quantizer): Enable passing custom quantizers Feb 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant