Skip to content

Add Qwen3-Coder awq moe example#1863

Merged
fynnsu merged 4 commits intomainfrom
add_qwen3_coder_example
Sep 26, 2025
Merged

Add Qwen3-Coder awq moe example#1863
fynnsu merged 4 commits intomainfrom
add_qwen3_coder_example

Conversation

@fynnsu
Copy link
Copy Markdown
Collaborator

@fynnsu fynnsu commented Sep 24, 2025

SUMMARY:
Add a Qwen3-Coder awq example based on https://huggingface.co/nm-testing/Qwen3-Coder-30B-A3B-Instruct-W4A16-awq.

TEST PLAN:
Ran script locally and verified resulting model outputs were reasonable.

Prompt: "Write a binary search function"
Output:

def binary_search(arr, target):
    left = 0
    right = len(arr) - 1

    while left <= right:
        mid = (left + right) // 2

        if arr[mid] == target:
            return mid
        elif arr[mid] < target:
            left = mid + 1
        else:
            right = mid - 1

    return -1

@github-actions
Copy link
Copy Markdown

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
@fynnsu fynnsu force-pushed the add_qwen3_coder_example branch from eebe131 to 3756f10 Compare September 26, 2025 16:08
@fynnsu fynnsu marked this pull request as ready for review September 26, 2025 17:24
@fynnsu fynnsu added the ready When a PR is ready for review label Sep 26, 2025
Copy link
Copy Markdown
Collaborator

@brian-dellabetta brian-dellabetta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks great! excited to have this in

Copy link
Copy Markdown
Collaborator

@shanjiaz shanjiaz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice

@fynnsu fynnsu merged commit 3e721cb into main Sep 26, 2025
8 checks passed
@fynnsu fynnsu deleted the add_qwen3_coder_example branch September 26, 2025 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready When a PR is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants