Skip to content

[Bug Fix] Fix test that requre GPU#1096

Merged
dsikka merged 4 commits intomainfrom
fix-bug-run-comp
Jan 24, 2025
Merged

[Bug Fix] Fix test that requre GPU#1096
dsikka merged 4 commits intomainfrom
fix-bug-run-comp

Conversation

@horheynm
Copy link
Copy Markdown

SUMMARY:
Nightly tests uses gpus, ci tests dont.
In the set up of tests/llmcompressor/transformers/obcq/test_consecutive_runs.py, a bug was found where quantization_config was always passed. This will result in an error if the model from the config file is not optimized.
We are passing in dense model, so it fails.

TEST PLAN:
Run the failing test, make sure it passes!

@github-actions
Copy link
Copy Markdown

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

kylesayrs
kylesayrs previously approved these changes Jan 24, 2025
Copy link
Copy Markdown
Collaborator

@kylesayrs kylesayrs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@kylesayrs kylesayrs added the ready When a PR is ready for review label Jan 24, 2025
Copy link
Copy Markdown
Collaborator

@brian-dellabetta brian-dellabetta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

left a comment but LGTM otherwise

@horheynm horheynm dismissed stale reviews from brian-dellabetta and kylesayrs via 08ce927 January 24, 2025 15:22
@horheynm horheynm changed the title Fix test that requre GPU [Bug Fix] Fix test that requre GPU Jan 24, 2025
Copy link
Copy Markdown
Collaborator

@rahul-tuli rahul-tuli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dsikka dsikka merged commit 08c4c91 into main Jan 24, 2025
@dsikka dsikka deleted the fix-bug-run-comp branch January 24, 2025 18:18
rahul-tuli pushed a commit that referenced this pull request Jan 28, 2025
SUMMARY:
Nightly tests uses gpus, ci tests dont.
In the set up of
`tests/llmcompressor/transformers/obcq/test_consecutive_runs.py`, a bug
was found where `quantization_config` was always passed. This will
result in an error if the model from the config file is not optimized.
We are passing in dense model, so it fails.

TEST PLAN:
Run the failing test, make sure it passes!

Signed-off-by: Rahul Tuli <rahul@neuralmagic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready When a PR is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants