Skip to content

[Audio] Add whisper fp8 dynamic example#1111

Merged
mgoin merged 1 commit intomainfrom
kylesayrs/multimodal-fp8
Jan 29, 2025
Merged

[Audio] Add whisper fp8 dynamic example#1111
mgoin merged 1 commit intomainfrom
kylesayrs/multimodal-fp8

Conversation

@kylesayrs
Copy link
Copy Markdown
Collaborator

@kylesayrs kylesayrs commented Jan 28, 2025

Purpose

  • Add example of quantizing multimodal model with FP8 dynamic

Changes

  • Add whisper FP8 example, collaborated with @mgoin

Testing

  • Ran example to mention

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
@github-actions
Copy link
Copy Markdown

👋 Hi! Thank you for contributing to llm-compressor. Please add the ready label when the PR is ready for review.

Note: This is required to complete the testing suite, please only add the label once the PR is code complete and local testing has been performed.

@kylesayrs kylesayrs changed the title add whisper fp8 dynamic example [Audio] Add whisper fp8 dynamic example Jan 28, 2025
@kylesayrs kylesayrs added the ready When a PR is ready for review label Jan 28, 2025
@kylesayrs kylesayrs marked this pull request as ready for review January 28, 2025 20:32
@mgoin mgoin merged commit 999d660 into main Jan 29, 2025
8 checks passed
@mgoin mgoin deleted the kylesayrs/multimodal-fp8 branch January 29, 2025 23:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready When a PR is ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants