Skip to content

Implement CANCEL for streaming with VLM Pipeline #1725

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
ilya-lavrenov merged 8 commits into from
Mar 6, 2025
Merged

Implement CANCEL for streaming with VLM Pipeline #1725

ilya-lavrenov merged 8 commits into from
Mar 6, 2025

Conversation

@sbalandi
Copy link
Contributor

@sbalandi sbalandi commented Feb 12, 2025 •
edited
Loading

  • added support of CANCEL for streamer VLM Pipeline
  • please, note, that for phi3 added possibility to run without picture, for cases when CANCEL is happened on the step with image
  • added tests for CANCEL for VLM pipeline

@github-actions github-actions bot added the category: visual language Visual language pipeline label Feb 12, 2025
@sbalandi sbalandi force-pushed the cancel_vlm branch 4 times, most recently from 69d3622 to 12b2389 Compare February 13, 2025 13:40
@sbalandi sbalandi requested review from Wovchena and ilya-lavrenov and removed request for Wovchena February 13, 2025 20:58
@sbalandi sbalandi marked this pull request as ready for review February 13, 2025 20:58
Wovchena
Wovchena requested changes Feb 14, 2025
View reviewed changes
ilya-lavrenov
ilya-lavrenov reviewed Feb 14, 2025
View reviewed changes
ilya-lavrenov
ilya-lavrenov reviewed Feb 14, 2025
View reviewed changes
Wovchena
Wovchena reviewed Feb 14, 2025
View reviewed changes
Wovchena
Wovchena reviewed Feb 14, 2025
View reviewed changes
@sbalandi sbalandi force-pushed the cancel_vlm branch 4 times, most recently from 713a510 to 99484bf Compare February 14, 2025 22:38
Wovchena
Wovchena requested changes Feb 17, 2025
View reviewed changes
@ilya-lavrenov ilya-lavrenov added this to the 2025.1 milestone Feb 26, 2025
@sbalandi sbalandi force-pushed the cancel_vlm branch 3 times, most recently from 2237b5e to 6739a40 Compare March 3, 2025 20:37
@sbalandi sbalandi force-pushed the cancel_vlm branch 4 times, most recently from 3d7a9d5 to e5f52a2 Compare March 5, 2025 12:53
@sbalandi sbalandi requested a review from Wovchena March 5, 2025 15:26
Wovchena
Wovchena approved these changes Mar 6, 2025
View reviewed changes
ilya-lavrenov
ilya-lavrenov reviewed Mar 6, 2025
View reviewed changes
@sbalandi sbalandi force-pushed the cancel_vlm branch 2 times, most recently from 621ad30 to b0305a2 Compare March 6, 2025 16:26
@ilya-lavrenov ilya-lavrenov enabled auto-merge March 6, 2025 16:53
@ilya-lavrenov ilya-lavrenov disabled auto-merge March 6, 2025 17:48
@ilya-lavrenov ilya-lavrenov merged commit 434c2a9 into openvinotoolkit:master Mar 6, 2025
56 of 58 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Wovchena Wovchena Wovchena approved these changes

+1 more reviewer

@ilya-lavrenov ilya-lavrenov ilya-lavrenov approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@ilya-lavrenov ilya-lavrenov

@Wovchena Wovchena

Labels

category: LLM LLM pipeline (stateful, static) category: visual language Visual language pipeline no-match-files

Projects

None yet

Milestone

2025.1

Development

Successfully merging this pull request may close these issues.

3 participants

@sbalandi @ilya-lavrenov @Wovchena