Skip to content

Conversation

@ArgoZhang
Copy link
Member

@ArgoZhang ArgoZhang commented May 3, 2025

Link issues

fixes #5948

Summary By Copilot

Regression?

  • Yes
  • No

Risk

  • High
  • Medium
  • Low

Verification

  • Manual (required)
  • Automated

Packaging changes reviewed?

  • Yes
  • No
  • N/A

☑️ Self Check before Merge

⚠️ Please check all items below before review. ⚠️

  • Doc is updated/provided or not needed
  • Demo is updated/provided or not needed
  • Merge the latest code from the main branch

Summary by Sourcery

Add support for applying media track constraints to video devices, allowing dynamic adjustment of video stream properties like width and resolution

New Features:

  • Implement Apply method for video devices to modify media track constraints
  • Add buttons to change video resolution (QVGA, VGA, HD)

Enhancements:

  • Update media device interfaces to support applying constraints
  • Improve video device sample component with resolution change buttons

Tests:

  • Add unit test for Apply method in video device service

@bb-auto bb-auto bot added the enhancement New feature or request label May 3, 2025
@bb-auto bb-auto bot added this to the v9.6.0 milestone May 3, 2025
@sourcery-ai
Copy link
Contributor

sourcery-ai bot commented May 3, 2025

Reviewer's Guide

This pull request adds an Apply method to the IVideoDevice and IMediaDevices services, allowing media track constraints (like resolution and facing mode) to be applied to the active video stream. This is achieved by introducing a new JavaScript function apply that utilizes MediaStreamTrack.applyConstraints(), called via JS interop from the C# service implementations. The sample page is updated with buttons to demonstrate applying different resolutions.

Sequence Diagram for Applying Video Constraints

sequenceDiagram
    actor User
    participant RazorComponent as VideoDevices.razor
    participant VideoService as VideoDeviceService
    participant MediaJs as media.js

    User->>RazorComponent: Click 'Apply Resolution' button (e.g., VGA)
    RazorComponent->>VideoService: OnApply(640, 480)
    VideoService->>VideoService: Apply(new MediaTrackConstraints { Width = 640, Height = 480 })
    Note over VideoService, MediaJs: Service calls JS via Interop
    VideoService->>MediaJs: apply({ width: 640, height: 480 })
    MediaJs->>MediaJs: Get video track
    MediaJs->>MediaJs: Get current settings
    MediaJs->>MediaJs: Calculate exact height based on aspect ratio
    MediaJs->>MediaJs: Prepare new constraints object
    MediaJs->>MediaJs: track.applyConstraints(newSettings)
    MediaJs-->>VideoService: return success/failure
    VideoService-->>RazorComponent: Task<bool>
Loading

File-Level Changes

Change Details Files
Added Apply method to C# services and corresponding JavaScript implementation to apply media constraints.
  • Defined Apply(MediaTrackConstraints constraints) method in IMediaDevices and IVideoDevice interfaces.
  • Implemented Apply method in DefaultMediaDevices and DefaultVideoDevice to invoke JavaScript.
  • Created JavaScript apply(options) function using track.applyConstraints().
  • Added logic in JavaScript to calculate height based on width and aspect ratio.
src/BootstrapBlazor/Services/MediaDevices/IMediaDevices.cs
src/BootstrapBlazor/Services/MediaDevices/IVideoDevice.cs
src/BootstrapBlazor/Services/MediaDevices/DefaultMediaDevices.cs
src/BootstrapBlazor/Services/MediaDevices/DefaultVideoDevice.cs
src/BootstrapBlazor/wwwroot/modules/media.js
Updated the VideoDevices sample component to demonstrate applying constraints.
  • Added buttons (QVGA, VGA, HD) to trigger resolution changes.
  • Implemented OnApply C# handler to call the VideoDeviceService.Apply method.
  • Adjusted CSS for button layout (.bb-actions) and media element margins.
src/BootstrapBlazor.Server/Components/Samples/VideoDevices.razor
src/BootstrapBlazor.Server/Components/Samples/VideoDevices.razor.cs
src/BootstrapBlazor.Server/Components/Samples/VideoDevices.razor.css
Updated unit tests to cover the new Apply functionality.
  • Added JS interop setup for the apply function.
  • Included test assertions for the service.Apply method call.
test/UnitTest/Services/VideoDeviceTest.cs

Assessment against linked issues

Issue Objective Addressed Explanation
#5948 Add an Apply method to the IVideoDevice interface.

Possibly linked issues


Tips and commands

Interacting with Sourcery

  • Trigger a new review: Comment @sourcery-ai review on the pull request.
  • Continue discussions: Reply directly to Sourcery's review comments.
  • Generate a GitHub issue from a review comment: Ask Sourcery to create an
    issue from a review comment by replying to it. You can also reply to a
    review comment with @sourcery-ai issue to create an issue from it.
  • Generate a pull request title: Write @sourcery-ai anywhere in the pull
    request title to generate a title at any time. You can also comment
    @sourcery-ai title on the pull request to (re-)generate the title at any time.
  • Generate a pull request summary: Write @sourcery-ai summary anywhere in
    the pull request body to generate a PR summary at any time exactly where you
    want it. You can also comment @sourcery-ai summary on the pull request to
    (re-)generate the summary at any time.
  • Generate reviewer's guide: Comment @sourcery-ai guide on the pull
    request to (re-)generate the reviewer's guide at any time.
  • Resolve all Sourcery comments: Comment @sourcery-ai resolve on the
    pull request to resolve all Sourcery comments. Useful if you've already
    addressed all the comments and don't want to see them anymore.
  • Dismiss all Sourcery reviews: Comment @sourcery-ai dismiss on the pull
    request to dismiss all existing Sourcery reviews. Especially useful if you
    want to start fresh with a new review - don't forget to comment
    @sourcery-ai review to trigger a new review!

Customizing Your Experience

Access your dashboard to:

  • Enable or disable review features such as the Sourcery-generated pull request
    summary, the reviewer's guide, and others.
  • Change the review language.
  • Add, remove or edit custom review instructions.
  • Adjust other review settings.

Getting Help

@ArgoZhang ArgoZhang merged commit f57315d into main May 3, 2025
4 checks passed
@ArgoZhang ArgoZhang deleted the refactor-video branch May 3, 2025 04:07
Copy link
Contributor

@sourcery-ai sourcery-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @ArgoZhang - I've reviewed your changes - here's some feedback:

  • The JavaScript apply function appears to always return false; consider returning true upon successful application of constraints.
  • Using exact constraints in applyConstraints might cause errors on some devices; consider using ideal for better compatibility.
Here's what I looked at during the review
  • 🟡 General issues: 2 issues found
  • 🟢 Security: all looks good
  • 🟡 Testing: 1 issue found
  • 🟢 Complexity: all looks good
  • 🟢 Documentation: all looks good

Sourcery is free for open source - if you like our reviews please consider sharing them ✨
Help me be more useful! Please click 👍 or 👎 on each comment and I'll use the feedback to improve your reviews.

return ret;
}

export async function apply(options) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion (bug_risk): Return value is never updated on success.

ret remains false even on success; update it (or return true) when constraints apply successfully.

Suggested implementation:

            ret = true;
        }
    } catch (ex) {

Please verify that inserting ret = true at this position fits the overall logic, meaning that the constraints have been applied by this point. You might need to adjust the placement if additional logic should occur before returning a successful value.

Comment on lines +91 to +98
if (options.width) {
settings.width = {
exact: options.width,
};
settings.height = {
exact: Math.floor(options.width / aspectRatio)
};
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion: Inconsistency between JS applied constraints and provided parameters.

The function ignores options.height even when passed; either apply options.height to the constraints or update the interface to explicitly reflect that only width is used.

Suggested change
if (options.width) {
settings.width = {
exact: options.width,
};
settings.height = {
exact: Math.floor(options.width / aspectRatio)
};
}
if (options.width) {
settings.width = {
exact: options.width,
};
if (options.height) {
settings.height = {
exact: options.height,
};
} else {
settings.height = {
exact: Math.floor(options.width / aspectRatio)
};
}
}

Comment on lines 45 to +49
var close = await service.Close(".bb-video");
Assert.True(close);

var apply = await service.Apply(new MediaTrackConstraints() { Width = 640, Height = 480, VideoSelector = ".bb-video" });
Assert.True(apply);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion (testing): Consider testing failure scenarios for the Apply method.

Add tests for when the JS interop call for apply returns false and when it throws an exception.

@codecov
Copy link

codecov bot commented May 3, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 100.00%. Comparing base (94c27d8) to head (38255ce).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff            @@
##              main     #5949   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files          669       669           
  Lines        30548     30555    +7     
  Branches      4348      4348           
=========================================
+ Hits         30548     30555    +7     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

refactor(IVideoDevice): add Apply method

2 participants