[Explainer] Proposal for exposing the state of video effects on a MediaStreamTrack from camera capture

[markafoltz]

Hello,

@alvestrand asked me to post a link here to an explainer that @brychanrobot and I recently posted with a proposal for exposing camera effects state on a MediaStreamTrack, with an initial focus on background blur.

https://github.com/mfoltzgoogle/camera-effects

WICG/proposals#166

I understand there is already some spec language around this by exposing blur state through constraints: #49
So I will be looking at how the proposal aligns with that.

@alvestrand was kind enough to review the explainer and provide early feedback which is tracked in the following issues:

• Explain interaction with contraints markafoltz/camera-effects#4
• Architect new MediaStreamTrack API properly markafoltz/camera-effects#3
• Explore interaction between backgroundBlur controls on MediaStreamTrack markafoltz/camera-effects#2

I'm happy to take early feedback here as well, in particular from @eehakkin @youennf @riju - but may transfer it to issues in my own repo to better keep track of open work items.

I also will update this post as issues are closed out in the upstream repo.

CC @brychanrobot

[markafoltz]

The following breakout session will discuss this proposal in more detail:

w3c/tpac2024-breakouts#94

[markafoltz]

Thank you to @guidou and @riju for feedback on issues in https://github.com/markafoltz/camera-effects. Discussion is continuing in markafoltz/camera-effects#4, and look forward to continuing discussion at the breakout next week.

[youennf]

See also w3c/webcodecs#841 that adds a registry entry.
It would be nice to do a PR for that metadata here.