Skip to content

Extend EncodedVideoChunkMetadata for Spatial Scalability #756

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Extend EncodedVideoChunkMetadata for Spatial Scalability #756

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
517f6a0
Extend EncodedVideoChunkMetadata for Spatial Scalability
aboba Jan 4, 2024
c7dcedc
Move frameId and dependencies
aboba Jan 9, 2024
16ba584
Fix temporal/spatial layer assignments
aboba Jan 9, 2024
9efde67
Move frameId and dependencies
aboba Jan 9, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 33 additions & 7 deletions index.src.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -133,6 +133,10 @@
:: A grouping of {{EncodedVideoChunk}}s whose timestamp cadence produces a
particular framerate. See {{VideoEncoderConfig/scalabilityMode}}.

: <dfn>Spatial Layer</dfn>
:: A grouping of {{EncodedVideoChunk}}s which produces a particular
resolution. See {{VideoEncoderConfig/scalabilityMode}}.

: <dfn>Progressive Image</dfn>
:: An image that supports decoding to multiple levels of detail, with lower
levels becoming available while the encoded data is not yet fully buffered.
Expand Down Expand Up @@ -1644,19 +1648,29 @@
2. Assign |outputConfig| to
{{VideoEncoder/[[active output config]]}}.
7. If |encoderConfig|.{{VideoEncoderConfig/scalabilityMode}}
describes multiple [=temporal layers=] or [=spatial layers=]:
1. Let |svc| be a new {{SvcOutputMetadata}} instance.
8. If |encoderConfig|.{{VideoEncoderConfig/scalabilityMode}}
describes multiple [=temporal layers=]:
1. Let |svc| be a new {{SvcOutputMetadata}} instance.
2. Let |temporal_layer_id| be the zero-based index describing the
1. Let |temporal_layer_id| be the zero-based index describing the
temporal layer for |output|.
3. Assign |temporal_layer_id| to
2. Assign |temporal_layer_id| to
|svc|.{{SvcOutputMetadata/temporalLayerId}}.
4. Assign |svc| to
9. If |encoderConfig|.{{VideoEncoderConfig/scalabilityMode}}
describes multiple [=spatial layers=]:
1. Let |spatial_layer_id| be the zero-based index describing the
spatial layer for |output|.
2. Assign |spatial_layer_id| to
|svc|.{{SvcOutputMetadata/spatialLayerId}}.
10. If |encoderConfig|.{{VideoEncoderConfig/scalabilityMode}}
describes multiple [=temporal layers=] or [=spatial layers=]:
1. Assign |svc| to
|chunkMetadata|.{{EncodedVideoChunkMetadata/svc}}.
8. If |encoderConfig|.{{VideoEncoderConfig/alpha}} is set to `"keep"`:
11. If |encoderConfig|.{{VideoEncoderConfig/alpha}} is set to `"keep"`:
1. Let |alphaSideData| be the encoded alpha data in |output|.
2. Assign |alphaSideData| to
|chunkMetadata|.{{EncodedVideoChunkMetadata/alphaSideData}}.
9. Invoke {{VideoEncoder/[[output callback]]}} with |chunk| and
12. Invoke {{VideoEncoder/[[output callback]]}} with |chunk| and
|chunkMetadata|.
</dd>
<dt><dfn>Reset VideoEncoder</dfn> (with |exception|)</dt>
Expand Down Expand Up @@ -1700,10 +1714,13 @@
VideoDecoderConfig decoderConfig;
SvcOutputMetadata svc;
BufferSource alphaSideData;
unsigned long long frameId;
sequence <unsigned long long> dependencies;
};

dictionary SvcOutputMetadata {
unsigned long temporalLayerId;
unsigned long spatialLayerId;
};
</xmp>

Expand All @@ -1719,11 +1736,20 @@
:: A {{BufferSource}} that contains the {{EncodedVideoChunk}}'s extra alpha
channel data.

: <dfn dict-member for= EncodedVideoChunkMetadat>frameId</dfn>
:: A number that identifies the associated {{EncodedVideoChunk}}.

: <dfn dict-member for= EncodedVideoChunkMetadat>dependencies</dfn>
:: A sequence containing the {{frameId}} values that the associated {{EncodedVideoChunk}} depends on.

: <dfn dict-member for=SvcOutputMetadata>temporalLayerId</dfn>
:: A number that identifies the [=temporal layer=] for the associated
{{EncodedVideoChunk}}.


: <dfn dict-member for=SvcOutputMetadata>spatialLayerId</dfn>
:: A number that identifies the [=spatial layer=] for the associated
{{EncodedVideoChunk}}.

Configurations{#configurations}
===============================

Expand Down