Access HEVC elementary stream to use a custom decoder

[RodolpheFouquet]

Hi, I want to use my own wasm custom decoder to decode a DASH with an hevc adaptation set.

I see that I can modify this file https://github.com/Dash-Industry-Forum/dash.js/blob/development/src/streaming/utils/Capabilities.js to be able to accept an HEVC adaptation set even though the MSE check fails for it.

Then I guess, the next step should be to get the MP4 segment out of DASH.js. Do you think there is an easy way to register a callback that is triggered when a segment is loaded, parsed with an access to the segment payload?

Kind regards

[dsilhavy]

Hi,
first thing that comes to my mind is to modify the _onAppended function in the BufferController.js. You would need to add the appendedBytesInfo.bytes to the event as depicted below:

     if (appendedBytesInfo) {
            _triggerEvent(Events.BYTES_APPENDED_END_FRAGMENT, {
                quality: appendedBytesInfo.quality,
                startTime: appendedBytesInfo.start,
                index: appendedBytesInfo.index,
                bufferedRanges: ranges,
                segmentType: appendedBytesInfo.segmentType,
                mediaType: type,
                segmentData: appendedBytesInfo.bytes
            });
        }

What might be even easier is to listen to Events.MEDIA_FRAGMENT_LOADED:

player.on('mediaFragmentLoaded', _onMediaFragmentLoaded);

 function _onMediaFragmentLoaded(e) {
        // do something with e.chunk or e.request
    }

[RodolpheFouquet]

Thank you very much!