[Feat]: Stream signal via type C/OTG cable

[cryinrain69]

Version

2.6.1

Environment that reproduces the issue

Samsung Galaxy S22 Ultra - Android 14

Use case description

Currently I know the library supports streaming through the camera and recording the device's screen.
In case I want to get the input signal from an external camera connected via a USB Type C cable, is that possible?
More broadly, the signal could be from another source such as a digital TV receiver, or another device that uses an HDMI to type C converter cable to connect to the phone.

Proposed solution

No response

Alternative solutions

No response

[ThibaultBee]

UVC camera is something I want to work on but I am really busy on other subjects.
You are asking a lot of features/questions, it might be time to start considering sponsorship or/and contributions to help the development of this library.

[cryinrain69]

I agree.

I am currently using this library for experimental development, not yet used for any released project.
And during this testing process, I found that it will need a lot of more advanced features to be able to meet the requirements for a complete project (eg: Using external camera sources, adding effects, filters, icons, text, streaming from files,... like some other developed libraries).

With the basic features as they are now, I find the quality of the library quite good, with a lot of potential.

In addition to the basic features as they are now, if your library has many other advanced features, it is completely possible to commercialize it.
And I think everyone will welcome that.

As for the issue of sponsorship, donations it is completely reasonable for any stage of development of the library 👍

[ThibaultBee]

This library is quite young compare to others.
I already have the filter you quote in mind. Most of them are quite easy to add from 3.X. It is just a matter of time.

[Rider02vn]

@ThibaultBee
UVC Camera is also a feature I'm looking to integrate.
Can you integrate it into v3?
Or can you give some suggestions on how to do it?
I found some UVC Camera libraries, it seems suitable.
https://github.com/jiangdongguo/AndroidUSBCamera
https://github.com/saki4510t/UVCCamera
https://github.com/saki4510t/OpenCVwithUVC

[ThibaultBee]

Can you integrate it into v3?

It is not what I have planned right now.

Or can you give some suggestions on how to do it?

If you want to be involved in the developement, you are welcome. You could also sponsor the project.

• Find a proper UVC library (or do we need a library?):
  • it must be maintained
  • it must be possible to pass a Surface
  • pass my validation 👍

For any dev, use branch dev_v3.

In Extensions, add a uvccamera module.
It must be dependent from StreamPack core.
The UVCCameraSource implements interfaces: ICameraSourceInternal and ISurfaceSource.

As a matter of fact, you can already create your own video sources in your application. In 2.6.X, you have to implement: IVideoSource.

[Rider02vn]

I will look into this feature and see how it goes.
Thank you.

[Rider02vn]

Also, I would like to ask when do you plan to release v3 and what notable features will it have?

[Rider02vn]

I will look into this feature and see how it goes. Thank you.

Hi
I have now got a pretty good quality signal from UVC.
But I don't know how to use it in StreamPack.
Can I send you the demo source code so you can integrate it help me? (You can leave it as a test dev branch)

[ThibaultBee]

Also, I would like to ask when do you plan to release v3 and what notable features will it have?

See bulletpoints in: #87

Can I send you the demo source code so you can integrate it help me?

You can but I have other priorities right now.

[Rider02vn]

Hi.
I'm currently using this UVC lib: shiyinghan/UVCAndroid
I've created a UVCCameraSource class in core/internal/sources as shown in the image below (using v2.6.1)
But I don't know how to use it: switch to preview signal between camera (SRT, RTMP streamer) and UVC, push it to stream,...
Can you guide me the next steps to implement it?
I will be very grateful to you.

Class UVCCameraSource:

UVCCameraSource.kt.txt

[Rider02vn]

@ThibaultBee Can u help me ? :-(

[ThibaultBee]

Hi,

Why have you choosen this library over the previous ones?

But I don't know how to use it: switch to preview signal between camera (SRT, RTMP streamer) and UVC, push it to stream,...

What are you trying to achieve exactly?

@ThibaultBee Can u help me ? :-(

I am working on my spare time on this library, thus I can't be fast. Also, I have got other priorities right now. My focus is to finish the 3.0 to finally release it.

[Rider02vn]

Hi

Why have you choosen this library over the previous ones?
The reason I chose that library is because:

1. It is still updated recently.
2. When I tested it, I found it very easy to use and gave quite good quality.
3. It is also used by another livestream library (RootEncoder) to integrate UVC Camera. Demo here

What are you trying to achieve exactly?

I am following your instructions, which is to create a UVCCameraSource class (like the image/file I sent above). I also refer to the RootEncoder library about integrating that UVC library to apply to your library, currently I have also got the signal from UVC Camera and displayed its preview (based on AspectRatioSurfaceView).
But I don't know how to push it to the livestream server. That's what I want to do.

[ThibaultBee]

Then, have a look on a streamer like the CameraRtmpLiveStreamer.

For the live stream, you should set the encoderSurface (v2.X) (outputSurface (v3.X)) instead of the previewSurface.

Once again, you should work on dev_v3.