How to authorize for downloading KafkaConnect build.plugins in private storage or package

[comstering]

I have custom plugin in s3 or github private repository release file.

But KafkaConnect CRD spec.build.plugins don't set credentials.

How to download file in s3 or private repository?

[im-konge]

TBH I think there is not a way how to "authorize" to such private registries or to AWS S3 bucket.
But if there are some difficulties like this, you can create your own Dockerfile and build the image without use of the Connect Build feature.
The plugins (in .jar, .tgz or like Maven artifacts) are taken as they are, there is not any authentication or authorization to anything.

[im-konge]

Maybe (I read it on StackOverflow TBH 😀) you can do something like this: https://_:[email protected]/myorg/myrepo/com/org/mypackage/1.0.0/mypackage-1.0.0.jar and pass the token as an env variable? But that's just my guessing.

[im-konge]

And I see this for S3 - https://docs.aws.amazon.com/AmazonS3/latest/API/sigv4-query-string-auth.html
Would it be usable? But TBH I never tried it :)

[comstering]

I haven't wanted to use Dockerfile.

I tried github maven package with secret token.
I got it.

But this way is that the GitHub access token is either set to never expire or requires periodic replacement.

Thank for your help

[im-konge]

Yeah I know, but I'm glad that you figured it out at least in some way.