Error while consumer pull data transfer (OAuth2.0 anabled EndpointDataReference ) #4355

XMasud · 2024-07-10T20:23:55Z

XMasud
Jul 10, 2024

I want to exchange data between two connectors based on consumer pull (eclipse-edc/Samples). My endpoint data reference is protected by OAuth 2.0(Keycloak). I have created my asset meta models dataAddress like

 "dataAddress": {
    "type": "HttpData",
    "name": "Test Repo Url",
    "baseUrl": "http://host.docker.internal:8087/microservice1/home",
    "proxyPath": "true",
    "proxyQueryParams": "true",
    "proxyMethod": "false",
    "oauth2:tokenUrl": "http://host.docker.internal:9096/realms/Crypto/protocol/openid-connect/token",
    "oauth2:clientId": "**********",
    "oauth2:clientSecretKey": "***********",
    "oauth2:grantType": "client_credentials"
  }

In order to read the data, I have used

curl --location --request GET 'http://localhost:19291/public/' --header 'Authorization: <edr authorization attribute>'

But it returns 500 Server errors. It shows OAuth2: Cannot resolve client secret from the vault

Stacktraces in the logs:

DEBUG 2024-07-14T23:36:12.816686303 DSP: Incoming TransferRequestMessage for class org.eclipse.edc.connector.controlplane.transfer.spi.types.TransferProcess process
DEBUG 2024-07-14T23:36:12.856915273 TransferProcess 7df1a854-ffd2-4f30-a4ed-45ca8a063811 is now in state INITIAL
DEBUG 2024-07-14T23:36:13.566127819 [TransferProcessManagerImpl] TransferProcess 7df1a854-ffd2-4f30-a4ed-45ca8a063811 is now in state PROVISIONING
DEBUG 2024-07-14T23:36:13.573802939 TransferProcess: ID 7df1a854-ffd2-4f30-a4ed-45ca8a063811. Provisioning
DEBUG 2024-07-14T23:36:13.59875712 [TransferProcessManagerImpl] TransferProcess 7df1a854-ffd2-4f30-a4ed-45ca8a063811 is now in state PROVISIONED
DEBUG 2024-07-14T23:36:13.602322849 [TransferProcessManagerImpl] TransferProcess 7df1a854-ffd2-4f30-a4ed-45ca8a063811 is now in state STARTING
DEBUG 2024-07-14T23:36:13.612176385 TransferProcess: ID 7df1a854-ffd2-4f30-a4ed-45ca8a063811. Initiate data flow
DEBUG 2024-07-14T23:36:13.646554772 Resolving secret private-key
DEBUG 2024-07-14T23:36:14.384960962 [DataPlaneManagerImpl] DataFlow 7df1a854-ffd2-4f30-a4ed-45ca8a063811 is now in state STARTED
DEBUG 2024-07-14T23:36:14.393388949 TransferProcess: ID 7df1a854-ffd2-4f30-a4ed-45ca8a063811. send transfer start to http://host.docker.internal:29194/protocol
DEBUG 2024-07-14T23:36:14.517012167 TransferProcess: ID 7df1a854-ffd2-4f30-a4ed-45ca8a063811. send transfer start to http://host.docker.internal:29194/protocol
DEBUG 2024-07-14T23:36:14.518876497 [TransferProcessManagerImpl] TransferProcess 7df1a854-ffd2-4f30-a4ed-45ca8a063811 is now in state STARTED
DEBUG 2024-07-14T23:37:02.191386931 Resolving secret public-key
DEBUG 2024-07-14T23:37:02.244474325 Resolving secret *********
SEVERE 2024-07-14T23:37:02.253475104 JerseyExtension: Unexpected exception caught
org.eclipse.edc.spi.EdcException: Cannot authenticate through OAuth2: Cannot resolve client secret from the vault: ********
        at org.eclipse.edc.connector.dataplane.http.oauth2.Oauth2HttpRequestParamsDecorator.lambda$decorate$1(Oauth2HttpRequestParamsDecorator.java:45)
        at org.eclipse.edc.spi.result.AbstractResult.orElseThrow(AbstractResult.java:119)
        at org.eclipse.edc.connector.dataplane.http.oauth2.Oauth2HttpRequestParamsDecorator.decorate(Oauth2HttpRequestParamsDecorator.java:45)
        at org.eclipse.edc.connector.dataplane.http.params.HttpRequestParamsProviderImpl.lambda$provideSourceParams$0(HttpRequestParamsProviderImpl.java:58)
        at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
        at org.eclipse.edc.connector.dataplane.http.params.HttpRequestParamsProviderImpl.provideSourceParams(HttpRequestParamsProviderImpl.java:58)
        at org.eclipse.edc.connector.dataplane.http.pipeline.HttpDataSourceFactory.createSource(HttpDataSourceFactory.java:79)
        at org.eclipse.edc.connector.dataplane.framework.pipeline.PipelineServiceImpl.transfer(PipelineServiceImpl.java:113)
        at org.eclipse.edc.connector.dataplane.api.controller.DataPlanePublicApiV2Controller.processRequest(DataPlanePublicApiV2Controller.java:172)
        at org.eclipse.edc.connector.dataplane.api.controller.DataPlanePublicApiV2Controller.handle(DataPlanePublicApiV2Controller.java:150)
        at org.eclipse.edc.connector.dataplane.api.controller.DataPlanePublicApiV2Controller.get(DataPlanePublicApiV2Controller.java:76)
        at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
        at java.base/java.lang.reflect.Method.invoke(Method.java:578)
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:146)
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:189)
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:159)
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:93)
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:478)
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:400)
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
        at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:274)
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
        at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
        at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
        at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:266)
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:253)
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:696)
        at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
        at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:312)
        at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:764)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:529)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1381)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1303)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:192)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122)
        at org.eclipse.jetty.server.Server.handle(Server.java:563)
        at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598)
        at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100)
        at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53)
        at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:421)
        at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:390)
        at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:277)
        at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
        at java.base/java.lang.Thread.run(Thread.java:1623)

I am also attaching my asset metamodel and other configuration's public gist.

https://gist.github.com/XMasud/d5878e0d45f0132eb596befc61ed46cf

I would appreciate any suggestions you guys might have

Thanks in advance.

Answered by ndr-brt

Jul 17, 2024

I think the stack trace is pretty clear:
Cannot authenticate through OAuth2: Cannot resolve client secret from the vault: ********

the secret is not found in the vault, if you are using the in memory vault you need to "seed" it in some way

View full answer

ndr-brt · 2024-07-11T06:38:39Z

ndr-brt
Jul 11, 2024
Collaborator

the description is too vague to tell, please add more details, e.g. which call gives you 500? Are there any stacktraces in the logs?

3 replies

XMasud Jul 11, 2024
Author

@ndr-brt I have updated my question

ndr-brt Jul 17, 2024
Collaborator

I think the stack trace is pretty clear:
Cannot authenticate through OAuth2: Cannot resolve client secret from the vault: ********

the secret is not found in the vault, if you are using the in memory vault you need to "seed" it in some way

Answer selected by XMasud

XMasud Jul 22, 2024
Author

@ndr-brt Thanks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Error while consumer pull data transfer (OAuth2.0 anabled EndpointDataReference ) #4355

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Replies: 1 comment 3 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Error while consumer pull data transfer (OAuth2.0 anabled EndpointDataReference ) #4355

Uh oh!

Uh oh!

XMasud Jul 10, 2024

Replies: 1 comment · 3 replies

Uh oh!

ndr-brt Jul 11, 2024 Collaborator

Uh oh!

XMasud Jul 11, 2024 Author

Uh oh!

Uh oh!

ndr-brt Jul 17, 2024 Collaborator

Uh oh!

XMasud Jul 22, 2024 Author

XMasud
Jul 10, 2024

Replies: 1 comment 3 replies

ndr-brt
Jul 11, 2024
Collaborator

XMasud Jul 11, 2024
Author

ndr-brt Jul 17, 2024
Collaborator

XMasud Jul 22, 2024
Author