Skip to content

Conversation

@psainics
Copy link
Contributor

@psainics psainics commented Jan 21, 2025

🍒 [cherrypick]

Commits :

PR:


Error Management catch known errors [GCSCopy]

Jira : PLUGIN-1841

Description

  • Remove unused imports
  • Error Management catch known errors

Code change

  • Modified GCSCopy.java.java

Test

  • Test Case (File does not exist on path provided)
Raw Logs
2025-01-13 13:16:17,350 - ERROR [WorkflowDriver:i.c.c.i.a.r.w.WorkflowProgramController@90] - Workflow service 'workflow.default.GCS_COPY_TEST_RUN.DataPipelineWorkflow.714f70f0-d182-11ef-88e1-00000036fa10' failed.
io.cdap.cdap.api.exception.WrappedStageException: Stage 'GCS Copy' encountered : io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Failed to create storage client, unable to load service account credentials. /Users/pusaini/cbin/cred/GCP_invalid.json (No such file or directory)
  at io.cdap.cdap.etl.common.plugin.ExceptionWrappingCaller.call(ExceptionWrappingCaller.java:64)
  at io.cdap.cdap.etl.common.plugin.WrappedAction.run(WrappedAction.java:48)
  at io.cdap.cdap.etl.batch.customaction.PipelineAction.run(PipelineAction.java:91)
  at io.cdap.cdap.internal.app.runtime.AbstractContext.execute(AbstractContext.java:608)
  at io.cdap.cdap.internal.app.runtime.workflow.CustomActionExecutor.execute(CustomActionExecutor.java:90)
  at io.cdap.cdap.internal.app.runtime.workflow.WorkflowDriver.executeCustomAction(WorkflowDriver.java:449)
  at io.cdap.cdap.internal.app.runtime.workflow.WorkflowDriver.executeNode(WorkflowDriver.java:489)
  at io.cdap.cdap.internal.app.runtime.workflow.WorkflowDriver.executeAll(WorkflowDriver.java:669)
  at io.cdap.cdap.internal.app.runtime.workflow.WorkflowDriver.run(WorkflowDriver.java:653)
  at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:52)
  at java.lang.Thread.run(Thread.java:750)
Caused by: io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Failed to create storage client, unable to load service account credentials. /Users/pusaini/cbin/cred/GCP_invalid.json (No such file or directory)
  at io.cdap.cdap.etl.validation.DefaultFailureCollector.getOrThrowException(DefaultFailureCollector.java:78)
  at io.cdap.cdap.etl.validation.LoggingFailureCollector.getOrThrowException(LoggingFailureCollector.java:50)
  at io.cdap.plugin.gcp.gcs.actions.GCSCopy.run(GCSCopy.java:73)
  at io.cdap.cdap.etl.common.plugin.WrappedAction.lambda$run$1(WrappedAction.java:49)
  at io.cdap.cdap.etl.common.plugin.Caller$1.call(Caller.java:30)
  at io.cdap.cdap.etl.common.plugin.ExceptionWrappingCaller.call(ExceptionWrappingCaller.java:62)
  ... 10 common frames omitted

POST v3/namespaces/{namespace-id}/apps/{app-id}/workflows/DataPipelineWorkflow/runs/{run-id}/classify
[
{
  "stageName": "GCS Copy",
  "errorCategory": "Plugin-'Validation'-'GCS Copy'",
  "errorReason": "Stage 'GCS Copy' encountered 1 validation failures.",
  "errorMessage": "Stage 'GCS Copy' encountered : io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Failed to create storage client, unable to load service account credentials. /Users/pusaini/cbin/cred/GCP_invalid.json (No such file or directory)",
  "errorType": "USER",
  "dependency": "false"
}
]

image
image

@psainics psainics self-assigned this Jan 21, 2025
@psainics psainics marked this pull request as ready for review January 21, 2025 21:16
@psainics psainics force-pushed the cherry-pick/b3057e2842d138f235e342ef3ac74c5ceeb92fd6 branch from 272aa20 to 21b955c Compare January 22, 2025 00:43
@psainics psainics added the build Trigger unit test build label Jan 22, 2025
@psainics psainics merged commit fb80a86 into data-integrations:release/0.24 Jan 22, 2025
17 of 18 checks passed
@psainics psainics deleted the cherry-pick/b3057e2842d138f235e342ef3ac74c5ceeb92fd6 branch January 22, 2025 02:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build Trigger unit test build

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants