mysql normalization failed

[nikunjgajera]

2023-12-21 14:12:58 normalization > from pydantic import AnyUrl, BaseModel, Extra, Field
2023-12-21 14:12:58 normalization > File "pydantic/init.py", line 2, in init pydantic.init
2023-12-21 14:12:58 normalization > File "pydantic/dataclasses.py", line 41, in init pydantic.dataclasses
2023-12-21 14:12:58 normalization > # | | No action: no method is added. |
2023-12-21 14:12:58 normalization > ImportError: cannot import name dataclass_transform
2023-12-21 14:12:58 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=sync_892, RunId=cb01ad4d-3191-4e3a-a460-3cc5224c3714, WorkflowType=SyncWorkflow
io.temporal.failure.ActivityFailure: scheduledEventId=24, startedEventId=25, activityType='Normalize', activityId='788a80eb-aacb-3fb2-b9b3-bb6883c0cf8d', identity='1@2ae255f3e053', retryState=RETRY_STATE_MAXIMUM_ATTEMPTS_REACHED
at java.lang.Thread.getStackTrace(Thread.java:2550) ~[?:?]
at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.8.1.jar:?]
at jdk.proxy2.$Proxy58.normalize(Unknown Source) ~[?:?]
at io.airbyte.workers.temporal.sync.SyncWorkflowImpl.run(SyncWorkflowImpl.java:91) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]

2023-12-20 11:52:24 INFO i.a.w.g.DefaultNormalizationWorker(run):69 - Normalization failed
2023-12-20 11:52:24 normalization > Traceback (most recent call last):
2023-12-20 11:52:24 normalization > File "/usr/local/bin/transform-config", line 5, in
2023-12-20 11:52:24 normalization > from normalization.transform_config.transform import main
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/init.py", line 2, in
2023-12-20 11:52:24 INFO i.a.w.g.DefaultNormalizationWorker(run):73 - Normalization catch block exception---> {}.
io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:204) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:72) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:159) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at java.lang.Thread.run(Thread.java:1589) [?:?]
2023-12-20 11:52:24 normalization > from normalization.transform_catalog.transform import TransformCatalog
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/init.py", line 1, in
2023-12-20 11:52:24 normalization > from normalization.transform_catalog.transform import TransformCatalog
2023-12-20 11:52:24 INFO i.a.w.g.DefaultNormalizationWorker(run):84 - Normalization executed in 0 seconds.
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 12, in
2023-12-20 11:52:24 normalization > from normalization.transform_catalog.catalog_processor import CatalogProcessor
2023-12-20 11:52:24 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):162 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:94) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:159) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at java.lang.Thread.run(Thread.java:1589) [?:?]
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 12, in
2023-12-20 11:52:24 normalization > from airbyte_cdk.models import DestinationSyncMode, SyncMode
2023-12-20 11:52:24 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling...
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/init.py", line 5, in
2023-12-20 11:52:24 normalization > from .connector import AirbyteSpec, Connector
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/connector.py", line 14, in
2023-12-20 11:52:24 normalization > from airbyte_cdk.models import AirbyteConnectionStatus, ConnectorSpecification
2023-12-20 11:52:24 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating...
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/models/init.py", line 8, in
2023-12-20 11:52:24 normalization > from .airbyte_protocol import (
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/models/airbyte_protocol.py", line 5, in
2023-12-20 11:52:24 normalization > from airbyte_protocol.models import *
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_protocol/init.py", line 25, in
2023-12-20 11:52:24 normalization > from .models import (
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_protocol/models/init.py", line 3, in
2023-12-20 11:52:24 normalization > from .airbyte_protocol import *
2023-12-20 11:52:24 normalization > File "/usr/local/lib/python3.9/site-packages/airbyte_protocol/models/airbyte_protocol.py", line 9, in
2023-12-20 11:52:24 normalization > from pydantic import AnyUrl, BaseModel, Extra, Field
2023-12-20 11:52:24 normalization > File "pydantic/init.py", line 2, in init pydantic.init
2023-12-20 11:52:24 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=c7b6ceaf-3faa-3d6c-afd3-bc54bb3cd52e, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:310) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:80) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) [?:?]
at java.lang.Thread.run(Thread.java:1589) [?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?]
at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?]
at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?]
at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:136) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]
at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-workers-0.40.6.jar:?]

[marcosmarxm]

I'm closing because it lacks a lot of information and context. Please reopen a new discussion and add more data to the community help you:

• What version of the platform are you using
• What source and what version are you using, the same for destination.
• Are you creating a new connection, did you upgraded recently?

Try to think what more you can add to make the problem clear and reproducible.
Also, spend some time looking into the error stack trace to find a more meaningful title to your problem, the current it is generic and doesn't help.