java.lang.RuntimeException: Unable to deserialize PartialAirbyteMessage

[marcraminv]

Hey, community

I am trying to run a stream from Postgres to Snowflake. This stream is composed of 2 fields, both of them strings. It is a simple connection between Postgres and Snowflake. In the middle of the job the stream fails with the error:

First warning:

2024-04-23 03:37:11 destination > WARN main i.a.c.j.Jsons(handleDeserThrowable):424 Failed to deserialize json due to class com.fasterxml.jackson.databind.JsonMappingException
        at com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:402)
        at com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:361)
        at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.wrapAndThrow(BeanDeserializerBase.java:1853)
        at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:316)
        at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:177)
        at com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:129)
        at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:314)
        at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:177)
        at com.fasterxml.jackson.databind.deser.DefaultDeserializationContext.readRootValue(DefaultDeserializationContext.java:323)
        at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4825)
        at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3772)
        at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3740)
        at io.airbyte.commons.json.Jsons.tryDeserializeExact(Jsons.java:130)
        at io.airbyte.cdk.integrations.destination_async.AsyncStreamConsumer.deserializeAirbyteMessage(AsyncStreamConsumer.java:178)
        at io.airbyte.cdk.integrations.destination_async.AsyncStreamConsumer.accept(AsyncStreamConsumer.java:151)
        at io.airbyte.cdk.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:321)
        at io.airbyte.cdk.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:301)
        at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:190)
        at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.java:125)
        at io.airbyte.cdk.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.java:88)
        at io.airbyte.integrations.destination.snowflake.SnowflakeDestinationRunner.main(SnowflakeDestinationRunner.java:20)

Error message

2024-04-23 03:39:50 platform > failures: [ {
  "failureOrigin" : "destination",
  "failureType" : "system_error",
  "internalMessage" : "java.lang.RuntimeException: Unable to deserialize PartialAirbyteMessage.",
  "externalMessage" : "Something went wrong in the connector. See the logs for more details.",
  "metadata" : {
    "attemptNumber" : 9,
    "jobId" : 15749,
    "from_trace_message" : true,
    "connector_command" : "write"
  },
  "stacktrace" : "java.lang.RuntimeException: Unable to deserialize PartialAirbyteMessage.\n\tat io.airbyte.cdk.integrations.destination_async.AsyncStreamConsumer.lambda$deserializeAirbyteMessage$0(AsyncStreamConsumer.java:179)\n\tat java.base/java.util.Optional.orElseThrow(Optional.java:403)\n\tat io.airbyte.cdk.integrations.destination_async.AsyncStreamConsumer.deserializeAirbyteMessage(AsyncStreamConsumer.java:179)\n\tat io.airbyte.cdk.integrations.destination_async.AsyncStreamConsumer.accept(AsyncStreamConsumer.java:151)\n\tat io.airbyte.cdk.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:321)\n\tat io.airbyte.cdk.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:301)\n\tat io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:190)\n\tat io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.java:125)\n\tat io.airbyte.cdk.integrations.base.adaptive.AdaptiveDestinationRunner$Runner.run(AdaptiveDestinationRunner.java:88)\n\tat io.airbyte.integrations.destination.snowflake.SnowflakeDestinationRunner.main(SnowflakeDestinationRunner.java:20)\n",
  "timestamp" : 1713843530064
}

Would you happen to know how to get proper logging information? Why is it failing?

Some information about the stack
Deployment method: Docker containers
Airbyte version: 0.56.0
Postgres connector: 3.3.27
Snowflake connector: 3.6.6