Not able to connect my mongodb to postgres on airbyte #29938
Unanswered
vatsal-kavida
asked this question in
Connector Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I have setup a mongodb saource on airbyte and a postgres destination , now when trying to connect these these , then I get the below mentioned error during configuring the connection ->
Internal message: com.mongodb.MongoCommandException: Command failed with error 40353 (Location40353): 'Invalid $project :: caused by :: FieldPath must not end with a '.'.' on server dev-db-master-replica.kavida.ai:27017. The full response is {"ok": 0.0, "errmsg": "Invalid $project :: caused by :: FieldPath must not end with a '.'.", "code": 40353, "codeName": "Location40353"}
Failure type: system_error
when I checked the logs it shows something like this ->
2023-08-29 12:23:53 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/f5a9d2e8-bb4f-47f8-bcfd-aef730191b73/0/logs.log
2023-08-29 12:23:53 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.15
2023-08-29 12:23:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):251 - Attempt 0 to save workflow id for cancellation
2023-08-29 12:23:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-08-29 12:23:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-08-29 12:23:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-08-29 12:23:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-08-29 12:23:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-08-29 12:23:53 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-mongodb-v2:0.2.5 exists...
2023-08-29 12:23:53 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-mongodb-v2:0.2.5 was found locally.
2023-08-29 12:23:53 INFO i.a.w.p.DockerProcessFactory(create):143 - Creating docker container = source-mongodb-v2-discover-f5a9d2e8-bb4f-47f8-bcfd-aef730191b73-0-ecmgj with resources io.airbyte.config.ResourceRequirements@1086b818[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-08-29 12:23:53 INFO i.a.w.p.DockerProcessFactory(create):196 - Preparing command: docker run --rm --init -i -w /data/f5a9d2e8-bb4f-47f8-bcfd-aef730191b73/0 --log-driver none --name source-mongodb-v2-discover-f5a9d2e8-bb4f-47f8-bcfd-aef730191b73-0-ecmgj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-mongodb-v2:0.2.5 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.15 -e WORKER_JOB_ID=f5a9d2e8-bb4f-47f8-bcfd-aef730191b73 airbyte/source-mongodb-v2:0.2.5 discover --config source_config.json
2023-08-29 12:23:53 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-08-29 12:23:53 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.m.MongoDbSource(main):55 starting source: class io.airbyte.integrations.source.mongodb.MongoDbSource
2023-08-29 12:23:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {discover=null, config=source_config.json}
2023-08-29 12:23:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.source.mongodb.MongoDbSource
2023-08-29 12:23:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: DISCOVER
2023-08-29 12:23:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=DISCOVER, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-08-29 12:23:54 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-29 12:23:54 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-08-29 12:23:54 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.m.d.l.SLF4JLogger(warn):86 Ignoring unrecognized boolean value 'admin' in the connection string for 'ssl'. Replace with either 'true' or 'false'
2023-08-29 12:23:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.m.d.l.SLF4JLogger(info):71 Cluster created with settings {hosts=[dev-db-master-replica.kavida.ai:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms'}
I am unable to understand where things went wrong as earlier I have setup a different connection of mongodb to the same postgres destinattion and when trying again it fails
Beta Was this translation helpful? Give feedback.
All reactions