[source-mongodb] ingestion error QueryExceededMemoryLimitNoDiskUseAllowed

[dennisyoshikawa]

Hello everyone, please help me i need some advise for this error, i user airbyte open source (version 0.50.41), i ingest mongo db (connector version 1.2.1) to bigquery (v0.3.0) from june 2023 to 7 dec 2024 works fine until we found this error :

com.mongodb.MongoCommandException: Command failed with error 292 (QueryExceededMemoryLimitNoDiskUseAllowed): 'Error in $cursor stage :: caused by :: Sort exceeded memory limit of 104857600 bytes, but did not opt in to external sorting.' on server 128.199.108.148:2378. The full response is {"ok": 0.0, "errmsg": "Error in $cursor stage :: caused by :: Sort exceeded memory limit of 104857600 bytes, but did not opt in to external sorting.", "code": 292, "codeName": "QueryExceededMemoryLimitNoDiskUseAllowed"}

when i click "review changes"

and show this error

this setting we keep default

there is no changes with this ingestion setting, could you please help me to check this error, what should i do to make this run again?

[dennisyoshikawa]

Alhamdulillah, we solve this problem by remove the "view" we don't need from the data source, because the query of the view is take a lot of memory if we run it, thanks guys