MongoDB connector - fails to read from Atlas's hosted MongoDB

[itamarco]

Im using Presto 0.232 on AWS EMR.
My MongoDB (v4.2) instance is hosted on Atlas.

I managed to configure properly the MongoDB connector but im getting the attached error on every query.

A month ago i was using PrestSQL and came across the same error.
I filed a bug report and they fixed it by updating Mongo driver
trinodb/trino#4489

Perhaps it the same issue here.

However, since im not able to upgrade the Presto version on AWS EMR, I would like to hear whether there is other solution for this problem.

Thanks

Query 20201005_070929_00004_g4hdj failed: org.bson.BsonInvalidOperationException: Document does not contain key clusterTime
com.google.common.util.concurrent.UncheckedExecutionException: org.bson.BsonInvalidOperationException: Document does not contain key clusterTime
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3952)
	at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
	at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4958)
	at com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4964)
	at com.facebook.presto.mongodb.MongoSession.getTable(MongoSession.java:153)
	at com.facebook.presto.mongodb.MongoMetadata.getTableHandle(MongoMetadata.java:81)
	at com.facebook.presto.mongodb.MongoMetadata.getTableHandle(MongoMetadata.java:56)
	at com.facebook.presto.metadata.MetadataManager.getTableHandle(MetadataManager.java:331)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.visitTable(StatementAnalyzer.java:984)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.visitTable(StatementAnalyzer.java:269)
	at com.facebook.presto.sql.tree.Table.accept(Table.java:53)
	at com.facebook.presto.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:283)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.analyzeFrom(StatementAnalyzer.java:1927)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.visitQuerySpecification(StatementAnalyzer.java:1099)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.visitQuerySpecification(StatementAnalyzer.java:269)
	at com.facebook.presto.sql.tree.QuerySpecification.accept(QuerySpecification.java:127)
	at com.facebook.presto.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:283)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:293)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.visitQuery(StatementAnalyzer.java:814)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.visitQuery(StatementAnalyzer.java:269)
	at com.facebook.presto.sql.tree.Query.accept(Query.java:94)
	at com.facebook.presto.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:283)
	at com.facebook.presto.sql.analyzer.StatementAnalyzer.analyze(StatementAnalyzer.java:261)
	at com.facebook.presto.sql.analyzer.Analyzer.analyze(Analyzer.java:79)
	at com.facebook.presto.sql.analyzer.Analyzer.analyze(Analyzer.java:71)
	at com.facebook.presto.execution.SqlQueryExecution.<init>(SqlQueryExecution.java:194)
	at com.facebook.presto.execution.SqlQueryExecution.<init>(SqlQueryExecution.java:96)
	at com.facebook.presto.execution.SqlQueryExecution$SqlQueryExecutionFactory.createQueryExecution(SqlQueryExecution.java:733)
	at com.facebook.presto.execution.SqlQueryManager.createQueryInternal(SqlQueryManager.java:366)
	at com.facebook.presto.execution.SqlQueryManager.lambda$createQuery$4(SqlQueryManager.java:304)
	at com.facebook.presto.$gen.Presto_0_232____20201005_065016_1.run(Unknown Source)
	at com.facebook.airlift.concurrent.BoundedExecutor.drainQueue(BoundedExecutor.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.bson.BsonInvalidOperationException: Document does not contain key clusterTime
	at org.bson.BsonDocument.throwIfKeyAbsent(BsonDocument.java:859)
	at org.bson.BsonDocument.getTimestamp(BsonDocument.java:257)
	at com.mongodb.connection.ClusterClock.greaterOf(ClusterClock.java:40)
	at com.mongodb.connection.ClusterClock.advance(ClusterClock.java:31)
	at com.mongodb.connection.ClusterClockAdvancingSessionContext.advanceClusterTime(ClusterClockAdvancingSessionContext.java:71)
	at com.mongodb.connection.InternalStreamConnection.updateSessionContext(InternalStreamConnection.java:509)
	at com.mongodb.connection.InternalStreamConnection.receiveCommandMessageResponse(InternalStreamConnection.java:291)
	at com.mongodb.connection.InternalStreamConnection.sendAndReceive(InternalStreamConnection.java:254)
	at com.mongodb.connection.UsageTrackingInternalConnection.sendAndReceive(UsageTrackingInternalConnection.java:98)
	at com.mongodb.connection.DefaultConnectionPool$PooledConnection.sendAndReceive(DefaultConnectionPool.java:441)
	at com.mongodb.connection.CommandProtocolImpl.execute(CommandProtocolImpl.java:76)
	at com.mongodb.connection.DefaultServer$DefaultServerProtocolExecutor.execute(DefaultServer.java:189)
	at com.mongodb.connection.DefaultServerConnection.executeProtocol(DefaultServerConnection.java:263)
	at com.mongodb.connection.DefaultServerConnection.command(DefaultServerConnection.java:126)
	at com.mongodb.connection.DefaultServerConnection.command(DefaultServerConnection.java:118)
	at com.mongodb.operation.CommandOperationHelper.executeWrappedCommandProtocol(CommandOperationHelper.java:226)
	at com.mongodb.operation.CommandOperationHelper.executeWrappedCommandProtocol(CommandOperationHelper.java:217)
	at com.mongodb.operation.CommandOperationHelper.executeWrappedCommandProtocol(CommandOperationHelper.java:120)
	at com.mongodb.operation.ListIndexesOperation$1.call(ListIndexesOperation.java:143)
	at com.mongodb.operation.ListIndexesOperation$1.call(ListIndexesOperation.java:138)
	at com.mongodb.operation.OperationHelper.withConnectionSource(OperationHelper.java:470)
	at com.mongodb.operation.OperationHelper.withConnection(OperationHelper.java:414)
	at com.mongodb.operation.ListIndexesOperation.execute(ListIndexesOperation.java:138)
	at com.mongodb.operation.ListIndexesOperation.execute(ListIndexesOperation.java:69)
	at com.mongodb.Mongo$3.execute(Mongo.java:822)
	at com.mongodb.MongoIterableImpl.execute(MongoIterableImpl.java:130)
	at com.mongodb.MongoIterableImpl.iterator(MongoIterableImpl.java:77)
	at com.facebook.presto.mongodb.MongoIndex.parse(MongoIndex.java:36)

[bitsondatadev]

@itamarco if you're constrained to stay on EMR, prestosql (now called Trino), is available on EMR. The December 2020 release includes Trino (PrestoSQL) release 343 https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-6x.html. I'm not sure how they will manage this with the rebrand to Trino.