Skip to content

DocDB Substrait Implementation#3229

Open
AbdulR3hman wants to merge 2 commits intomasterfrom
feature/docdb-managed-connector-rebased
Open

DocDB Substrait Implementation#3229
AbdulR3hman wants to merge 2 commits intomasterfrom
feature/docdb-managed-connector-rebased

Conversation

@AbdulR3hman
Copy link
Contributor

@AbdulR3hman AbdulR3hman commented Jan 20, 2026

Enabling DocDB Substrait implementation.

This is a refactored and rebased (for easier review) version of PR-3016

@amazon-inspector-n-virginia
Copy link

⏳ I'm reviewing this pull request for security vulnerabilities and code quality issues. I'll provide an update when I'm done

1 similar comment
@amazon-inspector-n-virginia
Copy link

⏳ I'm reviewing this pull request for security vulnerabilities and code quality issues. I'll provide an update when I'm done

@amazon-inspector-n-virginia
Copy link

✅ I finished the code review, and didn't find any security or code quality issues.

1 similar comment
@amazon-inspector-n-virginia
Copy link

✅ I finished the code review, and didn't find any security or code quality issues.

@AbdulR3hman AbdulR3hman force-pushed the feature/docdb-managed-connector-rebased branch 2 times, most recently from b502ef3 to 6fb20bc Compare January 20, 2026 22:43
assertEquals("6", finalResponse.getNextToken());

// Verify empty page after all data is consumed
ListTablesRequest emptyRequest = new ListTablesRequest(IDENTITY, QUERY_ID, DEFAULT_CATALOG, DEFAULT_SCHEMA,
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this part of the test expects that the paging happens infinitely; and that the server pagination is stateful; which it isn't. by setting the next token to null; we are expecting to restart from the start which what happens here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

therefore this part of the test isn't correct hence removed.

@AbdulR3hman AbdulR3hman force-pushed the feature/docdb-managed-connector-rebased branch from 6fb20bc to 4167417 Compare January 20, 2026 22:54
@AbdulR3hman AbdulR3hman force-pushed the feature/docdb-managed-connector-rebased branch from 4167417 to 3d53fc7 Compare January 21, 2026 14:04
@AbdulR3hman AbdulR3hman marked this pull request as ready for review January 21, 2026 15:35
@macohen macohen requested review from burhan94 and ejeffrli February 6, 2026 21:48
@codecov
Copy link

codecov bot commented Mar 10, 2026

Codecov Report

❌ Patch coverage is 54.90196% with 207 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.35%. Comparing base (6ef1dfb) to head (d25fc36).
⚠️ Report is 100 commits behind head on master.
✅ All tests successful. No failed tests found.

Files with missing lines Patch % Lines
.../amazonaws/athena/connectors/docdb/QueryUtils.java 60.79% 52 Missing and 17 partials ⚠️
...a/connector/substrait/util/LimitAndSortHelper.java 0.00% 55 Missing ⚠️
...a/connector/substrait/SubstraitFunctionParser.java 58.62% 24 Missing and 12 partials ⚠️
.../athena/connectors/docdb/DocDBMetadataHandler.java 49.15% 29 Missing and 1 partial ⚠️
...ws/athena/connectors/docdb/DocDBRecordHandler.java 73.77% 12 Missing and 4 partials ⚠️
...a/connector/substrait/model/LogicalExpression.java 94.11% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master    #3229      +/-   ##
============================================
+ Coverage     68.33%   70.35%   +2.02%     
- Complexity     5021     5406     +385     
============================================
  Files           639      645       +6     
  Lines         24197    24884     +687     
  Branches       2992     3114     +122     
============================================
+ Hits          16534    17508     +974     
+ Misses         6227     5922     -305     
- Partials       1436     1454      +18     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

* @return Fully constructed MongoDB connection string in format: mongodb://username:password@host:port/?jdbcParams
* @throws RuntimeException if JSON credential parsing fails or required parameters are missing
*/
private String getConfigOptionsFromFederatedIdentity(Map<String, String> configOptions)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a reason to use this function instead of DocDbEnvironmentProperties? That should already contain the connection string, secrets, etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants