Skip to content

Conversation

@rjrudin
Copy link
Contributor

@rjrudin rjrudin commented Sep 23, 2025

Deprecated in 2.3.0, can be removed for 3.0.0

Copilot AI review requested due to automatic review settings September 23, 2025 15:54
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR removes the deprecated spark.marklogic.write.fileRows.documentType option that was deprecated in version 2.3.0, replacing it with the unified spark.marklogic.write.documentType option. Additionally, it addresses compiler warnings and enables stricter compilation settings to prevent future warnings.

  • Removed deprecated WRITE_FILE_ROWS_DOCUMENT_TYPE option and related code
  • Updated tests and documentation to use WRITE_DOCUMENT_TYPE instead
  • Added compiler flags to treat warnings as errors and fixed existing warnings

Reviewed Changes

Copilot reviewed 10 out of 11 changed files in this pull request and generated no comments.

Show a summary per file
File Description
WriteFileRowsTest.java Updated test methods to use new option and removed deprecation annotations
AbstractIntegrationTest.java Fixed generic type warning in method signature
marklogic-spark-messages.properties Removed deprecated option from properties file
WriteContext.java Removed deprecated method for handling old option
FileRowConverter.java Removed deprecated option handling and updated comment
Options.java Removed deprecated constant definition
build.gradle Added compiler flags for warnings and fixed property assignment warnings
writing.md Updated documentation to reference new option
generic-file-support.md Updated documentation to reference new option
configuration.md Updated configuration table with new option

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@github-actions
Copy link

github-actions bot commented Sep 23, 2025

Copyright Validation Results
Total: 10 | Passed: 6 | Failed: 0 | Skipped: 4 | at: 2025-09-23 19:25:53 UTC | commit: 0d2610d

⏭️ Skipped (Excluded) Files

  • docs/configuration.md
  • docs/reading-data/reading-files/generic-file-support.md
  • docs/writing.md
  • gradle.properties

✅ Valid Files

  • marklogic-spark-connector/src/main/java/com/marklogic/spark/Options.java
  • marklogic-spark-connector/src/main/java/com/marklogic/spark/writer/FileRowConverter.java
  • marklogic-spark-connector/src/main/java/com/marklogic/spark/writer/WriteContext.java
  • marklogic-spark-connector/src/main/resources/marklogic-spark-messages.properties
  • marklogic-spark-connector/src/test/java/com/marklogic/spark/reader/document/ReadDocumentRowsTest.java
  • marklogic-spark-connector/src/test/java/com/marklogic/spark/writer/WriteFileRowsTest.java

✅ All files have valid copyright headers!

@rjrudin rjrudin force-pushed the feature/remove-deprecated-options branch 2 times, most recently from ad960a6 to 4a658d7 Compare September 23, 2025 18:01
@rjrudin rjrudin changed the title MLE-24402 Removing deprecated option and all compiler warnings MLE-24402 Removing deprecated fileRows.documentType option Sep 23, 2025
@rjrudin rjrudin force-pushed the feature/remove-deprecated-options branch from 4a658d7 to b2168f5 Compare September 23, 2025 18:48
Copy link
Contributor

@BillFarber BillFarber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Assuming the connection failure in the tests is transitory.

Deprecated in 2.3.0, can be removed for 3.0.0
@rjrudin rjrudin force-pushed the feature/remove-deprecated-options branch from b2168f5 to 0d2610d Compare September 23, 2025 19:25
@sonarqube-progress-marklogic
Copy link

@rjrudin rjrudin merged commit 09f0cf1 into develop Sep 23, 2025
4 checks passed
@rjrudin rjrudin deleted the feature/remove-deprecated-options branch September 23, 2025 19:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants