Added NewFeatures Line to Changes.Md by arnavarora2004 · Pull Request #35798 · apache/beam

arnavarora2004 · 2025-08-06T19:00:51Z

Please add a meaningful description for your change here

I added the new feature description with link to the PR in the newFeatures section in CHANGES.MD

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
Update CHANGES.md with noteworthy changes.
If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

… connected and actually look good on user end for mutations

…est debugging

…test wise

…hemaTransformProviderIT, and testing out new mutations etc

…ted new user input, all mutations work correctly, put demo code for it

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com>

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProviderIT.java Co-authored-by: Derrick Williams <myutat@gmail.com>

gemini-code-assist

Summary of Changes

Hello @arnavarora2004, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

I've updated the project's CHANGES.md file to reflect a new feature. This ensures that users and contributors are aware of the recent addition of the BigTableRead Connector for BeamYaml, which now includes a new configuration parameter.

Highlights

Documentation Update: I've added a new entry to the CHANGES.md file under the "New Features / Improvements" section. This entry specifically highlights the integration of the BigTableRead Connector for BeamYaml, noting the inclusion of a new configuration parameter, and links to the corresponding pull request.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point in your pull request via creating an issue comment (i.e. comment on the pull request page) using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands.

Feature	Command	Description
Code Review	`/gemini review`	Performs a code review for the current pull request in its current state.
Pull Request Summary	`/gemini summary`	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in issue comments and review comments.
Help	`/gemini help`	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments or fill out our survey to provide feedback.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

CHANGES.md

ahmedabu98 · 2025-08-06T19:14:57Z

Can we add Bigtable write in here too? for 2.67.0

Co-authored-by: Ahmed Abualsaud <65791736+ahmedabu98@users.noreply.github.com>

github-actions · 2025-08-06T19:36:50Z

Assigning reviewers:

R: @chamikaramj added as fallback since no labels match configuration

Note: If you would like to opt out of this review, comment assign to next reviewer.

Available commands:

stop reviewer notifications - opt out of the automated review tooling
remind me after tests pass - tag the comment author after tests pass
waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

ahmedabu98

LGTM, thanks!

* Refactored BigTableReadSchemaTransformConfiguration * changed scope, working on buffer class for making BigTable yaml fully connected and actually look good on user end for mutations * Finished up a bit of standard_io.yaml * Finished up a bit of standard_io.yaml * Added bigTable test * changed some tests for BigTable * Added new IT file for simpleWrite and also made changes integration test debugging * Added new IT file for simpleWrite and also made changes integration test debugging * SetCell mutation test works, I want to see if this draft PR works CI test wise * Fixed a slight error * Added way more changes to integrations test.py, BigTableSimpleWriteSchemaTransformProviderIT, and testing out new mutations etc * BigTableSimpleWriteSchemaTransformProviderIT finished changes to mutated new user input, all mutations work correctly, put demo code for it * Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com> * Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com> * Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com> * Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com> * Update sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProviderIT.java Co-authored-by: Derrick Williams <myutat@gmail.com> * changed comments * Added changes from derrick comments * Added default schema maybe fixes the issues * Added schema to every test specificly, will run tests to see if it works * Added default schema maybe fixes the issues * Following formatting tests * Following formatting tests * Following checkstyle tests * Made schema and test changes * Made schema and test changes * Made schema and test changes * Made schema and test changes * Made schema and test changes * Added final test * changed timestamp values * added all mutations test * added all mutations test * pushed changes to format errors * pushed changes to format errors * Delete 4 * pushed changes to format errors * pushed changes to format errors * pushed changes to format errors * pushed changes to debugging errors * pushed changes to debugging errors * to see internal error added print(will remove) * to see internal error added print(will remove) * to see internal error added print(will remove) * import fixes * import fixes * import fixes * import fixes * import fixes * import fixes * pushed changes to debugging errors * pushed changes to debugging errors * pushed changes to debugging errors, added pulls from other beam * made changes to allMutations test * made changes to allMutations test * pushed changes to debugging errors, added pulls from other beam * pushed changes to debugging errors, added pulls from other beam * pushed changes to debugging errors, added pulls from other beam * pushed changes to debugging errors, added pulls from other beam * pushed changes to debugging errors, added pulls from other beam * new read errors fixed * pushed changes to debugging errors, added pulls from other beam * consolidated schema transform files, fixed small issues and bugs * consolidated schema transform files, fixed small issues and bugs * consolidated schema transform files, fixed small issues and bugs * consolidated schema transform files, fixed small issues and bugs * pushed changes to debugging errors, added pulls from other beam * pushed changes from ahmed * pushed changes from ahmed * pushed changes from ahmed * pushed changes from ahmed * pushed changes from ahmed * pushed changes from ahmed * pushed changes from ahmed * pushed changes from ahmed * Following checkstyle tests * Following checkstyle tests * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff * Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableReadSchemaTransformProvider.java Co-authored-by: Ahmed Abualsaud <65791736+ahmedabu98@users.noreply.github.com> * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff * pushed new changes to BigTableRead, making it work with new functionality feature of allowing flatten (defaulted to true) and added a new test in IT and fixed formatting stuff * new mongo files in branch * fixed family_name to string * fixed family_name to string * fixed family_name to string * fixed family_name to string * fixed family_name to string * fixed family_name to string * fixed family_name to string * fixed family_name to string * fixed cmmit issues * commented assert test, everything should work now * added feature changes to changes.md * Update CHANGES.md Co-authored-by: Ahmed Abualsaud <65791736+ahmedabu98@users.noreply.github.com> * added feature changes to changes.md --------- Co-authored-by: Derrick Williams <myutat@gmail.com> Co-authored-by: Ahmed Abualsaud <65791736+ahmedabu98@users.noreply.github.com>

arnavarora2004 and others added 30 commits May 21, 2025 11:43

Refactored BigTableReadSchemaTransformConfiguration

ad54a58

changed scope, working on buffer class for making BigTable yaml fully…

0edf81d

… connected and actually look good on user end for mutations

Finished up a bit of standard_io.yaml

18c9395

Finished up a bit of standard_io.yaml

a25033e

Merge branch 'apache:master' into master

0e4fb14

Added bigTable test

c048dcf

Merge branch 'master' of github.com:arnavarora2004/ArnavBeamWork

4ebc7c8

changed some tests for BigTable

3bb3dfc

Added new IT file for simpleWrite and also made changes integration t…

a8b8196

…est debugging

Added new IT file for simpleWrite and also made changes integration t…

cf8bd8f

…est debugging

SetCell mutation test works, I want to see if this draft PR works CI …

a06d7c6

…test wise

Fixed a slight error

5760278

Merge branch 'apache:master' into master

5cb0dd7

Added way more changes to integrations test.py, BigTableSimpleWriteSc…

f2640ae

…hemaTransformProviderIT, and testing out new mutations etc

Merge branch 'master' of github.com:arnavarora2004/ArnavBeamWork

69467c5

BigTableSimpleWriteSchemaTransformProviderIT finished changes to muta…

121ddf6

…ted new user input, all mutations work correctly, put demo code for it

Merge branch 'apache:master' into master

82d3612

Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/be…

14ca717

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com>

Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/be…

c36d864

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com>

Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/be…

d6366dd

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com>

Merge branch 'apache:master' into master

fcb5d03

Update sdks/java/io/google-cloud-platform/src/main/java/org/apache/be…

38ff386

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProvider.java Co-authored-by: Derrick Williams <myutat@gmail.com>

Update sdks/java/io/google-cloud-platform/src/test/java/org/apache/be…

a15e4ff

…am/sdk/io/gcp/bigtable/BigtableSimpleWriteSchemaTransformProviderIT.java Co-authored-by: Derrick Williams <myutat@gmail.com>

changed comments

c759a07

Merge branch 'master' of github.com:arnavarora2004/ArnavBeamWork

8e19a81

Added changes from derrick comments

b6d0157

Merge branch 'apache:master' into master

7ea3f76

Merge branch 'apache:master' into master

a35ced7

Added default schema maybe fixes the issues

50bb5a3

Added schema to every test specificly, will run tests to see if it works

426519d

arnavarora2004 added 17 commits July 30, 2025 15:40

Merge branch 'apache:master' into master

764d51b

Merge branch 'apache:master' into mongodb

b423787

fixed family_name to string

2b0806d

fixed family_name to string

77e4dd3

fixed family_name to string

b4ad9e4

Merge branch 'apache:master' into master

4b9ce38

Merge branch 'mongodb' into master

f56e50d

fixed family_name to string

3386f94

fixed family_name to string

2fd82ea

fixed cmmit issues

3059504

Merge branch 'apache:master' into master

e0a2bd5

Merge branch 'apache:master' into master

af0e80b

Merge branch 'apache:master' into master

188222f

Merge branch 'apache:master' into master

ef8b856

commented assert test, everything should work now

669b80d

Merge branch 'apache:master' into master

0469a15

added feature changes to changes.md

c848346

arnavarora2004 marked this pull request as ready for review August 6, 2025 19:00

gemini-code-assist bot reviewed Aug 6, 2025

View reviewed changes

ahmedabu98 reviewed Aug 6, 2025

View reviewed changes

CHANGES.md Outdated Show resolved Hide resolved

arnavarora2004 and others added 3 commits August 6, 2025 15:15

Update CHANGES.md

4b380eb

Co-authored-by: Ahmed Abualsaud <65791736+ahmedabu98@users.noreply.github.com>

added feature changes to changes.md

04d8798

Merge branch 'master' of github.com:arnavarora2004/ArnavBeamWork

2254e72

github-actions bot added the Next Action: Reviewers label Aug 6, 2025

ahmedabu98 approved these changes Aug 10, 2025

View reviewed changes

ahmedabu98 merged commit 64625a7 into apache:master Aug 10, 2025
4 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Added NewFeatures Line to Changes.Md#35798

Added NewFeatures Line to Changes.Md#35798
ahmedabu98 merged 144 commits intoapache:masterfrom
arnavarora2004:master

arnavarora2004 commented Aug 6, 2025

Uh oh!

gemini-code-assist bot left a comment

Uh oh!

Uh oh!

ahmedabu98 commented Aug 6, 2025

Uh oh!

github-actions bot commented Aug 6, 2025

Uh oh!

ahmedabu98 left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

arnavarora2004 commented Aug 6, 2025

GitHub Actions Tests Status (on master branch)

Uh oh!

gemini-code-assist bot left a comment

Choose a reason for hiding this comment

Summary of Changes

Highlights

Footnotes

Uh oh!

Uh oh!

ahmedabu98 commented Aug 6, 2025

Uh oh!

github-actions bot commented Aug 6, 2025

Uh oh!

ahmedabu98 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants