Skip to content

SnowflakeIO: filter on db and schema when searching for existing table#34486

Merged
Abacn merged 1 commit intoapache:masterfrom
turb:snowflake-schema-create-table
May 19, 2025
Merged

SnowflakeIO: filter on db and schema when searching for existing table#34486
Abacn merged 1 commit intoapache:masterfrom
turb:snowflake-schema-create-table

Conversation

@turb
Copy link
Contributor

@turb turb commented Mar 31, 2025

When searching if a table already exists, SnowflakeIO may wrongly find a table with the same name in another db/schema. So filter the search on it.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@github-actions
Copy link
Contributor

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @damondouglas for label java.
R: @damondouglas for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

@github-actions
Copy link
Contributor

github-actions bot commented Apr 8, 2025

Reminder, please take a look at this pr: @damondouglas @damondouglas

@github-actions
Copy link
Contributor

Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment assign to next reviewer:

R: @chamikaramj for label java.
R: @damondouglas for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

@turb
Copy link
Contributor Author

turb commented Apr 14, 2025

Hello @robertwb would it be possible to merge this one?

@github-actions
Copy link
Contributor

Reminder, please take a look at this pr: @chamikaramj @damondouglas

@github-actions
Copy link
Contributor

Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment assign to next reviewer:

R: @robertwb for label java.
R: @damondouglas for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

@github-actions
Copy link
Contributor

github-actions bot commented May 1, 2025

Reminder, please take a look at this pr: @robertwb @damondouglas

@turb turb force-pushed the snowflake-schema-create-table branch from fa86ae5 to 2e08c9e Compare May 5, 2025 12:14
@turb
Copy link
Contributor Author

turb commented May 5, 2025

Rebased on master.

@github-actions
Copy link
Contributor

github-actions bot commented May 7, 2025

Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment assign to next reviewer:

R: @chamikaramj for label java.
R: @damondouglas for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

@turb turb force-pushed the snowflake-schema-create-table branch from 2e08c9e to 83f424d Compare May 13, 2025 15:39
@Abacn
Copy link
Contributor

Abacn commented May 14, 2025

Thanks for the fix. Would it be possible to add a test case?

@turb
Copy link
Contributor Author

turb commented May 14, 2025

Thanks for the fix. Would it be possible to add a test case?

Thanks!

That's not easy at all: this is linked to system table schema in Snowflake, so requires an integration test. Thing is, IT require a working GCP-run Snowflake, which I don't have access to.

Unfortunately, there is no real way to have tests running against, say, a docker-embedded Snowflake db.

@turb
Copy link
Contributor Author

turb commented May 19, 2025

@Abacn is it a blocker?

I don't believe I can execute the IT. I may write a UT to check the query is the one expected, but it's not of great value I think.

Copy link
Contributor

@Abacn Abacn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the context

@Abacn Abacn merged commit 2cfeb31 into apache:master May 19, 2025
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants