Add an option to use INFORMATION_SCHEMA for partition info retrieval

[github-christophe-oudar]

resolves #867

Problem

Current approach to retrieve partition information is expensive and slow.

Solution

Providing a way to use INFORMATION_SCHEMA metadata would speed up the partition info retrieval as well for a fraction of the cost (almost constant to 10 MB)

Checklist

• I have read the contributing guide and understand what's expected of me
• I have run this code in development and it appears to resolve the stated issue
• This PR includes tests, or tests are not required/relevant for this PR
• This PR has no interface changes (e.g. macros, cli, logs, json artifacts, config files, adapter interface, etc) or this PR has already received feedback and approval from Product or DX

[github-christophe-oudar]

I was hoping to add an option to keep the previous approach but I can't since the prototype of adapter.get_partitions_metadata is set in dbt-core and I don't think we want to leak the BQ specific option.
I think that, overall, it's acceptable.

[nathaniel-may]

Hi @github-christophe-oudar, we appreciate the effort you took to implement this optimization and we thank you for your patience. I've made sure this is properly filed in our queue of work but it may still take some time for us to give it a proper review.

[github-actions]

This PR has been marked as Stale because it has been open with no activity as of late. If you would like the PR to remain open, please comment on the PR or else it will be closed in 7 days.

[HbirdJ]

I don't think this should be closed, there's a long history of requests for review here and in the dbt bq slack channel.

[github-christophe-oudar]

#867 got closed but I'm not sure it should be canceled.
If @amychen1776 referred to microbatch feature, I think we should proceed as it's not the same need.
I would probably prefer merging #1351 before because this one needs a rebase anyway and I refactored a bit in that PR.

[github-actions]

This PR has been marked as Stale because it has been open with no activity as of late. If you would like the PR to remain open, please comment on the PR or else it will be closed in 7 days.