feat(ingest/bigquery): improve profiler to support multiple partition columns and support external table profiling

[acrylJonny]

Checklist

• The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[codecov]

Codecov Report

❌ Patch coverage is 69.83446% with 492 lines in your changes missing coverage. Please review.
✅ All tests successful. No failed tests found.

Files with missing lines	Patch %	Lines
...uery_v2/profiling/partition_discovery/discovery.py	63.81%	233 Missing ⚠️
...ingestion/source/bigquery_v2/profiling/profiler.py	70.45%	104 Missing ⚠️
...ry_v2/profiling/partition_discovery/info_schema.py	54.54%	70 Missing ⚠️
...ion/source/bigquery_v2/profiling/query_executor.py	75.52%	35 Missing ⚠️
...ingestion/source/bigquery_v2/profiling/security.py	72.50%	33 Missing ⚠️
...bigquery_v2/profiling/partition_discovery/types.py	76.92%	6 Missing ⚠️
...v2/profiling/partition_discovery/filter_builder.py	94.66%	4 Missing ⚠️
.../ingestion/source/bigquery_v2/queries_extractor.py	88.57%	4 Missing ⚠️
...ngestion/source/bigquery_v2/bigquery_schema_gen.py	50.00%	3 Missing ⚠️

📢 Thoughts on this report? Let us know!

[aikido-pr-checks]

Potential SQL injection via string-based query concatenation - critical severity
SQL injection might be possible in these locations, especially if the strings being concatenated are controlled via user input.

Remediation: If possible, rebuild the query to use prepared statements or an ORM. If that is not possible, make sure the user input is verified or sanitized. As an added layer of protection, we also recommend installing a WAF that blocks SQL injection attacks.
^{View details in Aikido Security}

[aikido-pr-checks]

Potential SQL injection via string-based query concatenation - critical severity
SQL injection might be possible in these locations, especially if the strings being concatenated are controlled via user input.

Remediation: If possible, rebuild the query to use prepared statements or an ORM. If that is not possible, make sure the user input is verified or sanitized. As an added layer of protection, we also recommend installing a WAF that blocks SQL injection attacks.
^{View details in Aikido Security}