Replies: 1 comment 2 replies
-
You can write a custom Spark plugin to traverse the query plan and extract the table scan partition info. |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
How to use kyuubi to get which partition of table does spark sql hit?
Similar to SQL Lineage Support, we can know which table does spark sql hit.
https://kyuubi.readthedocs.io/en/master/extensions/engines/spark/lineage.html
Beta Was this translation helpful? Give feedback.
All reactions