Add support for `sempy.fabric.lakehouse` functions on schema-enabled Lakehouses in Microsoft Fabric.

[mohankumar453]

Description

Currently, the sempy.fabric.lakehouse functions such as list_lakehouse_tables(count_rows=True, extended=True) do not work on Lakehouses with schemas enabled. Attempting to run these functions results in the following error:

Error: {"requestId":"01d5abd1-1a43-41a0-b98b-74c202a8b1c6","errorCode":"UnsupportedOperationForSchemasEnabledLakehouse","message":"The operation is not supported for Lakehouse with schemas enabled."}

Expected Behavior

• list_lakehouse_tables should support schema-enabled Lakehouses, returning:
  • Table names
  • Table sizes
  • Row counts
  • Table last refreshed date and time
  • Other metadata (similar to classic Lakehouses)

Describe alternatives you've considered
Current workaround is to use native Spark queries to enumerate tables and count rows by iterating through the schemas.

Additional context
High-value for automated scripts, dashboards, and workspace audits.

[m-kovalsky]

Please try using get_lakehouse_tables within SLL in this PR.

[mohankumar453]

@m-kovalsky : I see the PR #1077 is still not merged. Doubt that I can use this.

But I tried to use the function and got the below error.

from sempy_labs.lakehouse import get_lakehouse_tables
df = get_lakehouse_tables(count_rows=True, exclude_shortcuts=True)

display(df)

---

KeyError Traceback (most recent call last)
File /nfs4/pyenv-2250dcf0-8bd6-468a-85ed-7b35fcbc38c1/lib/python3.11/site-packages/pandas/core/indexes/base.py:3641, in Index.get_loc(self, key)
3640 try:
-> 3641 return self._engine.get_loc(casted_key)
3642 except KeyError as err:

File pandas/_libs/index.pyx:168, in pandas._libs.index.IndexEngine.get_loc()

File pandas/_libs/index.pyx:197, in pandas._libs.index.IndexEngine.get_loc()

File pandas/_libs/hashtable_class_helper.pxi:7668, in pandas._libs.hashtable.PyObjectHashTable.get_item()

File pandas/_libs/hashtable_class_helper.pxi:7676, in pandas._libs.hashtable.PyObjectHashTable.get_item()

KeyError: 'Row Count'

The above exception was the direct cause of the following exception:

[m-kovalsky]

You can copy the function from the PR and run that. If not, then wait till the next version is released. Your code points to production which doesn't have PR 1077 in it so naturally it won't contain the fix.

[mohankumar453]

@m-kovalsky : I copied the function from the PR and tried.. Still it did not work.. I think I will have to wait for the next version to be released..