semantic-link-labs 0.9.11

New Functions

• sempy_labs

  • Semantic Models
    • create_vpax Creates a .vpax file a la Vertipaq Analyzer. Thanks @marcosqlbi & @dgosbell!
    • update_semantic_model_refresh_schedule (#679)
  • Environments
    • list_environments
  • Tags
    • list_tags
    • apply_tags
    • unapply_tags
  • Variable Libraries
    • list_variable_libraries
    • delete_variable_library

• sempy_labs.admin

  • Tags
    • create_tags
    • delete_tag
    • update_tag

• sempy_labs.lakehouse

  • is_v_ordered Checks if a delta table is v-ordered
  • delete_lakehouse (#653)
  • update_lakehouse (#653)
  • load_table (#653)
  • list_livy_sessions
  • get_user_delegation_key

• sempy_labs.tom

  • copy_object Copies/clones an object from one semantic model to another. As an example, this function can copy a table from one semantic model to another.

Updated Functions

• sempy_labs
  • query_kusto Removed logic which caused DateTime columns to display as integers instead of as dates.
  • get_notebook_definition, create_notebook, update_notebook_definition Added the 'format' parameter. Thanks @lBilali!
• sempy_labs.directlake
  • update_direct_lake_model_connection Added the 'tables' parameter to support updating the Direct Lake connection for specific tables in a model (#659).

Bug Fixes

• #462
• #630 (list_blobs now supports pagination)
• #641
• #663
• #668
• #669
• #671
• #675

semantic-link-labs 0.9.10

New Functions

• sempy_labs
  • query_kusto Query a KQL database using either KQL or SQL. Thanks @pawarbi!
  • query_workspace_monitoring View workspace monitoring stats by running either a KQL or SQL query.
• sempy_labs.admin
  • get_refreshables Thanks @ecotte!
  • export_dataflow Thanks @ecotte!

Updated Functions

• sempy_labs
  • backup_semantic_model Added the optional 'password' parameter. Thanks @MitchSS!
  • restore_semantic_model Added the optional 'password' parameter. Thanks @MitchSS!
  • save_as_delta_table This function can now be executed in either a PySpark or pure python notebook. (#623)
• sempy_labs.lakehouse
  • optimize_lakehouse_tables This function can be executed in either a PySpark or pure python notebook (#542)
  • vacuum_lakehouse_tables This function can be executed in either a PySpark or pure python notebook (#542).
  • get_lakehouse_tables Now supports Service Principal authentication (#609). This function can now be executed in either a PySpark or pure python notebook.
  • get_lakehouse_columns Now supports Service Principal authentication. This function can now be executed in either a PySpark or pure python notebook.

Bug Fixes

• #616
• #622
• sempy_labs
  • Fixed issue with Direct Lake semantic models using vertipaq_analyzer
  • Fixed issue with get_semantic_model_size
• sempy_labs.admin
  • list_unused_artifacts Fixed reversed name and ID.
• sempy_labs.directlake
  • Fixed issue in generate_shared_expression for Direct Lake over OneLake connections

semantic-link-labs 0.9.9

• Fixed issue with semantic link scopes for particular Fabric API references
• Fixed issue with create_abfss_path

semantic-link-labs 0.9.8

• Fixed bug regarding duplicated 'resolve' functions.

semantic-link-labs 0.9.7

New Functions

• sempy_labs
  • delta_analyzer_history Thanks @dax-tips!
• sempy_labs.lakehouse
  • recover_lakehouse_object Recovers a deleted object (i.e. table/file/folder) from a lakehouse (#123). Thanks @hurtn!
  • list_blobs lists the blob files for a given lakehouse.
• sempy_labs.report
  • save_report_as_pbip Saves a report in the service as a .pbip file within the specified lakehouse. This is a solution to downloading 'undownloadable' reports/models (which are likely undownloadable due to changes made via XMLA R/W).
• sempy_labs.tom
  • convert_direct_lake_to_import Converts a table which is in Direct Lake mode to import mode using the specified source as the source (lakehouse or warehouse).

Updated Functions

• sempy_labs
  • run_model_bpa_bulk The 'workspace' parameter now supports both workspace names and/or IDs (#568).
• sempy_labs.admin
  • list_domain_tenant_settings_overrides now shows the Domain Id.
  • list_workspaces_tenant_settings_overrides now shows the Workspace Id.
• sempy_labs.directlake
  • generate_shared_expression Added the 'use_sql_endpoint' parameter. If set to False, will build a 'Direct Lake over OneLake' connection to the lakehouse (if a lakehouse is specified as the item type).
• sempy_labs.lakehouse
  • create_shortcut_onelake Added the 'shortcut_conflict_policy' parameter (#587).
• sempy_labs.migration
  • migrate_direct_lake_to_import Added the 'tables' and 'mode' parameters which allow you to migrate a portion of the Direct Lake semantic model to either import or DirectQuery. Specifying tables will only migrate those tables to the mode which you specify.

Bug Fixes

• #561
• #573
• #581
• #595

semantic-link-labs 0.9.6

New Functions

• sempy_labs
  • Semantic Models
    • generate_dax_query_view_url prints a URL which opens DAX Query View with the specified query to the specified semantic model. Thanks @DataZoe!
    • delete_semantic_model
  • Workspaces
    • delete_workspace
  • SQL Database
    • create_sql_database
    • delete_sql_database
    • list_sql_databases

Updated Functions

• sempy_labs
  • delta_analyzer added the optional 'schema' parameter to support schema-enabled tables (#547).
  • get_delta_table_history added the optional 'schema' parameter to support schema-enabled tables.
  • create_abfss_path added the optional 'schema' parameter.
• sempy_labs.directlake
  • direct_lake_schema_sync added the 'remove_from_model' parameter (#448). This function also now returns a dataframe.

Service Principal

The following functions now support service principal authentication:

• list_environments
• publish_environment
• list_eventhouses
• list_graphql_apis
• list_kql_databases
• list_lakehouses
• create_managed_private_endpoint
• list_managed_private_endpoints
• delete_managed_private_endpoint
• list_mirrored_databases
• list_sql_databases
• list_warehouses
• provision_workspace_identity
• deprovision_workspace_identity
• delete_user_from_workspace
• update_workspace_user
• list_workspace_users
• unassign_workspace_from_capacity
• list_workspace_role_assignments
• delete_workspace

Bug Fixes

• #551

Maintenance

• Refactored 'resolve' functions to support Service Principal. This will enable many more functions (listed above) in Semantic Link Labs to support Service Principal authentication.

semantic-link-labs 0.9.5

New Functions

• sempy_labs
  • Git
    • get_my_git_credentials
    • update_my_git_credentials
  • Mounted Data Factories
    • list_mounted_data_factories
    • delete_mounted_data_factory
    • get_mounted_data_factory_definition
• sempy_labs.admin
  • Artifacts
    • list_unused_artifacts
  • Capacities
    • list_capacity_users
  • Subscriptions
    • list_user_subscriptions
    • list_report_subscriptions
  • Workspaces
    • add_user_to_workspace (#539)
    • delete_user_from_workspace
    • restore_deleted_workspace

Updated Functions

• sempy_labs
  • vertipaq_analyzer Now returns a dictionary of dataframes (#481, #538).
  • The following functions changed the 'capacity_name' parameter to 'capacity' and now accept either the capacity name or ID: resolve_capacity_id, delete_premium_capacity, delete_fabric_capacity, create_vnet_gateway
• sempy_labs.directlake
  • update_direct_lake_partition_entity Added the 'schema' parameter for working with schema-enabled lakehouses. Setting this parameter to None keeps the existing schema.
• sempy_labs.lakehouse
  • list_shortcuts Moved this function to the lakehouse subpackage. It will remain in the sempy_labs subpackage for some time so as not to break existing code but please update your code to use this funtion in this new location (where it should have been all along). Added the 'path' parameter and improved the code (thanks @lBilali!).
  • create_shortcut_onelake
    • Now checks whether the shortcut already exists before creating the shortcut (#521).
• sempy_labs.tom
  • add_to_perspective Added the 'include_all' property, relevant for tables only.
  • has_incremental_refresh_policy Updated the parameter to take a TOM object instead of a table name. This is a breaking change.

Bug Fixes

• #518
• #522
• #524

semantic-link-labs 0.9.4

New Functions

• sempy_labs
  • Eventhouses
    • get_eventhouse_definition
  • Semantic Models
    • get_semantic_model_refresh_schedule
    • enable_semantic_model_scheduled_refresh
  • Delta Tables
    • get_delta_table_history
  • SQL Databases (Thanks @achrafcei!)
    • ConnectSQLDatabase
    • get_sql_database_tables
    • get_sql_database_columns
  • Job Scheduler
    • create_item_schedule_cron
    • create_item_schedule_daily
    • create_item_schedule_weekly
• sempy_labs.admin
  • Widely Shared Artifacts
    • list_widely_shared_artifacts Both of the widely shared artifacts APIs can be called from this single function. Simply specify the 'api_name' parameter accordingly.
  • Apps
    • list_apps
    • list_app_users
  • Semantic Models
    • list_dataset_users
  • Reports
    • list_report_users
  • Workspaces
    • list_workspace_users
  • Capacities
    • patch_capacity
  • Tenants
    • list_capacity_tenant_settings_overrides (use this instead of list_capacities_delegated_tenant_settings
    • delete_capacity_tenant_setting_override
    • update_tenant_setting
    • update_capacity_tenant_setting_override
    • list_workspaces_tenant_settings_overrides
    • list_domain_tenant_settings_overrides
• sempy_labs.tom
  • get_bim Gets the bim file for the semantic model

Updated Functions

• sempy_labs
  • run_model_bpa Now supports rules based on calculated tables and calculated columns
  • model_bpa_rules Updated DAX expression rules to check calculated tables & calculated columns.
  • deploy_semantic_model Added the 'perspective' parameter. Set this parameter to a perspective within the model to reduce the deployed model to only the objects within that perspective. Dependent objects (i.e. columns, measures, tables) are also added into the deployed model to ensure an errorless model. This technique is akin to the master model technique.
  • create_eventhouse Added the 'definition' parameter which accepts the 'EventhouseProperties.json' definition.
  • initialize_git_connection Added the 'initialization_strategy' parameter. Thanks @hurtn!
  • export_report Added the 'lakehouse' and 'lakehouse_workspace' parameters so this function can export a report to any lakehouse/workspace (#494).
  • delta_analyzer this function now supports analyzer partitioned delta tables. Also added the 'column_stats' parameter. If this is set to False, only the first 3 dataframes are returned (thereby executing faster).
  • evaluate_dax_impersonation Better handling of optional columns (#499).
  • ConnectLakehouse, ConnectWarehouse updated default timeout to 30 seconds.
• sempy_labs.graph
  • send_mail added the 'content_type' parameter which allows you to send either Text or HTML emails. Thanks @pawarbi for the suggestion!
• sempy_labs.lakehouse
  • create_shortcut_onelake added the 'source_path' and 'destination_path' parameters to make the function more flexible in working not just with tables but also with files (and able to map not just to a folder but to subfolders (#475).
  • delete_shortcut added the 'shortcut_path' parameter to make the function more flexible in working not just with tables but also with files (#480).
• sempy_labs.tom
  • remove_translation Added the 'property' parameter so you can remove not just translated names but also descriptions and display folders.
  • remove_object Updated accordingly for the update to remove_translation

Bug Fixes

• #442
• #467
• #473
• #495
• #500
• Fixed issue with graph.list_teams

semantic-link-labs 0.9.3

Improvements

• Updated Functions

  • sempy_labs
    • delta_analyzer Added 'lakehouse' and 'workspace' parameters so now you can analyze any delta table from any lakehouse/workspace - not just in the lakehouse attached to the notebook. Note that if you export the delta analyzer results they will be saved to delta tables in the lakehouse attached to the notebook.
    • create_abfss_path Made the 'delta_table_name' parameter optional so this function can also build the abfss path of a given lakehouse (not just a delta table).
    • Connection & Gateway functions now support Service Principal Authentication. Thanks @ecotte!
  • sempy_labs.admin
    • scan_workspaces Limited to 100 workspaces (per API limit). Improvements for passing workspace name/IDs. Thanks @ecotte!

• General updates

  • Most functions in semantic link labs can be executed using pure python notebooks. Some functions (in some instances) require PySpark notebooks. If you run a function which requires a PySpark notebook in a pure python notebook, a friendly error message will notify you as such.

Bug Fixes

• #398
• #444
• #445
• #447
• Bug in report_rebind has been resolved.

semantic-link-labs 0.9.2

Improvements

• New Functions

  • sempy_labs
    • delta_analyzer Provides statistics about delta tables, specifically relevant regarding their use in Direct Lake semantic models. This code is based on the work of @dax-tips! More info can be found here.
    • list_synonyms Lists the synonyms from a semantic model's linguistic schema
    • GraphQL
      • list_graphql_apis
      • create_graphql_api
  • sempy_labs.admin
    • get_capacity_state (#424).
  • $${\color{green}NEW!}$$ sempy_labs.graph functions to support Microsoft Graph)
    • Users
      • get_user
      • list_users
      • send_mail
      • resolve_user_id
    • Groups
      • list_groups
      • list_group_owners
      • list_group_members
      • add_group_members
      • add_group_owners
      • resolve_group_id
      • renew_group
    • Teams
      • list_teams
  • sempy_labs.lakehouse
    • reset_shortcut_cache
    • run_table_maintenance
  • sempy_labs.migration
    • migrate_direct_lake_to_import In-place migration of a semantic model from Direct Lake mode to Import mode.

• Updated Functions

  • sempy_labs
    • list_deployment_pipeline_stages parameters now accept either name or ID.
    • list_deployment_pipeline_stage_items parameters now accept either name or ID. Changed parameter 'stage_name' to 'stage' as it can be either name or ID.
  • sempy_labs.admin
    • All 'domain' functions accept either name or ID. The parameter is now 'domain' instead of 'domain_name'.
  • sempy_labs.lakehouse
    • lakehouse_attached No longer uses Spark to determine if a lakehouse is attached to the notebook.

Bug Fixes

• #423
• #430
• #436

Maintenance

• Functions which query Microsoft APIs now use an internal function (in Semantic Link Labs) to reduce and simplify code.
• Functions which return pandas dataframes and specify data types have been refactored to reduce and simplify code.

Notebooks

• Delta Analyzer Shows how to use the new delta_analyzer function.
• Service Principal Added examples for using the new wrapper functions for Microsoft Graph which were released in this version.